00:00:00.000 Started by upstream project "autotest-nightly-lts" build number 2406 00:00:00.000 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3667 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.139 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.140 The recommended git tool is: git 00:00:00.140 using credential 00000000-0000-0000-0000-000000000002 00:00:00.146 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.168 Fetching changes from the remote Git repository 00:00:00.170 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.195 Using shallow fetch with depth 1 00:00:00.195 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.195 > git --version # timeout=10 00:00:00.224 > git --version # 'git version 2.39.2' 00:00:00.224 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.241 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.241 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.452 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.463 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.477 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.477 > git config core.sparsecheckout # timeout=10 00:00:05.490 > git read-tree -mu HEAD # timeout=10 00:00:05.507 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.529 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.529 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.621 [Pipeline] Start of Pipeline 00:00:05.635 [Pipeline] library 00:00:05.636 Loading library shm_lib@master 00:00:05.636 Library shm_lib@master is cached. Copying from home. 00:00:05.656 [Pipeline] node 00:00:05.666 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:05.667 [Pipeline] { 00:00:05.678 [Pipeline] catchError 00:00:05.680 [Pipeline] { 00:00:05.693 [Pipeline] wrap 00:00:05.700 [Pipeline] { 00:00:05.706 [Pipeline] stage 00:00:05.707 [Pipeline] { (Prologue) 00:00:05.911 [Pipeline] sh 00:00:06.193 + logger -p user.info -t JENKINS-CI 00:00:06.208 [Pipeline] echo 00:00:06.209 Node: GP11 00:00:06.217 [Pipeline] sh 00:00:06.519 [Pipeline] setCustomBuildProperty 00:00:06.529 [Pipeline] echo 00:00:06.531 Cleanup processes 00:00:06.536 [Pipeline] sh 00:00:06.821 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.821 851110 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:06.833 [Pipeline] sh 00:00:07.114 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.114 ++ grep -v 'sudo pgrep' 00:00:07.114 ++ awk '{print $1}' 00:00:07.114 + sudo kill -9 00:00:07.114 + true 00:00:07.126 [Pipeline] cleanWs 00:00:07.134 [WS-CLEANUP] Deleting project workspace... 00:00:07.134 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.141 [WS-CLEANUP] done 00:00:07.144 [Pipeline] setCustomBuildProperty 00:00:07.152 [Pipeline] sh 00:00:07.432 + sudo git config --global --replace-all safe.directory '*' 00:00:07.497 [Pipeline] httpRequest 00:00:10.099 [Pipeline] echo 00:00:10.100 Sorcerer 10.211.164.101 is alive 00:00:10.111 [Pipeline] retry 00:00:10.113 [Pipeline] { 00:00:10.127 [Pipeline] httpRequest 00:00:10.131 HttpMethod: GET 00:00:10.131 URL: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.133 Sending request to url: http://10.211.164.101/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.140 Response Code: HTTP/1.1 200 OK 00:00:10.140 Success: Status code 200 is in the accepted range: 200,404 00:00:10.140 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:11.200 [Pipeline] } 00:00:11.216 [Pipeline] // retry 00:00:11.223 [Pipeline] sh 00:00:11.508 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:11.527 [Pipeline] httpRequest 00:00:12.480 [Pipeline] echo 00:00:12.483 Sorcerer 10.211.164.101 is alive 00:00:12.492 [Pipeline] retry 00:00:12.495 [Pipeline] { 00:00:12.509 [Pipeline] httpRequest 00:00:12.514 HttpMethod: GET 00:00:12.515 URL: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.515 Sending request to url: http://10.211.164.101/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.546 Response Code: HTTP/1.1 200 OK 00:00:12.547 Success: Status code 200 is in the accepted range: 200,404 00:00:12.547 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:15.789 [Pipeline] } 00:01:15.807 [Pipeline] // retry 00:01:15.814 [Pipeline] sh 00:01:16.103 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:18.651 [Pipeline] sh 00:01:18.940 + git -C spdk log --oneline -n5 00:01:18.940 c13c99a5e test: Various fixes for Fedora40 00:01:18.940 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:18.940 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:18.940 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:18.940 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:18.949 [Pipeline] } 00:01:18.957 [Pipeline] // stage 00:01:18.964 [Pipeline] stage 00:01:18.966 [Pipeline] { (Prepare) 00:01:18.980 [Pipeline] writeFile 00:01:18.993 [Pipeline] sh 00:01:19.277 + logger -p user.info -t JENKINS-CI 00:01:19.290 [Pipeline] sh 00:01:19.575 + logger -p user.info -t JENKINS-CI 00:01:19.589 [Pipeline] sh 00:01:19.876 + cat autorun-spdk.conf 00:01:19.876 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:19.876 SPDK_TEST_NVMF=1 00:01:19.876 SPDK_TEST_NVME_CLI=1 00:01:19.876 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:19.876 SPDK_TEST_NVMF_NICS=e810 00:01:19.876 SPDK_RUN_UBSAN=1 00:01:19.876 NET_TYPE=phy 00:01:19.884 RUN_NIGHTLY=1 00:01:19.889 [Pipeline] readFile 00:01:19.915 [Pipeline] withEnv 00:01:19.917 [Pipeline] { 00:01:19.929 [Pipeline] sh 00:01:20.215 + set -ex 00:01:20.215 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:20.215 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:20.215 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.215 ++ SPDK_TEST_NVMF=1 00:01:20.215 ++ SPDK_TEST_NVME_CLI=1 00:01:20.215 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.215 ++ SPDK_TEST_NVMF_NICS=e810 00:01:20.215 ++ SPDK_RUN_UBSAN=1 00:01:20.215 ++ NET_TYPE=phy 00:01:20.215 ++ RUN_NIGHTLY=1 00:01:20.215 + case $SPDK_TEST_NVMF_NICS in 00:01:20.215 + DRIVERS=ice 00:01:20.215 + [[ tcp == \r\d\m\a ]] 00:01:20.215 + [[ -n ice ]] 00:01:20.215 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:20.215 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:20.215 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:20.215 rmmod: ERROR: Module irdma is not currently loaded 00:01:20.215 rmmod: ERROR: Module i40iw is not currently loaded 00:01:20.215 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:20.215 + true 00:01:20.215 + for D in $DRIVERS 00:01:20.215 + sudo modprobe ice 00:01:20.215 + exit 0 00:01:20.226 [Pipeline] } 00:01:20.241 [Pipeline] // withEnv 00:01:20.246 [Pipeline] } 00:01:20.259 [Pipeline] // stage 00:01:20.268 [Pipeline] catchError 00:01:20.270 [Pipeline] { 00:01:20.285 [Pipeline] timeout 00:01:20.286 Timeout set to expire in 1 hr 0 min 00:01:20.288 [Pipeline] { 00:01:20.302 [Pipeline] stage 00:01:20.304 [Pipeline] { (Tests) 00:01:20.318 [Pipeline] sh 00:01:20.605 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.605 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.605 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.605 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:20.605 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:20.605 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:20.605 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:20.605 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:20.605 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:20.605 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:20.605 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:20.605 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.605 + source /etc/os-release 00:01:20.605 ++ NAME='Fedora Linux' 00:01:20.605 ++ VERSION='39 (Cloud Edition)' 00:01:20.605 ++ ID=fedora 00:01:20.605 ++ VERSION_ID=39 00:01:20.605 ++ VERSION_CODENAME= 00:01:20.605 ++ PLATFORM_ID=platform:f39 00:01:20.605 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:20.605 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:20.605 ++ LOGO=fedora-logo-icon 00:01:20.605 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:20.605 ++ HOME_URL=https://fedoraproject.org/ 00:01:20.605 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:20.605 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:20.605 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:20.605 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:20.605 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:20.605 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:20.605 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:20.605 ++ SUPPORT_END=2024-11-12 00:01:20.605 ++ VARIANT='Cloud Edition' 00:01:20.605 ++ VARIANT_ID=cloud 00:01:20.605 + uname -a 00:01:20.605 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:20.605 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:21.547 Hugepages 00:01:21.547 node hugesize free / total 00:01:21.547 node0 1048576kB 0 / 0 00:01:21.547 node0 2048kB 0 / 0 00:01:21.547 node1 1048576kB 0 / 0 00:01:21.547 node1 2048kB 0 / 0 00:01:21.547 00:01:21.547 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:21.547 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:21.547 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:21.547 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:21.547 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:21.547 + rm -f /tmp/spdk-ld-path 00:01:21.547 + source autorun-spdk.conf 00:01:21.547 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.547 ++ SPDK_TEST_NVMF=1 00:01:21.547 ++ SPDK_TEST_NVME_CLI=1 00:01:21.547 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.547 ++ SPDK_TEST_NVMF_NICS=e810 00:01:21.547 ++ SPDK_RUN_UBSAN=1 00:01:21.547 ++ NET_TYPE=phy 00:01:21.547 ++ RUN_NIGHTLY=1 00:01:21.547 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:21.547 + [[ -n '' ]] 00:01:21.547 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.547 + for M in /var/spdk/build-*-manifest.txt 00:01:21.547 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:21.547 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.547 + for M in /var/spdk/build-*-manifest.txt 00:01:21.547 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:21.547 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.547 + for M in /var/spdk/build-*-manifest.txt 00:01:21.547 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:21.547 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.547 ++ uname 00:01:21.547 + [[ Linux == \L\i\n\u\x ]] 00:01:21.547 + sudo dmesg -T 00:01:21.547 + sudo dmesg --clear 00:01:21.547 + dmesg_pid=852411 00:01:21.547 + [[ Fedora Linux == FreeBSD ]] 00:01:21.547 + sudo dmesg -Tw 00:01:21.547 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:21.547 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:21.547 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:21.547 + [[ -x /usr/src/fio-static/fio ]] 00:01:21.547 + export FIO_BIN=/usr/src/fio-static/fio 00:01:21.547 + FIO_BIN=/usr/src/fio-static/fio 00:01:21.547 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:21.547 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:21.547 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:21.547 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:21.547 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:21.547 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:21.547 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:21.547 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:21.547 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:21.547 Test configuration: 00:01:21.547 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.547 SPDK_TEST_NVMF=1 00:01:21.547 SPDK_TEST_NVME_CLI=1 00:01:21.547 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.547 SPDK_TEST_NVMF_NICS=e810 00:01:21.547 SPDK_RUN_UBSAN=1 00:01:21.547 NET_TYPE=phy 00:01:21.547 RUN_NIGHTLY=1 00:54:12 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:21.547 00:54:12 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:21.547 00:54:12 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:21.547 00:54:12 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:21.547 00:54:12 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:21.547 00:54:12 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.547 00:54:12 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.547 00:54:12 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.548 00:54:12 -- paths/export.sh@5 -- $ export PATH 00:01:21.548 00:54:12 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.548 00:54:12 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:21.548 00:54:12 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:21.548 00:54:12 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732578852.XXXXXX 00:01:21.548 00:54:12 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732578852.FDBnnZ 00:01:21.548 00:54:12 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:21.548 00:54:12 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:21.548 00:54:12 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:21.548 00:54:12 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:21.548 00:54:12 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:21.548 00:54:12 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:21.548 00:54:12 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:21.548 00:54:12 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.807 00:54:12 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:21.807 00:54:12 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:21.807 00:54:12 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:21.807 00:54:12 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.807 00:54:12 -- spdk/autobuild.sh@16 -- $ date -u 00:01:21.807 Mon Nov 25 11:54:12 PM UTC 2024 00:01:21.807 00:54:12 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:21.807 LTS-67-gc13c99a5e 00:01:21.807 00:54:12 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:21.807 00:54:12 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:21.807 00:54:12 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:21.807 00:54:12 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:21.807 00:54:12 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:21.807 00:54:12 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.807 ************************************ 00:01:21.807 START TEST ubsan 00:01:21.807 ************************************ 00:01:21.807 00:54:12 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:21.807 using ubsan 00:01:21.807 00:01:21.807 real 0m0.000s 00:01:21.807 user 0m0.000s 00:01:21.807 sys 0m0.000s 00:01:21.807 00:54:12 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:21.807 00:54:12 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.807 ************************************ 00:01:21.807 END TEST ubsan 00:01:21.807 ************************************ 00:01:21.807 00:54:12 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:21.807 00:54:12 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:21.807 00:54:12 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:21.807 00:54:12 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:21.807 00:54:12 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:21.807 00:54:12 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:21.807 00:54:12 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:21.807 00:54:12 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:21.807 00:54:12 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:21.807 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:21.807 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:22.065 Using 'verbs' RDMA provider 00:01:32.636 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:42.653 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:42.653 Creating mk/config.mk...done. 00:01:42.653 Creating mk/cc.flags.mk...done. 00:01:42.653 Type 'make' to build. 00:01:42.653 00:54:32 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:42.653 00:54:32 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:42.653 00:54:32 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:42.653 00:54:32 -- common/autotest_common.sh@10 -- $ set +x 00:01:42.653 ************************************ 00:01:42.653 START TEST make 00:01:42.653 ************************************ 00:01:42.653 00:54:32 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:42.653 make[1]: Nothing to be done for 'all'. 00:01:50.798 The Meson build system 00:01:50.798 Version: 1.5.0 00:01:50.798 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:50.798 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:50.798 Build type: native build 00:01:50.798 Program cat found: YES (/usr/bin/cat) 00:01:50.798 Project name: DPDK 00:01:50.798 Project version: 23.11.0 00:01:50.798 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:50.798 C linker for the host machine: cc ld.bfd 2.40-14 00:01:50.798 Host machine cpu family: x86_64 00:01:50.798 Host machine cpu: x86_64 00:01:50.798 Message: ## Building in Developer Mode ## 00:01:50.798 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:50.798 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:50.798 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:50.798 Program python3 found: YES (/usr/bin/python3) 00:01:50.798 Program cat found: YES (/usr/bin/cat) 00:01:50.798 Compiler for C supports arguments -march=native: YES 00:01:50.798 Checking for size of "void *" : 8 00:01:50.798 Checking for size of "void *" : 8 (cached) 00:01:50.798 Library m found: YES 00:01:50.798 Library numa found: YES 00:01:50.798 Has header "numaif.h" : YES 00:01:50.798 Library fdt found: NO 00:01:50.798 Library execinfo found: NO 00:01:50.798 Has header "execinfo.h" : YES 00:01:50.798 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:50.798 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:50.798 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:50.798 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:50.798 Run-time dependency openssl found: YES 3.1.1 00:01:50.798 Run-time dependency libpcap found: YES 1.10.4 00:01:50.798 Has header "pcap.h" with dependency libpcap: YES 00:01:50.798 Compiler for C supports arguments -Wcast-qual: YES 00:01:50.798 Compiler for C supports arguments -Wdeprecated: YES 00:01:50.798 Compiler for C supports arguments -Wformat: YES 00:01:50.798 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:50.798 Compiler for C supports arguments -Wformat-security: NO 00:01:50.798 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:50.798 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:50.798 Compiler for C supports arguments -Wnested-externs: YES 00:01:50.798 Compiler for C supports arguments -Wold-style-definition: YES 00:01:50.798 Compiler for C supports arguments -Wpointer-arith: YES 00:01:50.798 Compiler for C supports arguments -Wsign-compare: YES 00:01:50.798 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:50.798 Compiler for C supports arguments -Wundef: YES 00:01:50.798 Compiler for C supports arguments -Wwrite-strings: YES 00:01:50.798 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:50.798 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:50.798 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:50.798 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:50.798 Program objdump found: YES (/usr/bin/objdump) 00:01:50.798 Compiler for C supports arguments -mavx512f: YES 00:01:50.798 Checking if "AVX512 checking" compiles: YES 00:01:50.798 Fetching value of define "__SSE4_2__" : 1 00:01:50.798 Fetching value of define "__AES__" : 1 00:01:50.798 Fetching value of define "__AVX__" : 1 00:01:50.798 Fetching value of define "__AVX2__" : (undefined) 00:01:50.798 Fetching value of define "__AVX512BW__" : (undefined) 00:01:50.798 Fetching value of define "__AVX512CD__" : (undefined) 00:01:50.798 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:50.798 Fetching value of define "__AVX512F__" : (undefined) 00:01:50.798 Fetching value of define "__AVX512VL__" : (undefined) 00:01:50.798 Fetching value of define "__PCLMUL__" : 1 00:01:50.798 Fetching value of define "__RDRND__" : 1 00:01:50.798 Fetching value of define "__RDSEED__" : (undefined) 00:01:50.798 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:50.798 Fetching value of define "__znver1__" : (undefined) 00:01:50.798 Fetching value of define "__znver2__" : (undefined) 00:01:50.798 Fetching value of define "__znver3__" : (undefined) 00:01:50.798 Fetching value of define "__znver4__" : (undefined) 00:01:50.798 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:50.798 Message: lib/log: Defining dependency "log" 00:01:50.798 Message: lib/kvargs: Defining dependency "kvargs" 00:01:50.798 Message: lib/telemetry: Defining dependency "telemetry" 00:01:50.798 Checking for function "getentropy" : NO 00:01:50.798 Message: lib/eal: Defining dependency "eal" 00:01:50.798 Message: lib/ring: Defining dependency "ring" 00:01:50.798 Message: lib/rcu: Defining dependency "rcu" 00:01:50.798 Message: lib/mempool: Defining dependency "mempool" 00:01:50.798 Message: lib/mbuf: Defining dependency "mbuf" 00:01:50.798 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:50.798 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:50.798 Compiler for C supports arguments -mpclmul: YES 00:01:50.798 Compiler for C supports arguments -maes: YES 00:01:50.798 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:50.798 Compiler for C supports arguments -mavx512bw: YES 00:01:50.798 Compiler for C supports arguments -mavx512dq: YES 00:01:50.798 Compiler for C supports arguments -mavx512vl: YES 00:01:50.798 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:50.798 Compiler for C supports arguments -mavx2: YES 00:01:50.798 Compiler for C supports arguments -mavx: YES 00:01:50.798 Message: lib/net: Defining dependency "net" 00:01:50.798 Message: lib/meter: Defining dependency "meter" 00:01:50.798 Message: lib/ethdev: Defining dependency "ethdev" 00:01:50.798 Message: lib/pci: Defining dependency "pci" 00:01:50.798 Message: lib/cmdline: Defining dependency "cmdline" 00:01:50.798 Message: lib/hash: Defining dependency "hash" 00:01:50.798 Message: lib/timer: Defining dependency "timer" 00:01:50.798 Message: lib/compressdev: Defining dependency "compressdev" 00:01:50.798 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:50.798 Message: lib/dmadev: Defining dependency "dmadev" 00:01:50.798 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:50.798 Message: lib/power: Defining dependency "power" 00:01:50.798 Message: lib/reorder: Defining dependency "reorder" 00:01:50.798 Message: lib/security: Defining dependency "security" 00:01:50.798 Has header "linux/userfaultfd.h" : YES 00:01:50.798 Has header "linux/vduse.h" : YES 00:01:50.798 Message: lib/vhost: Defining dependency "vhost" 00:01:50.798 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:50.799 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:50.799 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:50.799 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:50.799 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:50.799 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:50.799 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:50.799 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:50.799 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:50.799 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:50.799 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:50.799 Configuring doxy-api-html.conf using configuration 00:01:50.799 Configuring doxy-api-man.conf using configuration 00:01:50.799 Program mandb found: YES (/usr/bin/mandb) 00:01:50.799 Program sphinx-build found: NO 00:01:50.799 Configuring rte_build_config.h using configuration 00:01:50.799 Message: 00:01:50.799 ================= 00:01:50.799 Applications Enabled 00:01:50.799 ================= 00:01:50.799 00:01:50.799 apps: 00:01:50.799 00:01:50.799 00:01:50.799 Message: 00:01:50.799 ================= 00:01:50.799 Libraries Enabled 00:01:50.799 ================= 00:01:50.799 00:01:50.799 libs: 00:01:50.799 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:50.799 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:50.799 cryptodev, dmadev, power, reorder, security, vhost, 00:01:50.799 00:01:50.799 Message: 00:01:50.799 =============== 00:01:50.799 Drivers Enabled 00:01:50.799 =============== 00:01:50.799 00:01:50.799 common: 00:01:50.799 00:01:50.799 bus: 00:01:50.799 pci, vdev, 00:01:50.799 mempool: 00:01:50.799 ring, 00:01:50.799 dma: 00:01:50.799 00:01:50.799 net: 00:01:50.799 00:01:50.799 crypto: 00:01:50.799 00:01:50.799 compress: 00:01:50.799 00:01:50.799 vdpa: 00:01:50.799 00:01:50.799 00:01:50.799 Message: 00:01:50.799 ================= 00:01:50.799 Content Skipped 00:01:50.799 ================= 00:01:50.799 00:01:50.799 apps: 00:01:50.799 dumpcap: explicitly disabled via build config 00:01:50.799 graph: explicitly disabled via build config 00:01:50.799 pdump: explicitly disabled via build config 00:01:50.799 proc-info: explicitly disabled via build config 00:01:50.799 test-acl: explicitly disabled via build config 00:01:50.799 test-bbdev: explicitly disabled via build config 00:01:50.799 test-cmdline: explicitly disabled via build config 00:01:50.799 test-compress-perf: explicitly disabled via build config 00:01:50.799 test-crypto-perf: explicitly disabled via build config 00:01:50.799 test-dma-perf: explicitly disabled via build config 00:01:50.799 test-eventdev: explicitly disabled via build config 00:01:50.799 test-fib: explicitly disabled via build config 00:01:50.799 test-flow-perf: explicitly disabled via build config 00:01:50.799 test-gpudev: explicitly disabled via build config 00:01:50.799 test-mldev: explicitly disabled via build config 00:01:50.799 test-pipeline: explicitly disabled via build config 00:01:50.799 test-pmd: explicitly disabled via build config 00:01:50.799 test-regex: explicitly disabled via build config 00:01:50.799 test-sad: explicitly disabled via build config 00:01:50.799 test-security-perf: explicitly disabled via build config 00:01:50.799 00:01:50.799 libs: 00:01:50.799 metrics: explicitly disabled via build config 00:01:50.799 acl: explicitly disabled via build config 00:01:50.799 bbdev: explicitly disabled via build config 00:01:50.799 bitratestats: explicitly disabled via build config 00:01:50.799 bpf: explicitly disabled via build config 00:01:50.799 cfgfile: explicitly disabled via build config 00:01:50.799 distributor: explicitly disabled via build config 00:01:50.799 efd: explicitly disabled via build config 00:01:50.799 eventdev: explicitly disabled via build config 00:01:50.799 dispatcher: explicitly disabled via build config 00:01:50.799 gpudev: explicitly disabled via build config 00:01:50.799 gro: explicitly disabled via build config 00:01:50.799 gso: explicitly disabled via build config 00:01:50.799 ip_frag: explicitly disabled via build config 00:01:50.799 jobstats: explicitly disabled via build config 00:01:50.799 latencystats: explicitly disabled via build config 00:01:50.799 lpm: explicitly disabled via build config 00:01:50.799 member: explicitly disabled via build config 00:01:50.799 pcapng: explicitly disabled via build config 00:01:50.799 rawdev: explicitly disabled via build config 00:01:50.799 regexdev: explicitly disabled via build config 00:01:50.799 mldev: explicitly disabled via build config 00:01:50.799 rib: explicitly disabled via build config 00:01:50.799 sched: explicitly disabled via build config 00:01:50.799 stack: explicitly disabled via build config 00:01:50.799 ipsec: explicitly disabled via build config 00:01:50.799 pdcp: explicitly disabled via build config 00:01:50.799 fib: explicitly disabled via build config 00:01:50.799 port: explicitly disabled via build config 00:01:50.799 pdump: explicitly disabled via build config 00:01:50.799 table: explicitly disabled via build config 00:01:50.799 pipeline: explicitly disabled via build config 00:01:50.799 graph: explicitly disabled via build config 00:01:50.799 node: explicitly disabled via build config 00:01:50.799 00:01:50.799 drivers: 00:01:50.799 common/cpt: not in enabled drivers build config 00:01:50.799 common/dpaax: not in enabled drivers build config 00:01:50.799 common/iavf: not in enabled drivers build config 00:01:50.799 common/idpf: not in enabled drivers build config 00:01:50.799 common/mvep: not in enabled drivers build config 00:01:50.799 common/octeontx: not in enabled drivers build config 00:01:50.799 bus/auxiliary: not in enabled drivers build config 00:01:50.799 bus/cdx: not in enabled drivers build config 00:01:50.799 bus/dpaa: not in enabled drivers build config 00:01:50.799 bus/fslmc: not in enabled drivers build config 00:01:50.799 bus/ifpga: not in enabled drivers build config 00:01:50.799 bus/platform: not in enabled drivers build config 00:01:50.799 bus/vmbus: not in enabled drivers build config 00:01:50.799 common/cnxk: not in enabled drivers build config 00:01:50.799 common/mlx5: not in enabled drivers build config 00:01:50.799 common/nfp: not in enabled drivers build config 00:01:50.799 common/qat: not in enabled drivers build config 00:01:50.799 common/sfc_efx: not in enabled drivers build config 00:01:50.799 mempool/bucket: not in enabled drivers build config 00:01:50.799 mempool/cnxk: not in enabled drivers build config 00:01:50.799 mempool/dpaa: not in enabled drivers build config 00:01:50.799 mempool/dpaa2: not in enabled drivers build config 00:01:50.799 mempool/octeontx: not in enabled drivers build config 00:01:50.799 mempool/stack: not in enabled drivers build config 00:01:50.799 dma/cnxk: not in enabled drivers build config 00:01:50.799 dma/dpaa: not in enabled drivers build config 00:01:50.799 dma/dpaa2: not in enabled drivers build config 00:01:50.799 dma/hisilicon: not in enabled drivers build config 00:01:50.799 dma/idxd: not in enabled drivers build config 00:01:50.799 dma/ioat: not in enabled drivers build config 00:01:50.799 dma/skeleton: not in enabled drivers build config 00:01:50.799 net/af_packet: not in enabled drivers build config 00:01:50.799 net/af_xdp: not in enabled drivers build config 00:01:50.799 net/ark: not in enabled drivers build config 00:01:50.799 net/atlantic: not in enabled drivers build config 00:01:50.799 net/avp: not in enabled drivers build config 00:01:50.799 net/axgbe: not in enabled drivers build config 00:01:50.799 net/bnx2x: not in enabled drivers build config 00:01:50.799 net/bnxt: not in enabled drivers build config 00:01:50.799 net/bonding: not in enabled drivers build config 00:01:50.799 net/cnxk: not in enabled drivers build config 00:01:50.799 net/cpfl: not in enabled drivers build config 00:01:50.799 net/cxgbe: not in enabled drivers build config 00:01:50.799 net/dpaa: not in enabled drivers build config 00:01:50.799 net/dpaa2: not in enabled drivers build config 00:01:50.799 net/e1000: not in enabled drivers build config 00:01:50.799 net/ena: not in enabled drivers build config 00:01:50.799 net/enetc: not in enabled drivers build config 00:01:50.799 net/enetfec: not in enabled drivers build config 00:01:50.799 net/enic: not in enabled drivers build config 00:01:50.799 net/failsafe: not in enabled drivers build config 00:01:50.799 net/fm10k: not in enabled drivers build config 00:01:50.799 net/gve: not in enabled drivers build config 00:01:50.799 net/hinic: not in enabled drivers build config 00:01:50.799 net/hns3: not in enabled drivers build config 00:01:50.799 net/i40e: not in enabled drivers build config 00:01:50.799 net/iavf: not in enabled drivers build config 00:01:50.799 net/ice: not in enabled drivers build config 00:01:50.799 net/idpf: not in enabled drivers build config 00:01:50.800 net/igc: not in enabled drivers build config 00:01:50.800 net/ionic: not in enabled drivers build config 00:01:50.800 net/ipn3ke: not in enabled drivers build config 00:01:50.800 net/ixgbe: not in enabled drivers build config 00:01:50.800 net/mana: not in enabled drivers build config 00:01:50.800 net/memif: not in enabled drivers build config 00:01:50.800 net/mlx4: not in enabled drivers build config 00:01:50.800 net/mlx5: not in enabled drivers build config 00:01:50.800 net/mvneta: not in enabled drivers build config 00:01:50.800 net/mvpp2: not in enabled drivers build config 00:01:50.800 net/netvsc: not in enabled drivers build config 00:01:50.800 net/nfb: not in enabled drivers build config 00:01:50.800 net/nfp: not in enabled drivers build config 00:01:50.800 net/ngbe: not in enabled drivers build config 00:01:50.800 net/null: not in enabled drivers build config 00:01:50.800 net/octeontx: not in enabled drivers build config 00:01:50.800 net/octeon_ep: not in enabled drivers build config 00:01:50.800 net/pcap: not in enabled drivers build config 00:01:50.800 net/pfe: not in enabled drivers build config 00:01:50.800 net/qede: not in enabled drivers build config 00:01:50.800 net/ring: not in enabled drivers build config 00:01:50.800 net/sfc: not in enabled drivers build config 00:01:50.800 net/softnic: not in enabled drivers build config 00:01:50.800 net/tap: not in enabled drivers build config 00:01:50.800 net/thunderx: not in enabled drivers build config 00:01:50.800 net/txgbe: not in enabled drivers build config 00:01:50.800 net/vdev_netvsc: not in enabled drivers build config 00:01:50.800 net/vhost: not in enabled drivers build config 00:01:50.800 net/virtio: not in enabled drivers build config 00:01:50.800 net/vmxnet3: not in enabled drivers build config 00:01:50.800 raw/*: missing internal dependency, "rawdev" 00:01:50.800 crypto/armv8: not in enabled drivers build config 00:01:50.800 crypto/bcmfs: not in enabled drivers build config 00:01:50.800 crypto/caam_jr: not in enabled drivers build config 00:01:50.800 crypto/ccp: not in enabled drivers build config 00:01:50.800 crypto/cnxk: not in enabled drivers build config 00:01:50.800 crypto/dpaa_sec: not in enabled drivers build config 00:01:50.800 crypto/dpaa2_sec: not in enabled drivers build config 00:01:50.800 crypto/ipsec_mb: not in enabled drivers build config 00:01:50.800 crypto/mlx5: not in enabled drivers build config 00:01:50.800 crypto/mvsam: not in enabled drivers build config 00:01:50.800 crypto/nitrox: not in enabled drivers build config 00:01:50.800 crypto/null: not in enabled drivers build config 00:01:50.800 crypto/octeontx: not in enabled drivers build config 00:01:50.800 crypto/openssl: not in enabled drivers build config 00:01:50.800 crypto/scheduler: not in enabled drivers build config 00:01:50.800 crypto/uadk: not in enabled drivers build config 00:01:50.800 crypto/virtio: not in enabled drivers build config 00:01:50.800 compress/isal: not in enabled drivers build config 00:01:50.800 compress/mlx5: not in enabled drivers build config 00:01:50.800 compress/octeontx: not in enabled drivers build config 00:01:50.800 compress/zlib: not in enabled drivers build config 00:01:50.800 regex/*: missing internal dependency, "regexdev" 00:01:50.800 ml/*: missing internal dependency, "mldev" 00:01:50.800 vdpa/ifc: not in enabled drivers build config 00:01:50.800 vdpa/mlx5: not in enabled drivers build config 00:01:50.800 vdpa/nfp: not in enabled drivers build config 00:01:50.800 vdpa/sfc: not in enabled drivers build config 00:01:50.800 event/*: missing internal dependency, "eventdev" 00:01:50.800 baseband/*: missing internal dependency, "bbdev" 00:01:50.800 gpu/*: missing internal dependency, "gpudev" 00:01:50.800 00:01:50.800 00:01:50.800 Build targets in project: 85 00:01:50.800 00:01:50.800 DPDK 23.11.0 00:01:50.800 00:01:50.800 User defined options 00:01:50.800 buildtype : debug 00:01:50.800 default_library : shared 00:01:50.800 libdir : lib 00:01:50.800 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:50.800 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:50.800 c_link_args : 00:01:50.800 cpu_instruction_set: native 00:01:50.800 disable_apps : test-fib,test-sad,test,test-regex,test-security-perf,test-bbdev,dumpcap,test-crypto-perf,test-flow-perf,test-gpudev,test-cmdline,test-dma-perf,test-eventdev,test-pipeline,test-acl,proc-info,test-compress-perf,graph,test-pmd,test-mldev,pdump 00:01:50.800 disable_libs : bbdev,latencystats,member,gpudev,mldev,pipeline,lpm,efd,regexdev,sched,node,dispatcher,table,bpf,port,gro,fib,cfgfile,ip_frag,gso,rawdev,ipsec,pdcp,rib,acl,metrics,graph,pcapng,jobstats,eventdev,stack,bitratestats,distributor,pdump 00:01:50.800 enable_docs : false 00:01:50.800 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:50.800 enable_kmods : false 00:01:50.800 tests : false 00:01:50.800 00:01:50.800 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:51.377 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:51.377 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:51.378 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:51.378 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:51.378 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:51.378 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:51.378 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:51.378 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:51.378 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:51.378 [9/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:51.378 [10/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:51.378 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:51.378 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:51.378 [13/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:51.378 [14/265] Linking static target lib/librte_kvargs.a 00:01:51.378 [15/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:51.378 [16/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:51.378 [17/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:51.378 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:51.378 [19/265] Linking static target lib/librte_log.a 00:01:51.378 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:51.638 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:52.210 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.210 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:52.210 [24/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:52.210 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:52.210 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:52.210 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:52.210 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:52.210 [29/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:52.210 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:52.210 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:52.210 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:52.210 [33/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:52.210 [34/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:52.210 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:52.210 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:52.210 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:52.210 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:52.210 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:52.210 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:52.210 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:52.210 [42/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:52.210 [43/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:52.210 [44/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:52.210 [45/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:52.210 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:52.210 [47/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:52.210 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:52.210 [49/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:52.210 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:52.210 [51/265] Linking static target lib/librte_telemetry.a 00:01:52.210 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:52.210 [53/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:52.210 [54/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:52.210 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:52.210 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:52.210 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:52.210 [58/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:52.476 [59/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:52.476 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:52.476 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:52.476 [62/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:52.476 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:52.476 [64/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:52.476 [65/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:52.476 [66/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:52.476 [67/265] Linking static target lib/librte_pci.a 00:01:52.476 [68/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:52.476 [69/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:52.476 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:52.476 [71/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:52.476 [72/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.740 [73/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:52.740 [74/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:52.740 [75/265] Linking target lib/librte_log.so.24.0 00:01:52.740 [76/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:52.740 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:52.740 [78/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:52.740 [79/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:52.740 [80/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:52.740 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:52.740 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:52.740 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:53.000 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:53.000 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:53.000 [86/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:53.000 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:53.000 [88/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:53.000 [89/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:53.000 [90/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:53.000 [91/265] Linking target lib/librte_kvargs.so.24.0 00:01:53.000 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.000 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:53.261 [94/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:53.261 [95/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:53.261 [96/265] Linking static target lib/librte_ring.a 00:01:53.261 [97/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:53.261 [98/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:53.261 [99/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:53.261 [100/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:53.261 [101/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:53.261 [102/265] Linking static target lib/librte_meter.a 00:01:53.261 [103/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:53.261 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:53.261 [105/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:53.261 [106/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:53.261 [107/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:53.261 [108/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:53.261 [109/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:53.261 [110/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:53.261 [111/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.261 [112/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:53.261 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:53.261 [114/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:53.261 [115/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:53.261 [116/265] Linking static target lib/librte_rcu.a 00:01:53.523 [117/265] Linking static target lib/librte_eal.a 00:01:53.523 [118/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:53.523 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:53.523 [120/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:53.523 [121/265] Linking target lib/librte_telemetry.so.24.0 00:01:53.523 [122/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:53.523 [123/265] Linking static target lib/librte_mempool.a 00:01:53.523 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:53.523 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:53.523 [126/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:53.523 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:53.523 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:53.523 [129/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:53.523 [130/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:53.523 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:53.523 [132/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:53.786 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:53.786 [134/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:53.786 [135/265] Linking static target lib/librte_cmdline.a 00:01:53.786 [136/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:53.786 [137/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:53.786 [138/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.786 [139/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:53.786 [140/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.786 [141/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:53.786 [142/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:53.786 [143/265] Linking static target lib/librte_net.a 00:01:53.786 [144/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:54.047 [145/265] Linking static target lib/librte_timer.a 00:01:54.047 [146/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:54.047 [147/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:54.047 [148/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:54.047 [149/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.047 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:54.047 [151/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:54.047 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:54.305 [153/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:54.305 [154/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:54.305 [155/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:54.305 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:54.305 [157/265] Linking static target lib/librte_dmadev.a 00:01:54.305 [158/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:54.305 [159/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.305 [160/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:54.305 [161/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:54.305 [162/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:54.305 [163/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.305 [164/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:54.563 [165/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.563 [166/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:54.563 [167/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:54.563 [168/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:54.563 [169/265] Linking static target lib/librte_hash.a 00:01:54.563 [170/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:54.563 [171/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:54.563 [172/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:54.563 [173/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:54.563 [174/265] Linking static target lib/librte_compressdev.a 00:01:54.563 [175/265] Linking static target lib/librte_power.a 00:01:54.563 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:54.563 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:54.563 [178/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:54.563 [179/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:54.563 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:54.563 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:54.821 [182/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.821 [183/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:54.821 [184/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:54.821 [185/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:54.821 [186/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:54.821 [187/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:54.821 [188/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:54.821 [189/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:54.821 [190/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:54.821 [191/265] Linking static target lib/librte_reorder.a 00:01:54.821 [192/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:54.821 [193/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:54.821 [194/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:54.821 [195/265] Linking static target lib/librte_security.a 00:01:55.079 [196/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:55.079 [197/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:55.079 [198/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.079 [199/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:55.079 [200/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:55.079 [201/265] Linking static target lib/librte_mbuf.a 00:01:55.079 [202/265] Linking static target drivers/librte_bus_pci.a 00:01:55.079 [203/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:55.079 [204/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.079 [205/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:55.079 [206/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:55.079 [207/265] Linking static target drivers/librte_bus_vdev.a 00:01:55.079 [208/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:55.079 [209/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.079 [210/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:55.079 [211/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:55.079 [212/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:55.079 [213/265] Linking static target drivers/librte_mempool_ring.a 00:01:55.079 [214/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.079 [215/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:55.337 [216/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.337 [217/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:55.337 [218/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.337 [219/265] Linking static target lib/librte_ethdev.a 00:01:55.337 [220/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.337 [221/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.595 [222/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:55.595 [223/265] Linking static target lib/librte_cryptodev.a 00:01:56.528 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.903 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:59.286 [226/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.544 [227/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.544 [228/265] Linking target lib/librte_eal.so.24.0 00:01:59.803 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:59.803 [230/265] Linking target lib/librte_ring.so.24.0 00:01:59.803 [231/265] Linking target lib/librte_pci.so.24.0 00:01:59.803 [232/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:59.803 [233/265] Linking target lib/librte_timer.so.24.0 00:01:59.803 [234/265] Linking target lib/librte_meter.so.24.0 00:01:59.803 [235/265] Linking target lib/librte_dmadev.so.24.0 00:01:59.803 [236/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:59.803 [237/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:59.803 [238/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:59.804 [239/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:59.804 [240/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:59.804 [241/265] Linking target lib/librte_rcu.so.24.0 00:01:59.804 [242/265] Linking target lib/librte_mempool.so.24.0 00:01:59.804 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:00.062 [244/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:00.062 [245/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:00.062 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:00.062 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:00.321 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:00.321 [249/265] Linking target lib/librte_reorder.so.24.0 00:02:00.321 [250/265] Linking target lib/librte_compressdev.so.24.0 00:02:00.321 [251/265] Linking target lib/librte_net.so.24.0 00:02:00.321 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:00.321 [253/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:00.321 [254/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:00.321 [255/265] Linking target lib/librte_cmdline.so.24.0 00:02:00.321 [256/265] Linking target lib/librte_security.so.24.0 00:02:00.321 [257/265] Linking target lib/librte_hash.so.24.0 00:02:00.321 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:00.580 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:00.581 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:00.581 [261/265] Linking target lib/librte_power.so.24.0 00:02:03.119 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:03.119 [263/265] Linking static target lib/librte_vhost.a 00:02:04.497 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.497 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:04.497 INFO: autodetecting backend as ninja 00:02:04.497 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:05.065 CC lib/ut/ut.o 00:02:05.065 CC lib/log/log.o 00:02:05.065 CC lib/log/log_flags.o 00:02:05.065 CC lib/log/log_deprecated.o 00:02:05.065 CC lib/ut_mock/mock.o 00:02:05.324 LIB libspdk_ut_mock.a 00:02:05.324 SO libspdk_ut_mock.so.5.0 00:02:05.324 LIB libspdk_log.a 00:02:05.324 LIB libspdk_ut.a 00:02:05.324 SO libspdk_ut.so.1.0 00:02:05.324 SO libspdk_log.so.6.1 00:02:05.324 SYMLINK libspdk_ut_mock.so 00:02:05.324 SYMLINK libspdk_ut.so 00:02:05.324 SYMLINK libspdk_log.so 00:02:05.583 CC lib/util/base64.o 00:02:05.583 CC lib/ioat/ioat.o 00:02:05.583 CC lib/util/bit_array.o 00:02:05.583 CC lib/util/cpuset.o 00:02:05.583 CC lib/util/crc16.o 00:02:05.583 CC lib/dma/dma.o 00:02:05.583 CXX lib/trace_parser/trace.o 00:02:05.583 CC lib/util/crc32.o 00:02:05.583 CC lib/util/crc32c.o 00:02:05.583 CC lib/util/crc32_ieee.o 00:02:05.583 CC lib/util/crc64.o 00:02:05.583 CC lib/util/dif.o 00:02:05.583 CC lib/util/fd.o 00:02:05.583 CC lib/util/file.o 00:02:05.583 CC lib/util/hexlify.o 00:02:05.583 CC lib/util/iov.o 00:02:05.583 CC lib/util/math.o 00:02:05.583 CC lib/util/pipe.o 00:02:05.583 CC lib/util/strerror_tls.o 00:02:05.583 CC lib/util/string.o 00:02:05.583 CC lib/util/uuid.o 00:02:05.583 CC lib/util/fd_group.o 00:02:05.583 CC lib/util/xor.o 00:02:05.583 CC lib/util/zipf.o 00:02:05.583 CC lib/vfio_user/host/vfio_user_pci.o 00:02:05.583 CC lib/vfio_user/host/vfio_user.o 00:02:05.842 LIB libspdk_dma.a 00:02:05.842 SO libspdk_dma.so.3.0 00:02:05.842 SYMLINK libspdk_dma.so 00:02:05.842 LIB libspdk_ioat.a 00:02:05.842 SO libspdk_ioat.so.6.0 00:02:05.842 LIB libspdk_vfio_user.a 00:02:05.842 SO libspdk_vfio_user.so.4.0 00:02:05.842 SYMLINK libspdk_ioat.so 00:02:05.842 SYMLINK libspdk_vfio_user.so 00:02:06.101 LIB libspdk_util.a 00:02:06.101 SO libspdk_util.so.8.0 00:02:06.360 SYMLINK libspdk_util.so 00:02:06.360 CC lib/idxd/idxd.o 00:02:06.360 CC lib/rdma/common.o 00:02:06.360 CC lib/conf/conf.o 00:02:06.360 CC lib/json/json_parse.o 00:02:06.360 CC lib/env_dpdk/env.o 00:02:06.360 CC lib/idxd/idxd_user.o 00:02:06.361 CC lib/env_dpdk/memory.o 00:02:06.361 CC lib/json/json_util.o 00:02:06.361 CC lib/rdma/rdma_verbs.o 00:02:06.361 CC lib/vmd/vmd.o 00:02:06.361 CC lib/json/json_write.o 00:02:06.361 CC lib/idxd/idxd_kernel.o 00:02:06.361 CC lib/env_dpdk/pci.o 00:02:06.361 CC lib/vmd/led.o 00:02:06.361 CC lib/env_dpdk/init.o 00:02:06.361 CC lib/env_dpdk/threads.o 00:02:06.361 CC lib/env_dpdk/pci_ioat.o 00:02:06.361 CC lib/env_dpdk/pci_virtio.o 00:02:06.361 CC lib/env_dpdk/pci_vmd.o 00:02:06.361 CC lib/env_dpdk/pci_idxd.o 00:02:06.361 CC lib/env_dpdk/pci_event.o 00:02:06.361 CC lib/env_dpdk/sigbus_handler.o 00:02:06.361 CC lib/env_dpdk/pci_dpdk.o 00:02:06.361 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:06.361 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:06.361 LIB libspdk_trace_parser.a 00:02:06.361 SO libspdk_trace_parser.so.4.0 00:02:06.620 SYMLINK libspdk_trace_parser.so 00:02:06.620 LIB libspdk_conf.a 00:02:06.620 SO libspdk_conf.so.5.0 00:02:06.620 SYMLINK libspdk_conf.so 00:02:06.620 LIB libspdk_rdma.a 00:02:06.620 SO libspdk_rdma.so.5.0 00:02:06.620 LIB libspdk_json.a 00:02:06.880 SYMLINK libspdk_rdma.so 00:02:06.880 SO libspdk_json.so.5.1 00:02:06.880 SYMLINK libspdk_json.so 00:02:06.880 CC lib/jsonrpc/jsonrpc_server.o 00:02:06.880 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:06.880 CC lib/jsonrpc/jsonrpc_client.o 00:02:06.880 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:06.880 LIB libspdk_idxd.a 00:02:06.880 SO libspdk_idxd.so.11.0 00:02:07.139 SYMLINK libspdk_idxd.so 00:02:07.139 LIB libspdk_vmd.a 00:02:07.139 SO libspdk_vmd.so.5.0 00:02:07.139 SYMLINK libspdk_vmd.so 00:02:07.139 LIB libspdk_jsonrpc.a 00:02:07.139 SO libspdk_jsonrpc.so.5.1 00:02:07.398 SYMLINK libspdk_jsonrpc.so 00:02:07.398 CC lib/rpc/rpc.o 00:02:07.657 LIB libspdk_rpc.a 00:02:07.657 SO libspdk_rpc.so.5.0 00:02:07.657 SYMLINK libspdk_rpc.so 00:02:07.657 CC lib/trace/trace.o 00:02:07.657 CC lib/trace/trace_flags.o 00:02:07.657 CC lib/trace/trace_rpc.o 00:02:07.657 CC lib/sock/sock.o 00:02:07.657 CC lib/notify/notify.o 00:02:07.657 CC lib/sock/sock_rpc.o 00:02:07.657 CC lib/notify/notify_rpc.o 00:02:07.915 LIB libspdk_notify.a 00:02:07.915 SO libspdk_notify.so.5.0 00:02:07.915 LIB libspdk_trace.a 00:02:07.915 SYMLINK libspdk_notify.so 00:02:07.915 SO libspdk_trace.so.9.0 00:02:07.915 SYMLINK libspdk_trace.so 00:02:08.173 LIB libspdk_sock.a 00:02:08.173 CC lib/thread/thread.o 00:02:08.174 CC lib/thread/iobuf.o 00:02:08.174 SO libspdk_sock.so.8.0 00:02:08.174 SYMLINK libspdk_sock.so 00:02:08.433 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:08.433 CC lib/nvme/nvme_ctrlr.o 00:02:08.433 CC lib/nvme/nvme_fabric.o 00:02:08.433 CC lib/nvme/nvme_ns_cmd.o 00:02:08.433 CC lib/nvme/nvme_ns.o 00:02:08.433 CC lib/nvme/nvme_pcie_common.o 00:02:08.433 CC lib/nvme/nvme_pcie.o 00:02:08.433 CC lib/nvme/nvme_qpair.o 00:02:08.433 CC lib/nvme/nvme.o 00:02:08.433 CC lib/nvme/nvme_quirks.o 00:02:08.433 CC lib/nvme/nvme_transport.o 00:02:08.433 CC lib/nvme/nvme_discovery.o 00:02:08.433 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:08.433 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:08.433 CC lib/nvme/nvme_tcp.o 00:02:08.433 CC lib/nvme/nvme_opal.o 00:02:08.433 CC lib/nvme/nvme_io_msg.o 00:02:08.433 CC lib/nvme/nvme_poll_group.o 00:02:08.433 CC lib/nvme/nvme_zns.o 00:02:08.433 CC lib/nvme/nvme_cuse.o 00:02:08.433 CC lib/nvme/nvme_vfio_user.o 00:02:08.433 CC lib/nvme/nvme_rdma.o 00:02:08.433 LIB libspdk_env_dpdk.a 00:02:08.433 SO libspdk_env_dpdk.so.13.0 00:02:08.692 SYMLINK libspdk_env_dpdk.so 00:02:09.626 LIB libspdk_thread.a 00:02:09.885 SO libspdk_thread.so.9.0 00:02:09.885 SYMLINK libspdk_thread.so 00:02:09.885 CC lib/virtio/virtio.o 00:02:09.885 CC lib/blob/blobstore.o 00:02:09.885 CC lib/blob/request.o 00:02:09.885 CC lib/accel/accel.o 00:02:09.885 CC lib/virtio/virtio_vhost_user.o 00:02:09.885 CC lib/init/json_config.o 00:02:09.885 CC lib/blob/zeroes.o 00:02:09.885 CC lib/accel/accel_rpc.o 00:02:09.885 CC lib/virtio/virtio_vfio_user.o 00:02:09.885 CC lib/init/subsystem.o 00:02:09.885 CC lib/accel/accel_sw.o 00:02:09.885 CC lib/blob/blob_bs_dev.o 00:02:09.885 CC lib/virtio/virtio_pci.o 00:02:09.885 CC lib/init/subsystem_rpc.o 00:02:09.885 CC lib/init/rpc.o 00:02:10.144 LIB libspdk_init.a 00:02:10.144 SO libspdk_init.so.4.0 00:02:10.402 SYMLINK libspdk_init.so 00:02:10.402 LIB libspdk_virtio.a 00:02:10.402 SO libspdk_virtio.so.6.0 00:02:10.402 SYMLINK libspdk_virtio.so 00:02:10.402 CC lib/event/app.o 00:02:10.402 CC lib/event/reactor.o 00:02:10.402 CC lib/event/log_rpc.o 00:02:10.402 CC lib/event/app_rpc.o 00:02:10.402 CC lib/event/scheduler_static.o 00:02:10.661 LIB libspdk_nvme.a 00:02:10.661 SO libspdk_nvme.so.12.0 00:02:10.919 LIB libspdk_event.a 00:02:10.919 SO libspdk_event.so.12.0 00:02:10.919 SYMLINK libspdk_event.so 00:02:10.919 SYMLINK libspdk_nvme.so 00:02:10.919 LIB libspdk_accel.a 00:02:10.919 SO libspdk_accel.so.14.0 00:02:11.180 SYMLINK libspdk_accel.so 00:02:11.180 CC lib/bdev/bdev.o 00:02:11.180 CC lib/bdev/bdev_rpc.o 00:02:11.180 CC lib/bdev/bdev_zone.o 00:02:11.180 CC lib/bdev/part.o 00:02:11.180 CC lib/bdev/scsi_nvme.o 00:02:13.078 LIB libspdk_blob.a 00:02:13.078 SO libspdk_blob.so.10.1 00:02:13.078 SYMLINK libspdk_blob.so 00:02:13.078 CC lib/blobfs/blobfs.o 00:02:13.078 CC lib/blobfs/tree.o 00:02:13.078 CC lib/lvol/lvol.o 00:02:13.645 LIB libspdk_bdev.a 00:02:13.645 LIB libspdk_blobfs.a 00:02:13.645 SO libspdk_blobfs.so.9.0 00:02:13.645 SO libspdk_bdev.so.14.0 00:02:13.937 SYMLINK libspdk_blobfs.so 00:02:13.937 LIB libspdk_lvol.a 00:02:13.937 SYMLINK libspdk_bdev.so 00:02:13.937 SO libspdk_lvol.so.9.1 00:02:13.938 SYMLINK libspdk_lvol.so 00:02:13.938 CC lib/nbd/nbd.o 00:02:13.938 CC lib/ublk/ublk.o 00:02:13.938 CC lib/nbd/nbd_rpc.o 00:02:13.938 CC lib/ublk/ublk_rpc.o 00:02:13.938 CC lib/nvmf/ctrlr.o 00:02:13.938 CC lib/scsi/dev.o 00:02:13.938 CC lib/scsi/lun.o 00:02:13.938 CC lib/nvmf/ctrlr_discovery.o 00:02:13.938 CC lib/scsi/port.o 00:02:13.938 CC lib/nvmf/ctrlr_bdev.o 00:02:13.938 CC lib/ftl/ftl_core.o 00:02:13.938 CC lib/scsi/scsi.o 00:02:13.938 CC lib/nvmf/subsystem.o 00:02:13.938 CC lib/ftl/ftl_init.o 00:02:13.938 CC lib/scsi/scsi_bdev.o 00:02:13.938 CC lib/nvmf/nvmf.o 00:02:13.938 CC lib/ftl/ftl_layout.o 00:02:13.938 CC lib/nvmf/nvmf_rpc.o 00:02:13.938 CC lib/scsi/scsi_pr.o 00:02:13.938 CC lib/ftl/ftl_debug.o 00:02:13.938 CC lib/ftl/ftl_io.o 00:02:13.938 CC lib/nvmf/transport.o 00:02:13.938 CC lib/scsi/scsi_rpc.o 00:02:13.938 CC lib/nvmf/tcp.o 00:02:13.938 CC lib/ftl/ftl_sb.o 00:02:13.938 CC lib/ftl/ftl_l2p.o 00:02:13.938 CC lib/nvmf/rdma.o 00:02:13.938 CC lib/scsi/task.o 00:02:13.938 CC lib/ftl/ftl_l2p_flat.o 00:02:13.938 CC lib/ftl/ftl_nv_cache.o 00:02:13.938 CC lib/ftl/ftl_band.o 00:02:13.938 CC lib/ftl/ftl_band_ops.o 00:02:13.938 CC lib/ftl/ftl_writer.o 00:02:13.938 CC lib/ftl/ftl_rq.o 00:02:13.938 CC lib/ftl/ftl_reloc.o 00:02:13.938 CC lib/ftl/ftl_l2p_cache.o 00:02:13.938 CC lib/ftl/ftl_p2l.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:13.938 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:14.224 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:14.224 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:14.224 CC lib/ftl/utils/ftl_conf.o 00:02:14.224 CC lib/ftl/utils/ftl_md.o 00:02:14.224 CC lib/ftl/utils/ftl_mempool.o 00:02:14.224 CC lib/ftl/utils/ftl_bitmap.o 00:02:14.224 CC lib/ftl/utils/ftl_property.o 00:02:14.224 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:14.224 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:14.496 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:14.496 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:14.496 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:14.496 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:14.496 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:14.496 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:14.496 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:14.496 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:14.496 CC lib/ftl/base/ftl_base_dev.o 00:02:14.496 CC lib/ftl/base/ftl_base_bdev.o 00:02:14.496 CC lib/ftl/ftl_trace.o 00:02:14.754 LIB libspdk_nbd.a 00:02:14.754 SO libspdk_nbd.so.6.0 00:02:14.754 SYMLINK libspdk_nbd.so 00:02:14.754 LIB libspdk_scsi.a 00:02:14.754 SO libspdk_scsi.so.8.0 00:02:15.013 LIB libspdk_ublk.a 00:02:15.013 SYMLINK libspdk_scsi.so 00:02:15.013 SO libspdk_ublk.so.2.0 00:02:15.013 SYMLINK libspdk_ublk.so 00:02:15.013 CC lib/vhost/vhost.o 00:02:15.013 CC lib/vhost/vhost_rpc.o 00:02:15.013 CC lib/iscsi/conn.o 00:02:15.013 CC lib/vhost/vhost_scsi.o 00:02:15.013 CC lib/iscsi/init_grp.o 00:02:15.013 CC lib/vhost/vhost_blk.o 00:02:15.013 CC lib/iscsi/iscsi.o 00:02:15.013 CC lib/vhost/rte_vhost_user.o 00:02:15.013 CC lib/iscsi/md5.o 00:02:15.013 CC lib/iscsi/param.o 00:02:15.013 CC lib/iscsi/portal_grp.o 00:02:15.013 CC lib/iscsi/tgt_node.o 00:02:15.013 CC lib/iscsi/iscsi_subsystem.o 00:02:15.013 CC lib/iscsi/iscsi_rpc.o 00:02:15.013 CC lib/iscsi/task.o 00:02:15.272 LIB libspdk_ftl.a 00:02:15.531 SO libspdk_ftl.so.8.0 00:02:15.789 SYMLINK libspdk_ftl.so 00:02:16.356 LIB libspdk_vhost.a 00:02:16.356 SO libspdk_vhost.so.7.1 00:02:16.356 SYMLINK libspdk_vhost.so 00:02:16.356 LIB libspdk_nvmf.a 00:02:16.356 LIB libspdk_iscsi.a 00:02:16.356 SO libspdk_nvmf.so.17.0 00:02:16.615 SO libspdk_iscsi.so.7.0 00:02:16.615 SYMLINK libspdk_nvmf.so 00:02:16.615 SYMLINK libspdk_iscsi.so 00:02:16.874 CC module/env_dpdk/env_dpdk_rpc.o 00:02:16.874 CC module/accel/ioat/accel_ioat.o 00:02:16.874 CC module/blob/bdev/blob_bdev.o 00:02:16.874 CC module/accel/ioat/accel_ioat_rpc.o 00:02:16.874 CC module/accel/iaa/accel_iaa.o 00:02:16.874 CC module/accel/error/accel_error.o 00:02:16.874 CC module/accel/dsa/accel_dsa.o 00:02:16.874 CC module/sock/posix/posix.o 00:02:16.874 CC module/accel/error/accel_error_rpc.o 00:02:16.874 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:16.874 CC module/accel/dsa/accel_dsa_rpc.o 00:02:16.874 CC module/accel/iaa/accel_iaa_rpc.o 00:02:16.874 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:16.874 CC module/scheduler/gscheduler/gscheduler.o 00:02:16.874 LIB libspdk_env_dpdk_rpc.a 00:02:16.874 SO libspdk_env_dpdk_rpc.so.5.0 00:02:17.134 SYMLINK libspdk_env_dpdk_rpc.so 00:02:17.134 LIB libspdk_scheduler_gscheduler.a 00:02:17.134 LIB libspdk_scheduler_dpdk_governor.a 00:02:17.134 SO libspdk_scheduler_gscheduler.so.3.0 00:02:17.134 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:17.134 LIB libspdk_accel_error.a 00:02:17.134 LIB libspdk_accel_ioat.a 00:02:17.134 LIB libspdk_scheduler_dynamic.a 00:02:17.134 LIB libspdk_accel_iaa.a 00:02:17.134 SO libspdk_accel_error.so.1.0 00:02:17.134 SO libspdk_accel_ioat.so.5.0 00:02:17.134 SO libspdk_scheduler_dynamic.so.3.0 00:02:17.134 SYMLINK libspdk_scheduler_gscheduler.so 00:02:17.134 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:17.134 SO libspdk_accel_iaa.so.2.0 00:02:17.134 LIB libspdk_accel_dsa.a 00:02:17.134 SYMLINK libspdk_accel_error.so 00:02:17.134 SYMLINK libspdk_accel_ioat.so 00:02:17.134 SYMLINK libspdk_scheduler_dynamic.so 00:02:17.134 SO libspdk_accel_dsa.so.4.0 00:02:17.134 LIB libspdk_blob_bdev.a 00:02:17.134 SYMLINK libspdk_accel_iaa.so 00:02:17.134 SO libspdk_blob_bdev.so.10.1 00:02:17.134 SYMLINK libspdk_accel_dsa.so 00:02:17.134 SYMLINK libspdk_blob_bdev.so 00:02:17.394 CC module/bdev/passthru/vbdev_passthru.o 00:02:17.394 CC module/bdev/gpt/gpt.o 00:02:17.394 CC module/bdev/split/vbdev_split.o 00:02:17.394 CC module/bdev/ftl/bdev_ftl.o 00:02:17.394 CC module/bdev/delay/vbdev_delay.o 00:02:17.394 CC module/bdev/raid/bdev_raid.o 00:02:17.394 CC module/bdev/nvme/bdev_nvme.o 00:02:17.394 CC module/bdev/gpt/vbdev_gpt.o 00:02:17.394 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:17.394 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:17.394 CC module/bdev/null/bdev_null.o 00:02:17.394 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:17.394 CC module/bdev/raid/bdev_raid_rpc.o 00:02:17.394 CC module/bdev/malloc/bdev_malloc.o 00:02:17.394 CC module/bdev/split/vbdev_split_rpc.o 00:02:17.394 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:17.394 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:17.394 CC module/bdev/error/vbdev_error.o 00:02:17.394 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:17.394 CC module/bdev/null/bdev_null_rpc.o 00:02:17.394 CC module/bdev/raid/bdev_raid_sb.o 00:02:17.394 CC module/bdev/nvme/nvme_rpc.o 00:02:17.394 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:17.394 CC module/bdev/lvol/vbdev_lvol.o 00:02:17.394 CC module/bdev/raid/raid0.o 00:02:17.394 CC module/bdev/nvme/bdev_mdns_client.o 00:02:17.394 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:17.394 CC module/bdev/error/vbdev_error_rpc.o 00:02:17.394 CC module/bdev/raid/raid1.o 00:02:17.394 CC module/blobfs/bdev/blobfs_bdev.o 00:02:17.394 CC module/bdev/nvme/vbdev_opal.o 00:02:17.394 CC module/bdev/iscsi/bdev_iscsi.o 00:02:17.394 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:17.394 CC module/bdev/raid/concat.o 00:02:17.394 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:17.394 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:17.395 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:17.395 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:17.395 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:17.395 CC module/bdev/aio/bdev_aio.o 00:02:17.395 CC module/bdev/aio/bdev_aio_rpc.o 00:02:17.395 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:17.654 LIB libspdk_bdev_error.a 00:02:17.654 LIB libspdk_blobfs_bdev.a 00:02:17.654 LIB libspdk_bdev_gpt.a 00:02:17.654 SO libspdk_bdev_error.so.5.0 00:02:17.654 SO libspdk_blobfs_bdev.so.5.0 00:02:17.654 SO libspdk_bdev_gpt.so.5.0 00:02:17.913 LIB libspdk_sock_posix.a 00:02:17.913 SYMLINK libspdk_bdev_error.so 00:02:17.913 SO libspdk_sock_posix.so.5.0 00:02:17.913 SYMLINK libspdk_blobfs_bdev.so 00:02:17.913 LIB libspdk_bdev_split.a 00:02:17.913 SYMLINK libspdk_bdev_gpt.so 00:02:17.913 SO libspdk_bdev_split.so.5.0 00:02:17.913 LIB libspdk_bdev_passthru.a 00:02:17.913 LIB libspdk_bdev_null.a 00:02:17.913 SYMLINK libspdk_sock_posix.so 00:02:17.913 SO libspdk_bdev_passthru.so.5.0 00:02:17.913 SO libspdk_bdev_null.so.5.0 00:02:17.913 SYMLINK libspdk_bdev_split.so 00:02:17.913 LIB libspdk_bdev_ftl.a 00:02:17.913 SYMLINK libspdk_bdev_passthru.so 00:02:17.913 LIB libspdk_bdev_zone_block.a 00:02:17.913 SO libspdk_bdev_ftl.so.5.0 00:02:17.913 SYMLINK libspdk_bdev_null.so 00:02:17.913 SO libspdk_bdev_zone_block.so.5.0 00:02:17.913 LIB libspdk_bdev_aio.a 00:02:17.913 LIB libspdk_bdev_delay.a 00:02:17.913 SO libspdk_bdev_aio.so.5.0 00:02:17.913 SYMLINK libspdk_bdev_ftl.so 00:02:17.913 LIB libspdk_bdev_malloc.a 00:02:17.913 LIB libspdk_bdev_iscsi.a 00:02:17.913 SYMLINK libspdk_bdev_zone_block.so 00:02:17.913 SO libspdk_bdev_delay.so.5.0 00:02:17.913 SO libspdk_bdev_malloc.so.5.0 00:02:18.171 SO libspdk_bdev_iscsi.so.5.0 00:02:18.171 SYMLINK libspdk_bdev_aio.so 00:02:18.171 SYMLINK libspdk_bdev_delay.so 00:02:18.171 SYMLINK libspdk_bdev_malloc.so 00:02:18.171 SYMLINK libspdk_bdev_iscsi.so 00:02:18.171 LIB libspdk_bdev_lvol.a 00:02:18.171 LIB libspdk_bdev_virtio.a 00:02:18.171 SO libspdk_bdev_lvol.so.5.0 00:02:18.171 SO libspdk_bdev_virtio.so.5.0 00:02:18.171 SYMLINK libspdk_bdev_lvol.so 00:02:18.171 SYMLINK libspdk_bdev_virtio.so 00:02:18.431 LIB libspdk_bdev_raid.a 00:02:18.431 SO libspdk_bdev_raid.so.5.0 00:02:18.431 SYMLINK libspdk_bdev_raid.so 00:02:19.808 LIB libspdk_bdev_nvme.a 00:02:19.808 SO libspdk_bdev_nvme.so.6.0 00:02:19.808 SYMLINK libspdk_bdev_nvme.so 00:02:20.067 CC module/event/subsystems/vmd/vmd.o 00:02:20.067 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:20.067 CC module/event/subsystems/sock/sock.o 00:02:20.067 CC module/event/subsystems/iobuf/iobuf.o 00:02:20.067 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:20.067 CC module/event/subsystems/scheduler/scheduler.o 00:02:20.067 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:20.067 LIB libspdk_event_sock.a 00:02:20.067 LIB libspdk_event_vhost_blk.a 00:02:20.326 LIB libspdk_event_scheduler.a 00:02:20.326 LIB libspdk_event_vmd.a 00:02:20.326 LIB libspdk_event_iobuf.a 00:02:20.326 SO libspdk_event_sock.so.4.0 00:02:20.326 SO libspdk_event_vhost_blk.so.2.0 00:02:20.326 SO libspdk_event_scheduler.so.3.0 00:02:20.326 SO libspdk_event_vmd.so.5.0 00:02:20.326 SO libspdk_event_iobuf.so.2.0 00:02:20.326 SYMLINK libspdk_event_sock.so 00:02:20.326 SYMLINK libspdk_event_vhost_blk.so 00:02:20.326 SYMLINK libspdk_event_scheduler.so 00:02:20.326 SYMLINK libspdk_event_vmd.so 00:02:20.326 SYMLINK libspdk_event_iobuf.so 00:02:20.326 CC module/event/subsystems/accel/accel.o 00:02:20.586 LIB libspdk_event_accel.a 00:02:20.586 SO libspdk_event_accel.so.5.0 00:02:20.586 SYMLINK libspdk_event_accel.so 00:02:20.845 CC module/event/subsystems/bdev/bdev.o 00:02:20.845 LIB libspdk_event_bdev.a 00:02:20.845 SO libspdk_event_bdev.so.5.0 00:02:20.845 SYMLINK libspdk_event_bdev.so 00:02:21.104 CC module/event/subsystems/nbd/nbd.o 00:02:21.104 CC module/event/subsystems/scsi/scsi.o 00:02:21.104 CC module/event/subsystems/ublk/ublk.o 00:02:21.104 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:21.104 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:21.104 LIB libspdk_event_nbd.a 00:02:21.104 LIB libspdk_event_ublk.a 00:02:21.363 LIB libspdk_event_scsi.a 00:02:21.363 SO libspdk_event_nbd.so.5.0 00:02:21.363 SO libspdk_event_ublk.so.2.0 00:02:21.363 SO libspdk_event_scsi.so.5.0 00:02:21.363 SYMLINK libspdk_event_ublk.so 00:02:21.363 SYMLINK libspdk_event_nbd.so 00:02:21.364 SYMLINK libspdk_event_scsi.so 00:02:21.364 LIB libspdk_event_nvmf.a 00:02:21.364 SO libspdk_event_nvmf.so.5.0 00:02:21.364 SYMLINK libspdk_event_nvmf.so 00:02:21.364 CC module/event/subsystems/iscsi/iscsi.o 00:02:21.364 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:21.622 LIB libspdk_event_vhost_scsi.a 00:02:21.622 SO libspdk_event_vhost_scsi.so.2.0 00:02:21.622 LIB libspdk_event_iscsi.a 00:02:21.622 SO libspdk_event_iscsi.so.5.0 00:02:21.622 SYMLINK libspdk_event_vhost_scsi.so 00:02:21.622 SYMLINK libspdk_event_iscsi.so 00:02:21.622 SO libspdk.so.5.0 00:02:21.622 SYMLINK libspdk.so 00:02:21.884 CC app/spdk_nvme_perf/perf.o 00:02:21.884 CC app/trace_record/trace_record.o 00:02:21.884 CXX app/trace/trace.o 00:02:21.884 CC app/spdk_lspci/spdk_lspci.o 00:02:21.884 CC app/spdk_nvme_identify/identify.o 00:02:21.884 CC test/rpc_client/rpc_client_test.o 00:02:21.884 CC app/spdk_nvme_discover/discovery_aer.o 00:02:21.884 CC app/spdk_top/spdk_top.o 00:02:21.884 TEST_HEADER include/spdk/accel.h 00:02:21.884 TEST_HEADER include/spdk/accel_module.h 00:02:21.884 TEST_HEADER include/spdk/assert.h 00:02:21.884 TEST_HEADER include/spdk/barrier.h 00:02:21.884 TEST_HEADER include/spdk/base64.h 00:02:21.884 TEST_HEADER include/spdk/bdev.h 00:02:21.884 TEST_HEADER include/spdk/bdev_module.h 00:02:21.884 TEST_HEADER include/spdk/bdev_zone.h 00:02:21.884 TEST_HEADER include/spdk/bit_array.h 00:02:21.884 TEST_HEADER include/spdk/bit_pool.h 00:02:21.884 TEST_HEADER include/spdk/blob_bdev.h 00:02:21.884 CC app/spdk_dd/spdk_dd.o 00:02:21.884 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:21.884 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:21.884 TEST_HEADER include/spdk/blobfs.h 00:02:21.884 TEST_HEADER include/spdk/blob.h 00:02:21.884 TEST_HEADER include/spdk/conf.h 00:02:21.884 TEST_HEADER include/spdk/config.h 00:02:21.884 TEST_HEADER include/spdk/cpuset.h 00:02:21.884 CC app/nvmf_tgt/nvmf_main.o 00:02:21.884 CC app/iscsi_tgt/iscsi_tgt.o 00:02:21.884 CC examples/sock/hello_world/hello_sock.o 00:02:21.884 TEST_HEADER include/spdk/crc16.h 00:02:21.884 CC app/vhost/vhost.o 00:02:21.884 CC examples/ioat/verify/verify.o 00:02:21.884 CC examples/nvme/hello_world/hello_world.o 00:02:21.884 TEST_HEADER include/spdk/crc32.h 00:02:21.884 CC examples/vmd/lsvmd/lsvmd.o 00:02:21.884 CC examples/vmd/led/led.o 00:02:21.884 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:21.884 CC examples/nvme/reconnect/reconnect.o 00:02:21.884 CC examples/nvme/abort/abort.o 00:02:21.884 CC examples/nvme/hotplug/hotplug.o 00:02:21.884 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:21.884 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:21.884 CC examples/accel/perf/accel_perf.o 00:02:21.884 TEST_HEADER include/spdk/crc64.h 00:02:21.884 CC examples/util/zipf/zipf.o 00:02:21.884 CC examples/ioat/perf/perf.o 00:02:21.884 CC examples/nvme/arbitration/arbitration.o 00:02:21.884 CC examples/idxd/perf/perf.o 00:02:21.884 TEST_HEADER include/spdk/dif.h 00:02:21.884 TEST_HEADER include/spdk/dma.h 00:02:21.884 CC app/fio/nvme/fio_plugin.o 00:02:21.884 CC test/event/event_perf/event_perf.o 00:02:21.884 TEST_HEADER include/spdk/endian.h 00:02:21.884 TEST_HEADER include/spdk/env_dpdk.h 00:02:21.884 CC test/nvme/aer/aer.o 00:02:21.884 TEST_HEADER include/spdk/env.h 00:02:21.884 TEST_HEADER include/spdk/event.h 00:02:21.884 CC test/thread/poller_perf/poller_perf.o 00:02:21.884 TEST_HEADER include/spdk/fd_group.h 00:02:21.884 CC app/spdk_tgt/spdk_tgt.o 00:02:21.884 TEST_HEADER include/spdk/fd.h 00:02:21.884 TEST_HEADER include/spdk/file.h 00:02:22.146 TEST_HEADER include/spdk/ftl.h 00:02:22.146 TEST_HEADER include/spdk/gpt_spec.h 00:02:22.146 TEST_HEADER include/spdk/hexlify.h 00:02:22.146 TEST_HEADER include/spdk/histogram_data.h 00:02:22.146 TEST_HEADER include/spdk/idxd.h 00:02:22.146 TEST_HEADER include/spdk/idxd_spec.h 00:02:22.146 CC examples/bdev/hello_world/hello_bdev.o 00:02:22.146 TEST_HEADER include/spdk/init.h 00:02:22.146 CC examples/blob/hello_world/hello_blob.o 00:02:22.146 TEST_HEADER include/spdk/ioat.h 00:02:22.146 CC examples/thread/thread/thread_ex.o 00:02:22.146 TEST_HEADER include/spdk/ioat_spec.h 00:02:22.146 CC examples/blob/cli/blobcli.o 00:02:22.146 TEST_HEADER include/spdk/iscsi_spec.h 00:02:22.146 CC test/blobfs/mkfs/mkfs.o 00:02:22.146 TEST_HEADER include/spdk/json.h 00:02:22.146 CC examples/nvmf/nvmf/nvmf.o 00:02:22.146 CC test/app/bdev_svc/bdev_svc.o 00:02:22.146 TEST_HEADER include/spdk/jsonrpc.h 00:02:22.146 CC test/bdev/bdevio/bdevio.o 00:02:22.146 CC test/dma/test_dma/test_dma.o 00:02:22.146 CC test/accel/dif/dif.o 00:02:22.146 TEST_HEADER include/spdk/likely.h 00:02:22.146 TEST_HEADER include/spdk/log.h 00:02:22.146 TEST_HEADER include/spdk/lvol.h 00:02:22.146 TEST_HEADER include/spdk/memory.h 00:02:22.146 CC examples/bdev/bdevperf/bdevperf.o 00:02:22.146 TEST_HEADER include/spdk/mmio.h 00:02:22.146 TEST_HEADER include/spdk/nbd.h 00:02:22.146 CC test/env/mem_callbacks/mem_callbacks.o 00:02:22.146 TEST_HEADER include/spdk/notify.h 00:02:22.146 TEST_HEADER include/spdk/nvme.h 00:02:22.146 TEST_HEADER include/spdk/nvme_intel.h 00:02:22.146 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:22.146 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:22.146 TEST_HEADER include/spdk/nvme_spec.h 00:02:22.146 TEST_HEADER include/spdk/nvme_zns.h 00:02:22.146 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:22.147 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:22.147 TEST_HEADER include/spdk/nvmf.h 00:02:22.147 CC test/lvol/esnap/esnap.o 00:02:22.147 TEST_HEADER include/spdk/nvmf_spec.h 00:02:22.147 TEST_HEADER include/spdk/nvmf_transport.h 00:02:22.147 TEST_HEADER include/spdk/opal.h 00:02:22.147 TEST_HEADER include/spdk/opal_spec.h 00:02:22.147 TEST_HEADER include/spdk/pci_ids.h 00:02:22.147 TEST_HEADER include/spdk/pipe.h 00:02:22.147 TEST_HEADER include/spdk/queue.h 00:02:22.147 TEST_HEADER include/spdk/reduce.h 00:02:22.147 TEST_HEADER include/spdk/rpc.h 00:02:22.147 TEST_HEADER include/spdk/scheduler.h 00:02:22.147 TEST_HEADER include/spdk/scsi.h 00:02:22.147 TEST_HEADER include/spdk/scsi_spec.h 00:02:22.147 TEST_HEADER include/spdk/sock.h 00:02:22.147 LINK spdk_lspci 00:02:22.147 TEST_HEADER include/spdk/stdinc.h 00:02:22.147 TEST_HEADER include/spdk/string.h 00:02:22.147 TEST_HEADER include/spdk/thread.h 00:02:22.147 TEST_HEADER include/spdk/trace.h 00:02:22.147 TEST_HEADER include/spdk/trace_parser.h 00:02:22.147 TEST_HEADER include/spdk/tree.h 00:02:22.147 TEST_HEADER include/spdk/ublk.h 00:02:22.147 TEST_HEADER include/spdk/util.h 00:02:22.147 TEST_HEADER include/spdk/uuid.h 00:02:22.147 TEST_HEADER include/spdk/version.h 00:02:22.147 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:22.147 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:22.147 TEST_HEADER include/spdk/vhost.h 00:02:22.147 TEST_HEADER include/spdk/vmd.h 00:02:22.147 TEST_HEADER include/spdk/xor.h 00:02:22.147 TEST_HEADER include/spdk/zipf.h 00:02:22.147 CXX test/cpp_headers/accel.o 00:02:22.147 LINK lsvmd 00:02:22.147 LINK rpc_client_test 00:02:22.147 LINK spdk_nvme_discover 00:02:22.409 LINK led 00:02:22.409 LINK event_perf 00:02:22.409 LINK zipf 00:02:22.409 LINK interrupt_tgt 00:02:22.409 LINK nvmf_tgt 00:02:22.409 LINK poller_perf 00:02:22.409 LINK vhost 00:02:22.409 LINK pmr_persistence 00:02:22.409 LINK cmb_copy 00:02:22.409 LINK spdk_trace_record 00:02:22.409 LINK verify 00:02:22.409 LINK iscsi_tgt 00:02:22.409 LINK ioat_perf 00:02:22.409 LINK bdev_svc 00:02:22.409 LINK hello_world 00:02:22.409 LINK spdk_tgt 00:02:22.409 LINK mkfs 00:02:22.409 LINK hello_sock 00:02:22.409 LINK hotplug 00:02:22.409 LINK hello_blob 00:02:22.409 LINK thread 00:02:22.676 LINK hello_bdev 00:02:22.676 LINK aer 00:02:22.676 CC test/event/reactor/reactor.o 00:02:22.676 LINK arbitration 00:02:22.676 CXX test/cpp_headers/accel_module.o 00:02:22.676 LINK spdk_dd 00:02:22.676 LINK nvmf 00:02:22.676 LINK reconnect 00:02:22.676 LINK idxd_perf 00:02:22.676 CXX test/cpp_headers/assert.o 00:02:22.676 CC test/env/vtophys/vtophys.o 00:02:22.676 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:22.676 CC test/event/reactor_perf/reactor_perf.o 00:02:22.676 LINK abort 00:02:22.676 CXX test/cpp_headers/barrier.o 00:02:22.676 CC test/nvme/reset/reset.o 00:02:22.676 CXX test/cpp_headers/base64.o 00:02:22.676 LINK spdk_trace 00:02:22.676 CC test/env/memory/memory_ut.o 00:02:22.676 CC test/event/app_repeat/app_repeat.o 00:02:22.676 CC test/app/histogram_perf/histogram_perf.o 00:02:22.676 LINK test_dma 00:02:22.676 CC test/nvme/sgl/sgl.o 00:02:22.676 LINK dif 00:02:22.676 LINK bdevio 00:02:22.676 CC test/app/jsoncat/jsoncat.o 00:02:22.676 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:22.940 CC app/fio/bdev/fio_plugin.o 00:02:22.940 CXX test/cpp_headers/bdev.o 00:02:22.940 CXX test/cpp_headers/bdev_module.o 00:02:22.940 LINK accel_perf 00:02:22.940 CC test/nvme/e2edp/nvme_dp.o 00:02:22.940 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:22.940 CC test/event/scheduler/scheduler.o 00:02:22.940 LINK reactor 00:02:22.940 CC test/env/pci/pci_ut.o 00:02:22.940 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:22.940 CC test/nvme/overhead/overhead.o 00:02:22.940 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:22.940 LINK nvme_manage 00:02:22.940 CXX test/cpp_headers/bdev_zone.o 00:02:22.940 CXX test/cpp_headers/bit_array.o 00:02:22.940 CC test/app/stub/stub.o 00:02:22.940 LINK reactor_perf 00:02:22.940 LINK vtophys 00:02:22.940 LINK blobcli 00:02:22.940 CXX test/cpp_headers/bit_pool.o 00:02:22.940 LINK spdk_nvme 00:02:22.940 LINK env_dpdk_post_init 00:02:22.940 CC test/nvme/err_injection/err_injection.o 00:02:22.940 LINK histogram_perf 00:02:22.940 LINK app_repeat 00:02:22.940 CC test/nvme/startup/startup.o 00:02:22.940 CC test/nvme/simple_copy/simple_copy.o 00:02:22.940 CC test/nvme/reserve/reserve.o 00:02:22.940 LINK jsoncat 00:02:23.202 CC test/nvme/connect_stress/connect_stress.o 00:02:23.202 CC test/nvme/compliance/nvme_compliance.o 00:02:23.202 CC test/nvme/boot_partition/boot_partition.o 00:02:23.202 CC test/nvme/fused_ordering/fused_ordering.o 00:02:23.202 CXX test/cpp_headers/blob_bdev.o 00:02:23.202 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:23.202 CXX test/cpp_headers/blobfs_bdev.o 00:02:23.202 CXX test/cpp_headers/blobfs.o 00:02:23.202 CXX test/cpp_headers/blob.o 00:02:23.202 CXX test/cpp_headers/conf.o 00:02:23.202 CC test/nvme/fdp/fdp.o 00:02:23.202 CXX test/cpp_headers/config.o 00:02:23.202 LINK reset 00:02:23.202 CXX test/cpp_headers/cpuset.o 00:02:23.202 CXX test/cpp_headers/crc16.o 00:02:23.202 CXX test/cpp_headers/crc32.o 00:02:23.202 LINK mem_callbacks 00:02:23.202 CXX test/cpp_headers/crc64.o 00:02:23.202 CC test/nvme/cuse/cuse.o 00:02:23.202 LINK sgl 00:02:23.202 CXX test/cpp_headers/dif.o 00:02:23.202 CXX test/cpp_headers/dma.o 00:02:23.202 LINK scheduler 00:02:23.202 CXX test/cpp_headers/endian.o 00:02:23.202 CXX test/cpp_headers/env_dpdk.o 00:02:23.202 LINK stub 00:02:23.465 CXX test/cpp_headers/env.o 00:02:23.465 CXX test/cpp_headers/event.o 00:02:23.465 CXX test/cpp_headers/fd_group.o 00:02:23.465 CXX test/cpp_headers/fd.o 00:02:23.465 CXX test/cpp_headers/file.o 00:02:23.465 CXX test/cpp_headers/ftl.o 00:02:23.465 LINK startup 00:02:23.465 LINK nvme_dp 00:02:23.465 LINK spdk_nvme_perf 00:02:23.465 LINK err_injection 00:02:23.465 LINK reserve 00:02:23.465 LINK boot_partition 00:02:23.465 LINK spdk_nvme_identify 00:02:23.465 LINK connect_stress 00:02:23.465 CXX test/cpp_headers/gpt_spec.o 00:02:23.465 LINK overhead 00:02:23.465 CXX test/cpp_headers/hexlify.o 00:02:23.465 CXX test/cpp_headers/histogram_data.o 00:02:23.465 LINK simple_copy 00:02:23.465 LINK spdk_top 00:02:23.465 LINK fused_ordering 00:02:23.465 CXX test/cpp_headers/idxd.o 00:02:23.465 LINK nvme_fuzz 00:02:23.465 LINK doorbell_aers 00:02:23.465 LINK bdevperf 00:02:23.465 CXX test/cpp_headers/idxd_spec.o 00:02:23.465 CXX test/cpp_headers/init.o 00:02:23.465 CXX test/cpp_headers/ioat.o 00:02:23.465 CXX test/cpp_headers/ioat_spec.o 00:02:23.465 CXX test/cpp_headers/iscsi_spec.o 00:02:23.731 CXX test/cpp_headers/json.o 00:02:23.731 CXX test/cpp_headers/jsonrpc.o 00:02:23.731 CXX test/cpp_headers/likely.o 00:02:23.731 LINK pci_ut 00:02:23.731 CXX test/cpp_headers/log.o 00:02:23.731 CXX test/cpp_headers/lvol.o 00:02:23.731 CXX test/cpp_headers/memory.o 00:02:23.731 LINK vhost_fuzz 00:02:23.731 CXX test/cpp_headers/mmio.o 00:02:23.731 CXX test/cpp_headers/nbd.o 00:02:23.731 CXX test/cpp_headers/notify.o 00:02:23.731 CXX test/cpp_headers/nvme.o 00:02:23.731 CXX test/cpp_headers/nvme_intel.o 00:02:23.731 CXX test/cpp_headers/nvme_ocssd.o 00:02:23.731 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:23.731 CXX test/cpp_headers/nvme_spec.o 00:02:23.731 CXX test/cpp_headers/nvme_zns.o 00:02:23.731 CXX test/cpp_headers/nvmf_cmd.o 00:02:23.731 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:23.731 LINK spdk_bdev 00:02:23.731 CXX test/cpp_headers/nvmf.o 00:02:23.731 CXX test/cpp_headers/nvmf_spec.o 00:02:23.731 LINK nvme_compliance 00:02:23.731 CXX test/cpp_headers/nvmf_transport.o 00:02:23.731 CXX test/cpp_headers/opal.o 00:02:23.731 CXX test/cpp_headers/opal_spec.o 00:02:23.731 CXX test/cpp_headers/pci_ids.o 00:02:23.731 CXX test/cpp_headers/pipe.o 00:02:23.731 LINK fdp 00:02:23.731 CXX test/cpp_headers/queue.o 00:02:23.731 CXX test/cpp_headers/reduce.o 00:02:23.731 CXX test/cpp_headers/rpc.o 00:02:23.731 CXX test/cpp_headers/scheduler.o 00:02:23.731 CXX test/cpp_headers/scsi.o 00:02:23.731 CXX test/cpp_headers/scsi_spec.o 00:02:23.993 CXX test/cpp_headers/sock.o 00:02:23.993 CXX test/cpp_headers/stdinc.o 00:02:23.993 CXX test/cpp_headers/string.o 00:02:23.993 CXX test/cpp_headers/thread.o 00:02:23.993 CXX test/cpp_headers/trace.o 00:02:23.993 CXX test/cpp_headers/trace_parser.o 00:02:23.993 CXX test/cpp_headers/tree.o 00:02:23.993 CXX test/cpp_headers/ublk.o 00:02:23.993 CXX test/cpp_headers/util.o 00:02:23.993 CXX test/cpp_headers/uuid.o 00:02:23.993 CXX test/cpp_headers/version.o 00:02:23.993 CXX test/cpp_headers/vfio_user_pci.o 00:02:23.993 CXX test/cpp_headers/vfio_user_spec.o 00:02:23.993 CXX test/cpp_headers/vhost.o 00:02:23.993 CXX test/cpp_headers/vmd.o 00:02:23.993 CXX test/cpp_headers/xor.o 00:02:23.993 CXX test/cpp_headers/zipf.o 00:02:24.251 LINK memory_ut 00:02:24.820 LINK cuse 00:02:25.078 LINK iscsi_fuzz 00:02:27.617 LINK esnap 00:02:27.617 00:02:27.617 real 0m45.992s 00:02:27.617 user 9m39.793s 00:02:27.617 sys 2m9.815s 00:02:27.617 00:55:18 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:27.617 00:55:18 -- common/autotest_common.sh@10 -- $ set +x 00:02:27.617 ************************************ 00:02:27.617 END TEST make 00:02:27.617 ************************************ 00:02:27.877 00:55:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:27.877 00:55:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:27.877 00:55:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:27.877 00:55:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:27.877 00:55:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:27.877 00:55:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:27.877 00:55:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:27.877 00:55:18 -- scripts/common.sh@335 -- # IFS=.-: 00:02:27.877 00:55:18 -- scripts/common.sh@335 -- # read -ra ver1 00:02:27.877 00:55:18 -- scripts/common.sh@336 -- # IFS=.-: 00:02:27.877 00:55:18 -- scripts/common.sh@336 -- # read -ra ver2 00:02:27.877 00:55:18 -- scripts/common.sh@337 -- # local 'op=<' 00:02:27.877 00:55:18 -- scripts/common.sh@339 -- # ver1_l=2 00:02:27.877 00:55:18 -- scripts/common.sh@340 -- # ver2_l=1 00:02:27.877 00:55:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:27.877 00:55:18 -- scripts/common.sh@343 -- # case "$op" in 00:02:27.877 00:55:18 -- scripts/common.sh@344 -- # : 1 00:02:27.877 00:55:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:27.877 00:55:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:27.877 00:55:18 -- scripts/common.sh@364 -- # decimal 1 00:02:27.877 00:55:18 -- scripts/common.sh@352 -- # local d=1 00:02:27.877 00:55:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:27.877 00:55:18 -- scripts/common.sh@354 -- # echo 1 00:02:27.877 00:55:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:27.877 00:55:18 -- scripts/common.sh@365 -- # decimal 2 00:02:27.877 00:55:18 -- scripts/common.sh@352 -- # local d=2 00:02:27.877 00:55:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:27.877 00:55:18 -- scripts/common.sh@354 -- # echo 2 00:02:27.877 00:55:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:27.877 00:55:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:27.877 00:55:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:27.877 00:55:18 -- scripts/common.sh@367 -- # return 0 00:02:27.877 00:55:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:27.877 00:55:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:27.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.877 --rc genhtml_branch_coverage=1 00:02:27.877 --rc genhtml_function_coverage=1 00:02:27.877 --rc genhtml_legend=1 00:02:27.877 --rc geninfo_all_blocks=1 00:02:27.877 --rc geninfo_unexecuted_blocks=1 00:02:27.877 00:02:27.877 ' 00:02:27.877 00:55:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:27.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.877 --rc genhtml_branch_coverage=1 00:02:27.877 --rc genhtml_function_coverage=1 00:02:27.877 --rc genhtml_legend=1 00:02:27.877 --rc geninfo_all_blocks=1 00:02:27.877 --rc geninfo_unexecuted_blocks=1 00:02:27.877 00:02:27.877 ' 00:02:27.877 00:55:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:27.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.877 --rc genhtml_branch_coverage=1 00:02:27.877 --rc genhtml_function_coverage=1 00:02:27.877 --rc genhtml_legend=1 00:02:27.877 --rc geninfo_all_blocks=1 00:02:27.877 --rc geninfo_unexecuted_blocks=1 00:02:27.877 00:02:27.877 ' 00:02:27.877 00:55:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:27.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:27.877 --rc genhtml_branch_coverage=1 00:02:27.877 --rc genhtml_function_coverage=1 00:02:27.877 --rc genhtml_legend=1 00:02:27.877 --rc geninfo_all_blocks=1 00:02:27.877 --rc geninfo_unexecuted_blocks=1 00:02:27.877 00:02:27.877 ' 00:02:27.877 00:55:18 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:27.877 00:55:18 -- nvmf/common.sh@7 -- # uname -s 00:02:27.877 00:55:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:27.877 00:55:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:27.877 00:55:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:27.877 00:55:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:27.877 00:55:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:27.877 00:55:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:27.877 00:55:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:27.877 00:55:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:27.877 00:55:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:27.877 00:55:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:27.877 00:55:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:27.877 00:55:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:27.877 00:55:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:27.877 00:55:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:27.877 00:55:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:27.877 00:55:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:27.877 00:55:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:27.877 00:55:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:27.877 00:55:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:27.877 00:55:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.877 00:55:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.877 00:55:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.877 00:55:18 -- paths/export.sh@5 -- # export PATH 00:02:27.877 00:55:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:27.877 00:55:18 -- nvmf/common.sh@46 -- # : 0 00:02:27.877 00:55:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:27.877 00:55:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:27.877 00:55:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:27.877 00:55:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:27.877 00:55:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:27.877 00:55:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:27.877 00:55:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:27.877 00:55:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:27.877 00:55:18 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:27.877 00:55:18 -- spdk/autotest.sh@32 -- # uname -s 00:02:27.878 00:55:18 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:27.878 00:55:18 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:27.878 00:55:18 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:27.878 00:55:18 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:27.878 00:55:18 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:27.878 00:55:18 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:27.878 00:55:18 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:27.878 00:55:18 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:27.878 00:55:18 -- spdk/autotest.sh@48 -- # udevadm_pid=894724 00:02:27.878 00:55:18 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:27.878 00:55:18 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.878 00:55:18 -- spdk/autotest.sh@54 -- # echo 894726 00:02:27.878 00:55:18 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.878 00:55:18 -- spdk/autotest.sh@56 -- # echo 894727 00:02:27.878 00:55:18 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:27.878 00:55:18 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:27.878 00:55:18 -- spdk/autotest.sh@60 -- # echo 894728 00:02:27.878 00:55:18 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:27.878 00:55:18 -- spdk/autotest.sh@62 -- # echo 894729 00:02:27.878 00:55:18 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:27.878 00:55:18 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:27.878 00:55:18 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:27.878 00:55:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:27.878 00:55:18 -- common/autotest_common.sh@10 -- # set +x 00:02:27.878 00:55:18 -- spdk/autotest.sh@70 -- # create_test_list 00:02:27.878 00:55:18 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:27.878 00:55:18 -- common/autotest_common.sh@10 -- # set +x 00:02:27.878 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:27.878 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:27.878 00:55:18 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:27.878 00:55:18 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.878 00:55:18 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.878 00:55:18 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:27.878 00:55:18 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:27.878 00:55:18 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:27.878 00:55:18 -- common/autotest_common.sh@1450 -- # uname 00:02:27.878 00:55:18 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:27.878 00:55:18 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:27.878 00:55:18 -- common/autotest_common.sh@1470 -- # uname 00:02:27.878 00:55:18 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:27.878 00:55:18 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:27.878 00:55:18 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:28.137 lcov: LCOV version 1.15 00:02:28.137 00:55:18 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:46.213 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:46.213 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:46.213 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:46.213 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:46.213 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:46.213 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:01.086 00:55:51 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:01.086 00:55:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:01.086 00:55:51 -- common/autotest_common.sh@10 -- # set +x 00:03:01.086 00:55:51 -- spdk/autotest.sh@89 -- # rm -f 00:03:01.086 00:55:51 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:02.021 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:02.021 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:02.021 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:02.021 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:02.021 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:02.021 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:02.021 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:02.021 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:02.021 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:02.021 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:02.021 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:02.021 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:02.021 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:02.021 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:02.021 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:02.021 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:02.021 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:02.280 00:55:52 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:02.280 00:55:52 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:02.280 00:55:52 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:02.280 00:55:52 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:02.280 00:55:52 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:02.280 00:55:52 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:02.280 00:55:52 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:02.280 00:55:52 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:02.280 00:55:52 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:02.280 00:55:52 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:02.280 00:55:52 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:02.280 00:55:52 -- spdk/autotest.sh@108 -- # grep -v p 00:03:02.280 00:55:52 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:02.280 00:55:52 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:02.280 00:55:52 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:02.280 00:55:52 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:02.280 00:55:52 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:02.280 No valid GPT data, bailing 00:03:02.280 00:55:52 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:02.280 00:55:52 -- scripts/common.sh@393 -- # pt= 00:03:02.280 00:55:52 -- scripts/common.sh@394 -- # return 1 00:03:02.280 00:55:52 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:02.280 1+0 records in 00:03:02.280 1+0 records out 00:03:02.280 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00209058 s, 502 MB/s 00:03:02.280 00:55:52 -- spdk/autotest.sh@116 -- # sync 00:03:02.280 00:55:52 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:02.280 00:55:52 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:02.280 00:55:52 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:04.248 00:55:54 -- spdk/autotest.sh@122 -- # uname -s 00:03:04.248 00:55:54 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:04.248 00:55:54 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:04.248 00:55:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:04.248 00:55:54 -- common/autotest_common.sh@10 -- # set +x 00:03:04.248 ************************************ 00:03:04.248 START TEST setup.sh 00:03:04.248 ************************************ 00:03:04.248 00:55:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:04.248 * Looking for test storage... 00:03:04.248 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:04.248 00:55:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:04.248 00:55:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:04.248 00:55:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:04.248 00:55:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:04.248 00:55:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:04.248 00:55:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:04.248 00:55:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:04.248 00:55:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:04.248 00:55:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:04.248 00:55:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:04.248 00:55:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:04.248 00:55:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:04.248 00:55:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:04.248 00:55:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:04.248 00:55:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:04.248 00:55:54 -- scripts/common.sh@344 -- # : 1 00:03:04.248 00:55:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:04.248 00:55:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:04.248 00:55:54 -- scripts/common.sh@364 -- # decimal 1 00:03:04.248 00:55:54 -- scripts/common.sh@352 -- # local d=1 00:03:04.248 00:55:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:04.248 00:55:54 -- scripts/common.sh@354 -- # echo 1 00:03:04.248 00:55:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:04.248 00:55:54 -- scripts/common.sh@365 -- # decimal 2 00:03:04.248 00:55:54 -- scripts/common.sh@352 -- # local d=2 00:03:04.248 00:55:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:04.248 00:55:54 -- scripts/common.sh@354 -- # echo 2 00:03:04.248 00:55:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:04.248 00:55:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:04.248 00:55:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:04.248 00:55:54 -- scripts/common.sh@367 -- # return 0 00:03:04.248 00:55:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:04.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.248 --rc genhtml_branch_coverage=1 00:03:04.248 --rc genhtml_function_coverage=1 00:03:04.248 --rc genhtml_legend=1 00:03:04.248 --rc geninfo_all_blocks=1 00:03:04.248 --rc geninfo_unexecuted_blocks=1 00:03:04.248 00:03:04.248 ' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:04.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.248 --rc genhtml_branch_coverage=1 00:03:04.248 --rc genhtml_function_coverage=1 00:03:04.248 --rc genhtml_legend=1 00:03:04.248 --rc geninfo_all_blocks=1 00:03:04.248 --rc geninfo_unexecuted_blocks=1 00:03:04.248 00:03:04.248 ' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:04.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.248 --rc genhtml_branch_coverage=1 00:03:04.248 --rc genhtml_function_coverage=1 00:03:04.248 --rc genhtml_legend=1 00:03:04.248 --rc geninfo_all_blocks=1 00:03:04.248 --rc geninfo_unexecuted_blocks=1 00:03:04.248 00:03:04.248 ' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:04.248 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.248 --rc genhtml_branch_coverage=1 00:03:04.248 --rc genhtml_function_coverage=1 00:03:04.248 --rc genhtml_legend=1 00:03:04.248 --rc geninfo_all_blocks=1 00:03:04.248 --rc geninfo_unexecuted_blocks=1 00:03:04.248 00:03:04.248 ' 00:03:04.248 00:55:54 -- setup/test-setup.sh@10 -- # uname -s 00:03:04.248 00:55:54 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:04.248 00:55:54 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:04.248 00:55:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:04.248 00:55:54 -- common/autotest_common.sh@10 -- # set +x 00:03:04.248 ************************************ 00:03:04.248 START TEST acl 00:03:04.248 ************************************ 00:03:04.248 00:55:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:04.248 * Looking for test storage... 00:03:04.248 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:04.248 00:55:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:04.248 00:55:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:04.248 00:55:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:04.248 00:55:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:04.248 00:55:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:04.248 00:55:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:04.248 00:55:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:04.248 00:55:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:04.248 00:55:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:04.248 00:55:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:04.248 00:55:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:04.248 00:55:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:04.248 00:55:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:04.248 00:55:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:04.248 00:55:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:04.248 00:55:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:04.248 00:55:54 -- scripts/common.sh@344 -- # : 1 00:03:04.248 00:55:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:04.248 00:55:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:04.248 00:55:54 -- scripts/common.sh@364 -- # decimal 1 00:03:04.248 00:55:54 -- scripts/common.sh@352 -- # local d=1 00:03:04.249 00:55:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:04.249 00:55:54 -- scripts/common.sh@354 -- # echo 1 00:03:04.249 00:55:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:04.249 00:55:54 -- scripts/common.sh@365 -- # decimal 2 00:03:04.249 00:55:54 -- scripts/common.sh@352 -- # local d=2 00:03:04.249 00:55:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:04.249 00:55:54 -- scripts/common.sh@354 -- # echo 2 00:03:04.249 00:55:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:04.249 00:55:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:04.249 00:55:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:04.249 00:55:54 -- scripts/common.sh@367 -- # return 0 00:03:04.249 00:55:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:04.249 00:55:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:04.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.249 --rc genhtml_branch_coverage=1 00:03:04.249 --rc genhtml_function_coverage=1 00:03:04.249 --rc genhtml_legend=1 00:03:04.249 --rc geninfo_all_blocks=1 00:03:04.249 --rc geninfo_unexecuted_blocks=1 00:03:04.249 00:03:04.249 ' 00:03:04.249 00:55:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:04.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.249 --rc genhtml_branch_coverage=1 00:03:04.249 --rc genhtml_function_coverage=1 00:03:04.249 --rc genhtml_legend=1 00:03:04.249 --rc geninfo_all_blocks=1 00:03:04.249 --rc geninfo_unexecuted_blocks=1 00:03:04.249 00:03:04.249 ' 00:03:04.249 00:55:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:04.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.249 --rc genhtml_branch_coverage=1 00:03:04.249 --rc genhtml_function_coverage=1 00:03:04.249 --rc genhtml_legend=1 00:03:04.249 --rc geninfo_all_blocks=1 00:03:04.249 --rc geninfo_unexecuted_blocks=1 00:03:04.249 00:03:04.249 ' 00:03:04.249 00:55:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:04.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:04.249 --rc genhtml_branch_coverage=1 00:03:04.249 --rc genhtml_function_coverage=1 00:03:04.249 --rc genhtml_legend=1 00:03:04.249 --rc geninfo_all_blocks=1 00:03:04.249 --rc geninfo_unexecuted_blocks=1 00:03:04.249 00:03:04.249 ' 00:03:04.249 00:55:54 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:04.249 00:55:54 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:04.249 00:55:54 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:04.249 00:55:54 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:04.249 00:55:54 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:04.249 00:55:54 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:04.249 00:55:54 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:04.249 00:55:54 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:04.249 00:55:54 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:04.249 00:55:54 -- setup/acl.sh@12 -- # devs=() 00:03:04.249 00:55:54 -- setup/acl.sh@12 -- # declare -a devs 00:03:04.249 00:55:54 -- setup/acl.sh@13 -- # drivers=() 00:03:04.249 00:55:54 -- setup/acl.sh@13 -- # declare -A drivers 00:03:04.249 00:55:54 -- setup/acl.sh@51 -- # setup reset 00:03:04.249 00:55:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:04.249 00:55:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:06.152 00:55:56 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:06.152 00:55:56 -- setup/acl.sh@16 -- # local dev driver 00:03:06.152 00:55:56 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.152 00:55:56 -- setup/acl.sh@15 -- # setup output status 00:03:06.152 00:55:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:06.152 00:55:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:06.719 Hugepages 00:03:06.719 node hugesize free / total 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:03:06.719 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.719 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.719 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.719 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # continue 00:03:06.978 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.978 00:55:57 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:06.978 00:55:57 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:06.978 00:55:57 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:06.979 00:55:57 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:06.979 00:55:57 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:06.979 00:55:57 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:06.979 00:55:57 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:06.979 00:55:57 -- setup/acl.sh@54 -- # run_test denied denied 00:03:06.979 00:55:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:06.979 00:55:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:06.979 00:55:57 -- common/autotest_common.sh@10 -- # set +x 00:03:06.979 ************************************ 00:03:06.979 START TEST denied 00:03:06.979 ************************************ 00:03:06.979 00:55:57 -- common/autotest_common.sh@1114 -- # denied 00:03:06.979 00:55:57 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:06.979 00:55:57 -- setup/acl.sh@38 -- # setup output config 00:03:06.979 00:55:57 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:06.979 00:55:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:06.979 00:55:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:08.353 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:08.353 00:55:58 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:08.353 00:55:58 -- setup/acl.sh@28 -- # local dev driver 00:03:08.353 00:55:58 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:08.353 00:55:58 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:08.353 00:55:58 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:08.353 00:55:58 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:08.353 00:55:58 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:08.353 00:55:58 -- setup/acl.sh@41 -- # setup reset 00:03:08.353 00:55:58 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:08.353 00:55:58 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:10.886 00:03:10.886 real 0m3.913s 00:03:10.886 user 0m1.111s 00:03:10.886 sys 0m1.905s 00:03:10.886 00:56:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:10.886 00:56:01 -- common/autotest_common.sh@10 -- # set +x 00:03:10.886 ************************************ 00:03:10.886 END TEST denied 00:03:10.886 ************************************ 00:03:10.886 00:56:01 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:10.886 00:56:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:10.886 00:56:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:10.886 00:56:01 -- common/autotest_common.sh@10 -- # set +x 00:03:10.886 ************************************ 00:03:10.886 START TEST allowed 00:03:10.886 ************************************ 00:03:10.886 00:56:01 -- common/autotest_common.sh@1114 -- # allowed 00:03:10.886 00:56:01 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:10.886 00:56:01 -- setup/acl.sh@45 -- # setup output config 00:03:10.886 00:56:01 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:10.886 00:56:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.886 00:56:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:13.421 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:13.421 00:56:03 -- setup/acl.sh@47 -- # verify 00:03:13.421 00:56:03 -- setup/acl.sh@28 -- # local dev driver 00:03:13.421 00:56:03 -- setup/acl.sh@48 -- # setup reset 00:03:13.421 00:56:03 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:13.421 00:56:03 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:14.801 00:03:14.801 real 0m3.842s 00:03:14.801 user 0m0.993s 00:03:14.801 sys 0m1.761s 00:03:14.801 00:56:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.801 00:56:05 -- common/autotest_common.sh@10 -- # set +x 00:03:14.801 ************************************ 00:03:14.801 END TEST allowed 00:03:14.801 ************************************ 00:03:14.801 00:03:14.801 real 0m10.568s 00:03:14.801 user 0m3.217s 00:03:14.801 sys 0m5.455s 00:03:14.801 00:56:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:14.801 00:56:05 -- common/autotest_common.sh@10 -- # set +x 00:03:14.801 ************************************ 00:03:14.801 END TEST acl 00:03:14.801 ************************************ 00:03:14.801 00:56:05 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:14.801 00:56:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:14.801 00:56:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:14.801 00:56:05 -- common/autotest_common.sh@10 -- # set +x 00:03:14.801 ************************************ 00:03:14.801 START TEST hugepages 00:03:14.801 ************************************ 00:03:14.801 00:56:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:14.801 * Looking for test storage... 00:03:14.801 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:14.801 00:56:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:14.801 00:56:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:14.801 00:56:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:14.801 00:56:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:14.801 00:56:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:14.801 00:56:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:14.801 00:56:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:14.801 00:56:05 -- scripts/common.sh@335 -- # IFS=.-: 00:03:14.801 00:56:05 -- scripts/common.sh@335 -- # read -ra ver1 00:03:14.801 00:56:05 -- scripts/common.sh@336 -- # IFS=.-: 00:03:14.801 00:56:05 -- scripts/common.sh@336 -- # read -ra ver2 00:03:14.801 00:56:05 -- scripts/common.sh@337 -- # local 'op=<' 00:03:14.801 00:56:05 -- scripts/common.sh@339 -- # ver1_l=2 00:03:14.801 00:56:05 -- scripts/common.sh@340 -- # ver2_l=1 00:03:14.801 00:56:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:14.801 00:56:05 -- scripts/common.sh@343 -- # case "$op" in 00:03:14.801 00:56:05 -- scripts/common.sh@344 -- # : 1 00:03:14.801 00:56:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:14.801 00:56:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:14.801 00:56:05 -- scripts/common.sh@364 -- # decimal 1 00:03:14.801 00:56:05 -- scripts/common.sh@352 -- # local d=1 00:03:14.801 00:56:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:14.801 00:56:05 -- scripts/common.sh@354 -- # echo 1 00:03:14.801 00:56:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:14.801 00:56:05 -- scripts/common.sh@365 -- # decimal 2 00:03:14.801 00:56:05 -- scripts/common.sh@352 -- # local d=2 00:03:14.801 00:56:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:14.801 00:56:05 -- scripts/common.sh@354 -- # echo 2 00:03:14.801 00:56:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:14.801 00:56:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:14.801 00:56:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:14.801 00:56:05 -- scripts/common.sh@367 -- # return 0 00:03:14.801 00:56:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:14.801 00:56:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:14.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.801 --rc genhtml_branch_coverage=1 00:03:14.801 --rc genhtml_function_coverage=1 00:03:14.801 --rc genhtml_legend=1 00:03:14.801 --rc geninfo_all_blocks=1 00:03:14.801 --rc geninfo_unexecuted_blocks=1 00:03:14.801 00:03:14.801 ' 00:03:14.801 00:56:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:14.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.801 --rc genhtml_branch_coverage=1 00:03:14.801 --rc genhtml_function_coverage=1 00:03:14.801 --rc genhtml_legend=1 00:03:14.801 --rc geninfo_all_blocks=1 00:03:14.801 --rc geninfo_unexecuted_blocks=1 00:03:14.801 00:03:14.801 ' 00:03:14.801 00:56:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:14.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.801 --rc genhtml_branch_coverage=1 00:03:14.801 --rc genhtml_function_coverage=1 00:03:14.801 --rc genhtml_legend=1 00:03:14.801 --rc geninfo_all_blocks=1 00:03:14.801 --rc geninfo_unexecuted_blocks=1 00:03:14.801 00:03:14.801 ' 00:03:14.801 00:56:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:14.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:14.801 --rc genhtml_branch_coverage=1 00:03:14.801 --rc genhtml_function_coverage=1 00:03:14.801 --rc genhtml_legend=1 00:03:14.801 --rc geninfo_all_blocks=1 00:03:14.801 --rc geninfo_unexecuted_blocks=1 00:03:14.801 00:03:14.801 ' 00:03:14.801 00:56:05 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:14.801 00:56:05 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:14.801 00:56:05 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:14.802 00:56:05 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:14.802 00:56:05 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:14.802 00:56:05 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:14.802 00:56:05 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:14.802 00:56:05 -- setup/common.sh@18 -- # local node= 00:03:14.802 00:56:05 -- setup/common.sh@19 -- # local var val 00:03:14.802 00:56:05 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.802 00:56:05 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.802 00:56:05 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.802 00:56:05 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.802 00:56:05 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.802 00:56:05 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 43131376 kB' 'MemAvailable: 46904740 kB' 'Buffers: 2708 kB' 'Cached: 10620400 kB' 'SwapCached: 0 kB' 'Active: 7352552 kB' 'Inactive: 3766524 kB' 'Active(anon): 6950780 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499392 kB' 'Mapped: 163108 kB' 'Shmem: 6454812 kB' 'KReclaimable: 197780 kB' 'Slab: 758540 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560760 kB' 'KernelStack: 12848 kB' 'PageTables: 8108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559280 kB' 'Committed_AS: 8019436 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198732 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.802 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.802 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # continue 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.803 00:56:05 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.803 00:56:05 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:14.803 00:56:05 -- setup/common.sh@33 -- # echo 2048 00:03:14.803 00:56:05 -- setup/common.sh@33 -- # return 0 00:03:14.803 00:56:05 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:14.803 00:56:05 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:14.803 00:56:05 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:14.803 00:56:05 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:14.803 00:56:05 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:14.803 00:56:05 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:14.803 00:56:05 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:14.803 00:56:05 -- setup/hugepages.sh@207 -- # get_nodes 00:03:14.803 00:56:05 -- setup/hugepages.sh@27 -- # local node 00:03:14.803 00:56:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.803 00:56:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:14.803 00:56:05 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.803 00:56:05 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:14.803 00:56:05 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.803 00:56:05 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.803 00:56:05 -- setup/hugepages.sh@208 -- # clear_hp 00:03:14.803 00:56:05 -- setup/hugepages.sh@37 -- # local node hp 00:03:14.803 00:56:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:14.803 00:56:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:14.803 00:56:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:14.803 00:56:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:14.803 00:56:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:15.063 00:56:05 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:15.063 00:56:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:15.063 00:56:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:15.063 00:56:05 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:15.063 00:56:05 -- setup/hugepages.sh@41 -- # echo 0 00:03:15.063 00:56:05 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:15.063 00:56:05 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:15.063 00:56:05 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:15.063 00:56:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.063 00:56:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.063 00:56:05 -- common/autotest_common.sh@10 -- # set +x 00:03:15.063 ************************************ 00:03:15.063 START TEST default_setup 00:03:15.063 ************************************ 00:03:15.063 00:56:05 -- common/autotest_common.sh@1114 -- # default_setup 00:03:15.063 00:56:05 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:15.063 00:56:05 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:15.063 00:56:05 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:15.063 00:56:05 -- setup/hugepages.sh@51 -- # shift 00:03:15.063 00:56:05 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:15.063 00:56:05 -- setup/hugepages.sh@52 -- # local node_ids 00:03:15.063 00:56:05 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.063 00:56:05 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:15.063 00:56:05 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:15.063 00:56:05 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:15.063 00:56:05 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.063 00:56:05 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:15.063 00:56:05 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.063 00:56:05 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.063 00:56:05 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.063 00:56:05 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:15.063 00:56:05 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:15.063 00:56:05 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:15.063 00:56:05 -- setup/hugepages.sh@73 -- # return 0 00:03:15.063 00:56:05 -- setup/hugepages.sh@137 -- # setup output 00:03:15.063 00:56:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.063 00:56:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:16.441 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:16.441 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:16.441 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:16.442 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:16.442 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:16.442 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:16.442 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:16.442 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:16.442 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:17.383 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:17.383 00:56:07 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:17.383 00:56:07 -- setup/hugepages.sh@89 -- # local node 00:03:17.383 00:56:07 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.383 00:56:07 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.383 00:56:07 -- setup/hugepages.sh@92 -- # local surp 00:03:17.383 00:56:07 -- setup/hugepages.sh@93 -- # local resv 00:03:17.383 00:56:07 -- setup/hugepages.sh@94 -- # local anon 00:03:17.383 00:56:07 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.383 00:56:07 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.383 00:56:07 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.383 00:56:07 -- setup/common.sh@18 -- # local node= 00:03:17.383 00:56:07 -- setup/common.sh@19 -- # local var val 00:03:17.383 00:56:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.383 00:56:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.383 00:56:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.383 00:56:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.383 00:56:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.383 00:56:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45168564 kB' 'MemAvailable: 48941928 kB' 'Buffers: 2708 kB' 'Cached: 10620492 kB' 'SwapCached: 0 kB' 'Active: 7354492 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952720 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501104 kB' 'Mapped: 162604 kB' 'Shmem: 6454904 kB' 'KReclaimable: 197780 kB' 'Slab: 758372 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560592 kB' 'KernelStack: 12768 kB' 'PageTables: 7860 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025000 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.383 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.383 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.384 00:56:07 -- setup/common.sh@33 -- # echo 0 00:03:17.384 00:56:07 -- setup/common.sh@33 -- # return 0 00:03:17.384 00:56:07 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.384 00:56:07 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.384 00:56:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.384 00:56:07 -- setup/common.sh@18 -- # local node= 00:03:17.384 00:56:07 -- setup/common.sh@19 -- # local var val 00:03:17.384 00:56:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.384 00:56:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.384 00:56:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.384 00:56:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.384 00:56:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.384 00:56:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45169428 kB' 'MemAvailable: 48942792 kB' 'Buffers: 2708 kB' 'Cached: 10620492 kB' 'SwapCached: 0 kB' 'Active: 7355156 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953384 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501892 kB' 'Mapped: 162604 kB' 'Shmem: 6454904 kB' 'KReclaimable: 197780 kB' 'Slab: 758352 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560572 kB' 'KernelStack: 12784 kB' 'PageTables: 7880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.384 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.384 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.385 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.385 00:56:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.386 00:56:07 -- setup/common.sh@33 -- # echo 0 00:03:17.386 00:56:07 -- setup/common.sh@33 -- # return 0 00:03:17.386 00:56:07 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.386 00:56:07 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.386 00:56:07 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.386 00:56:07 -- setup/common.sh@18 -- # local node= 00:03:17.386 00:56:07 -- setup/common.sh@19 -- # local var val 00:03:17.386 00:56:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.386 00:56:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.386 00:56:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.386 00:56:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.386 00:56:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.386 00:56:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45177864 kB' 'MemAvailable: 48951228 kB' 'Buffers: 2708 kB' 'Cached: 10620496 kB' 'SwapCached: 0 kB' 'Active: 7354756 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952984 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501436 kB' 'Mapped: 162612 kB' 'Shmem: 6454908 kB' 'KReclaimable: 197780 kB' 'Slab: 758328 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560548 kB' 'KernelStack: 12832 kB' 'PageTables: 7876 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.386 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.386 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.387 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.387 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.388 00:56:07 -- setup/common.sh@33 -- # echo 0 00:03:17.388 00:56:07 -- setup/common.sh@33 -- # return 0 00:03:17.388 00:56:07 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.388 00:56:07 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:17.388 nr_hugepages=1024 00:03:17.388 00:56:07 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.388 resv_hugepages=0 00:03:17.388 00:56:07 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.388 surplus_hugepages=0 00:03:17.388 00:56:07 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.388 anon_hugepages=0 00:03:17.388 00:56:07 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.388 00:56:07 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:17.388 00:56:07 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.388 00:56:07 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.388 00:56:07 -- setup/common.sh@18 -- # local node= 00:03:17.388 00:56:07 -- setup/common.sh@19 -- # local var val 00:03:17.388 00:56:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.388 00:56:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.388 00:56:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.388 00:56:07 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.388 00:56:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.388 00:56:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45176968 kB' 'MemAvailable: 48950332 kB' 'Buffers: 2708 kB' 'Cached: 10620520 kB' 'SwapCached: 0 kB' 'Active: 7353988 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952216 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500580 kB' 'Mapped: 162536 kB' 'Shmem: 6454932 kB' 'KReclaimable: 197780 kB' 'Slab: 758312 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560532 kB' 'KernelStack: 12832 kB' 'PageTables: 7868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025044 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.388 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.388 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.389 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.389 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.390 00:56:07 -- setup/common.sh@33 -- # echo 1024 00:03:17.390 00:56:07 -- setup/common.sh@33 -- # return 0 00:03:17.390 00:56:07 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.390 00:56:07 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.390 00:56:07 -- setup/hugepages.sh@27 -- # local node 00:03:17.390 00:56:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.390 00:56:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:17.390 00:56:07 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.390 00:56:07 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:17.390 00:56:07 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.390 00:56:07 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.390 00:56:07 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.390 00:56:07 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.390 00:56:07 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.390 00:56:07 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.390 00:56:07 -- setup/common.sh@18 -- # local node=0 00:03:17.390 00:56:07 -- setup/common.sh@19 -- # local var val 00:03:17.390 00:56:07 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.390 00:56:07 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.390 00:56:07 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.390 00:56:07 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.390 00:56:07 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.390 00:56:07 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27543152 kB' 'MemUsed: 5331772 kB' 'SwapCached: 0 kB' 'Active: 1619240 kB' 'Inactive: 226888 kB' 'Active(anon): 1446016 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721140 kB' 'Mapped: 64000 kB' 'AnonPages: 128152 kB' 'Shmem: 1321028 kB' 'KernelStack: 7240 kB' 'PageTables: 3408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386784 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304504 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.390 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.390 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.391 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.391 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.392 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.392 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.392 00:56:07 -- setup/common.sh@32 -- # continue 00:03:17.392 00:56:07 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.392 00:56:07 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.392 00:56:07 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.392 00:56:07 -- setup/common.sh@33 -- # echo 0 00:03:17.392 00:56:07 -- setup/common.sh@33 -- # return 0 00:03:17.392 00:56:07 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.392 00:56:07 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.392 00:56:07 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.392 00:56:07 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.392 00:56:07 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:17.392 node0=1024 expecting 1024 00:03:17.392 00:56:07 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:17.392 00:03:17.392 real 0m2.515s 00:03:17.392 user 0m0.675s 00:03:17.392 sys 0m0.953s 00:03:17.392 00:56:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.392 00:56:07 -- common/autotest_common.sh@10 -- # set +x 00:03:17.392 ************************************ 00:03:17.392 END TEST default_setup 00:03:17.392 ************************************ 00:03:17.392 00:56:07 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:17.392 00:56:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.392 00:56:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.392 00:56:07 -- common/autotest_common.sh@10 -- # set +x 00:03:17.392 ************************************ 00:03:17.392 START TEST per_node_1G_alloc 00:03:17.392 ************************************ 00:03:17.392 00:56:07 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:17.392 00:56:07 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:17.392 00:56:07 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:17.392 00:56:07 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:17.392 00:56:07 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:17.392 00:56:07 -- setup/hugepages.sh@51 -- # shift 00:03:17.392 00:56:07 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:17.392 00:56:07 -- setup/hugepages.sh@52 -- # local node_ids 00:03:17.392 00:56:07 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.392 00:56:07 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:17.392 00:56:07 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:17.392 00:56:07 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:17.392 00:56:07 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.392 00:56:07 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:17.392 00:56:07 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.392 00:56:07 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.392 00:56:07 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.392 00:56:07 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:17.392 00:56:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:17.392 00:56:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:17.392 00:56:07 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:17.392 00:56:07 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:17.392 00:56:07 -- setup/hugepages.sh@73 -- # return 0 00:03:17.392 00:56:07 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:17.392 00:56:07 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:17.392 00:56:07 -- setup/hugepages.sh@146 -- # setup output 00:03:17.392 00:56:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.392 00:56:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:18.774 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.774 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:18.774 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.774 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.774 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.774 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.774 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.774 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.774 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.774 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:18.774 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:18.774 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:18.774 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:18.774 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:18.774 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:18.774 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:18.774 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:18.774 00:56:09 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:18.774 00:56:09 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:18.775 00:56:09 -- setup/hugepages.sh@89 -- # local node 00:03:18.775 00:56:09 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:18.775 00:56:09 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:18.775 00:56:09 -- setup/hugepages.sh@92 -- # local surp 00:03:18.775 00:56:09 -- setup/hugepages.sh@93 -- # local resv 00:03:18.775 00:56:09 -- setup/hugepages.sh@94 -- # local anon 00:03:18.775 00:56:09 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:18.775 00:56:09 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:18.775 00:56:09 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:18.775 00:56:09 -- setup/common.sh@18 -- # local node= 00:03:18.775 00:56:09 -- setup/common.sh@19 -- # local var val 00:03:18.775 00:56:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.775 00:56:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.775 00:56:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.775 00:56:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.775 00:56:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.775 00:56:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45175916 kB' 'MemAvailable: 48949280 kB' 'Buffers: 2708 kB' 'Cached: 10620576 kB' 'SwapCached: 0 kB' 'Active: 7355384 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953612 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501832 kB' 'Mapped: 162564 kB' 'Shmem: 6454988 kB' 'KReclaimable: 197780 kB' 'Slab: 758468 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560688 kB' 'KernelStack: 12832 kB' 'PageTables: 7856 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025216 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.775 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.775 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:18.776 00:56:09 -- setup/common.sh@33 -- # echo 0 00:03:18.776 00:56:09 -- setup/common.sh@33 -- # return 0 00:03:18.776 00:56:09 -- setup/hugepages.sh@97 -- # anon=0 00:03:18.776 00:56:09 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:18.776 00:56:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:18.776 00:56:09 -- setup/common.sh@18 -- # local node= 00:03:18.776 00:56:09 -- setup/common.sh@19 -- # local var val 00:03:18.776 00:56:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.776 00:56:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.776 00:56:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.776 00:56:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.776 00:56:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.776 00:56:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45176516 kB' 'MemAvailable: 48949880 kB' 'Buffers: 2708 kB' 'Cached: 10620576 kB' 'SwapCached: 0 kB' 'Active: 7355548 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953776 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501956 kB' 'Mapped: 162616 kB' 'Shmem: 6454988 kB' 'KReclaimable: 197780 kB' 'Slab: 758576 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560796 kB' 'KernelStack: 12848 kB' 'PageTables: 7912 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.776 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.776 00:56:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:18.777 00:56:09 -- setup/common.sh@33 -- # echo 0 00:03:18.777 00:56:09 -- setup/common.sh@33 -- # return 0 00:03:18.777 00:56:09 -- setup/hugepages.sh@99 -- # surp=0 00:03:18.777 00:56:09 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:18.777 00:56:09 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:18.777 00:56:09 -- setup/common.sh@18 -- # local node= 00:03:18.777 00:56:09 -- setup/common.sh@19 -- # local var val 00:03:18.777 00:56:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.777 00:56:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.777 00:56:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.777 00:56:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.777 00:56:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.777 00:56:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45177348 kB' 'MemAvailable: 48950712 kB' 'Buffers: 2708 kB' 'Cached: 10620576 kB' 'SwapCached: 0 kB' 'Active: 7354776 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953004 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501192 kB' 'Mapped: 162540 kB' 'Shmem: 6454988 kB' 'KReclaimable: 197780 kB' 'Slab: 758528 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560748 kB' 'KernelStack: 12864 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.777 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.777 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.778 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.778 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:18.779 00:56:09 -- setup/common.sh@33 -- # echo 0 00:03:18.779 00:56:09 -- setup/common.sh@33 -- # return 0 00:03:18.779 00:56:09 -- setup/hugepages.sh@100 -- # resv=0 00:03:18.779 00:56:09 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:18.779 nr_hugepages=1024 00:03:18.779 00:56:09 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:18.779 resv_hugepages=0 00:03:18.779 00:56:09 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:18.779 surplus_hugepages=0 00:03:18.779 00:56:09 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:18.779 anon_hugepages=0 00:03:18.779 00:56:09 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.779 00:56:09 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:18.779 00:56:09 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:18.779 00:56:09 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:18.779 00:56:09 -- setup/common.sh@18 -- # local node= 00:03:18.779 00:56:09 -- setup/common.sh@19 -- # local var val 00:03:18.779 00:56:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:18.779 00:56:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:18.779 00:56:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:18.779 00:56:09 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:18.779 00:56:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:18.779 00:56:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45177524 kB' 'MemAvailable: 48950888 kB' 'Buffers: 2708 kB' 'Cached: 10620604 kB' 'SwapCached: 0 kB' 'Active: 7355076 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953304 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501472 kB' 'Mapped: 162540 kB' 'Shmem: 6455016 kB' 'KReclaimable: 197780 kB' 'Slab: 758528 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560748 kB' 'KernelStack: 12848 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8025256 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.779 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.779 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # continue 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:18.780 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:18.780 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:18.780 00:56:09 -- setup/common.sh@33 -- # echo 1024 00:03:18.780 00:56:09 -- setup/common.sh@33 -- # return 0 00:03:18.780 00:56:09 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:18.780 00:56:09 -- setup/hugepages.sh@112 -- # get_nodes 00:03:18.780 00:56:09 -- setup/hugepages.sh@27 -- # local node 00:03:18.780 00:56:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.780 00:56:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.780 00:56:09 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:18.780 00:56:09 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:18.780 00:56:09 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:19.040 00:56:09 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:19.040 00:56:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.041 00:56:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.041 00:56:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:19.041 00:56:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.041 00:56:09 -- setup/common.sh@18 -- # local node=0 00:03:19.041 00:56:09 -- setup/common.sh@19 -- # local var val 00:03:19.041 00:56:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.041 00:56:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.041 00:56:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:19.041 00:56:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:19.041 00:56:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.041 00:56:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28601000 kB' 'MemUsed: 4273924 kB' 'SwapCached: 0 kB' 'Active: 1619744 kB' 'Inactive: 226888 kB' 'Active(anon): 1446520 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721172 kB' 'Mapped: 64004 kB' 'AnonPages: 128544 kB' 'Shmem: 1321060 kB' 'KernelStack: 7240 kB' 'PageTables: 3420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386788 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304508 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.041 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.041 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@33 -- # echo 0 00:03:19.042 00:56:09 -- setup/common.sh@33 -- # return 0 00:03:19.042 00:56:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.042 00:56:09 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:19.042 00:56:09 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:19.042 00:56:09 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:19.042 00:56:09 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.042 00:56:09 -- setup/common.sh@18 -- # local node=1 00:03:19.042 00:56:09 -- setup/common.sh@19 -- # local var val 00:03:19.042 00:56:09 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.042 00:56:09 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.042 00:56:09 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:19.042 00:56:09 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:19.042 00:56:09 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.042 00:56:09 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16576524 kB' 'MemUsed: 11084212 kB' 'SwapCached: 0 kB' 'Active: 5735552 kB' 'Inactive: 3539636 kB' 'Active(anon): 5507004 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8902156 kB' 'Mapped: 98536 kB' 'AnonPages: 373148 kB' 'Shmem: 5133972 kB' 'KernelStack: 5608 kB' 'PageTables: 4436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115500 kB' 'Slab: 371740 kB' 'SReclaimable: 115500 kB' 'SUnreclaim: 256240 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.042 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.042 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # continue 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.043 00:56:09 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.043 00:56:09 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.043 00:56:09 -- setup/common.sh@33 -- # echo 0 00:03:19.043 00:56:09 -- setup/common.sh@33 -- # return 0 00:03:19.043 00:56:09 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.043 00:56:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.043 00:56:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.043 00:56:09 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:19.043 node0=512 expecting 512 00:03:19.043 00:56:09 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:19.043 00:56:09 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:19.043 00:56:09 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:19.043 00:56:09 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:19.043 node1=512 expecting 512 00:03:19.043 00:56:09 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:19.043 00:03:19.043 real 0m1.461s 00:03:19.043 user 0m0.628s 00:03:19.043 sys 0m0.797s 00:03:19.043 00:56:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:19.043 00:56:09 -- common/autotest_common.sh@10 -- # set +x 00:03:19.043 ************************************ 00:03:19.043 END TEST per_node_1G_alloc 00:03:19.043 ************************************ 00:03:19.043 00:56:09 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:19.043 00:56:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:19.043 00:56:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:19.043 00:56:09 -- common/autotest_common.sh@10 -- # set +x 00:03:19.043 ************************************ 00:03:19.043 START TEST even_2G_alloc 00:03:19.043 ************************************ 00:03:19.043 00:56:09 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:19.043 00:56:09 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:19.043 00:56:09 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:19.043 00:56:09 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:19.043 00:56:09 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:19.043 00:56:09 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:19.043 00:56:09 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:19.043 00:56:09 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:19.043 00:56:09 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:19.043 00:56:09 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:19.043 00:56:09 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:19.043 00:56:09 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:19.043 00:56:09 -- setup/hugepages.sh@83 -- # : 512 00:03:19.043 00:56:09 -- setup/hugepages.sh@84 -- # : 1 00:03:19.043 00:56:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:19.043 00:56:09 -- setup/hugepages.sh@83 -- # : 0 00:03:19.043 00:56:09 -- setup/hugepages.sh@84 -- # : 0 00:03:19.043 00:56:09 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:19.043 00:56:09 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:19.043 00:56:09 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:19.043 00:56:09 -- setup/hugepages.sh@153 -- # setup output 00:03:19.043 00:56:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:19.043 00:56:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.426 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.426 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:20.426 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.426 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.426 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.426 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.426 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.426 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.426 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.426 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:20.426 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:20.426 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:20.426 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:20.426 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:20.426 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:20.426 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:20.426 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:20.426 00:56:10 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:20.426 00:56:10 -- setup/hugepages.sh@89 -- # local node 00:03:20.426 00:56:10 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.426 00:56:10 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.427 00:56:10 -- setup/hugepages.sh@92 -- # local surp 00:03:20.427 00:56:10 -- setup/hugepages.sh@93 -- # local resv 00:03:20.427 00:56:10 -- setup/hugepages.sh@94 -- # local anon 00:03:20.427 00:56:10 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.427 00:56:10 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.427 00:56:10 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.427 00:56:10 -- setup/common.sh@18 -- # local node= 00:03:20.427 00:56:10 -- setup/common.sh@19 -- # local var val 00:03:20.427 00:56:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.427 00:56:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.427 00:56:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.427 00:56:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.427 00:56:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.427 00:56:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45166260 kB' 'MemAvailable: 48939624 kB' 'Buffers: 2708 kB' 'Cached: 10620668 kB' 'SwapCached: 0 kB' 'Active: 7360692 kB' 'Inactive: 3766524 kB' 'Active(anon): 6958920 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 507036 kB' 'Mapped: 162988 kB' 'Shmem: 6455080 kB' 'KReclaimable: 197780 kB' 'Slab: 758496 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560716 kB' 'KernelStack: 12848 kB' 'PageTables: 7808 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8031736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198944 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.427 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.427 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.428 00:56:10 -- setup/common.sh@33 -- # echo 0 00:03:20.428 00:56:10 -- setup/common.sh@33 -- # return 0 00:03:20.428 00:56:10 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.428 00:56:10 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.428 00:56:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.428 00:56:10 -- setup/common.sh@18 -- # local node= 00:03:20.428 00:56:10 -- setup/common.sh@19 -- # local var val 00:03:20.428 00:56:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.428 00:56:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.428 00:56:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.428 00:56:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.428 00:56:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.428 00:56:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45169324 kB' 'MemAvailable: 48942688 kB' 'Buffers: 2708 kB' 'Cached: 10620672 kB' 'SwapCached: 0 kB' 'Active: 7356624 kB' 'Inactive: 3766524 kB' 'Active(anon): 6954852 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 503024 kB' 'Mapped: 162988 kB' 'Shmem: 6455084 kB' 'KReclaimable: 197780 kB' 'Slab: 758480 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560700 kB' 'KernelStack: 12816 kB' 'PageTables: 7704 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8027116 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.428 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.428 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.429 00:56:10 -- setup/common.sh@33 -- # echo 0 00:03:20.429 00:56:10 -- setup/common.sh@33 -- # return 0 00:03:20.429 00:56:10 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.429 00:56:10 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.429 00:56:10 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.429 00:56:10 -- setup/common.sh@18 -- # local node= 00:03:20.429 00:56:10 -- setup/common.sh@19 -- # local var val 00:03:20.429 00:56:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.429 00:56:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.429 00:56:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.429 00:56:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.429 00:56:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.429 00:56:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45168128 kB' 'MemAvailable: 48941492 kB' 'Buffers: 2708 kB' 'Cached: 10620672 kB' 'SwapCached: 0 kB' 'Active: 7359076 kB' 'Inactive: 3766524 kB' 'Active(anon): 6957304 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505468 kB' 'Mapped: 162984 kB' 'Shmem: 6455084 kB' 'KReclaimable: 197780 kB' 'Slab: 758536 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560756 kB' 'KernelStack: 12832 kB' 'PageTables: 7740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8030168 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198876 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.429 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.429 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.430 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.430 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.431 00:56:10 -- setup/common.sh@33 -- # echo 0 00:03:20.431 00:56:10 -- setup/common.sh@33 -- # return 0 00:03:20.431 00:56:10 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.431 00:56:10 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:20.431 nr_hugepages=1024 00:03:20.431 00:56:10 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.431 resv_hugepages=0 00:03:20.431 00:56:10 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.431 surplus_hugepages=0 00:03:20.431 00:56:10 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.431 anon_hugepages=0 00:03:20.431 00:56:10 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:20.431 00:56:10 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:20.431 00:56:10 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.431 00:56:10 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.431 00:56:10 -- setup/common.sh@18 -- # local node= 00:03:20.431 00:56:10 -- setup/common.sh@19 -- # local var val 00:03:20.431 00:56:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.431 00:56:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.431 00:56:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.431 00:56:10 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.431 00:56:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.431 00:56:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45167876 kB' 'MemAvailable: 48941240 kB' 'Buffers: 2708 kB' 'Cached: 10620696 kB' 'SwapCached: 0 kB' 'Active: 7361020 kB' 'Inactive: 3766524 kB' 'Active(anon): 6959248 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 507416 kB' 'Mapped: 162984 kB' 'Shmem: 6455108 kB' 'KReclaimable: 197780 kB' 'Slab: 758536 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560756 kB' 'KernelStack: 12896 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8031408 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198864 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.431 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.431 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.432 00:56:10 -- setup/common.sh@33 -- # echo 1024 00:03:20.432 00:56:10 -- setup/common.sh@33 -- # return 0 00:03:20.432 00:56:10 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:20.432 00:56:10 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.432 00:56:10 -- setup/hugepages.sh@27 -- # local node 00:03:20.432 00:56:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.432 00:56:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.432 00:56:10 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.432 00:56:10 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.432 00:56:10 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.432 00:56:10 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.432 00:56:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.432 00:56:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.432 00:56:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.432 00:56:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.432 00:56:10 -- setup/common.sh@18 -- # local node=0 00:03:20.432 00:56:10 -- setup/common.sh@19 -- # local var val 00:03:20.432 00:56:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.432 00:56:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.432 00:56:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.432 00:56:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.432 00:56:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.432 00:56:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28595812 kB' 'MemUsed: 4279112 kB' 'SwapCached: 0 kB' 'Active: 1619464 kB' 'Inactive: 226888 kB' 'Active(anon): 1446240 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721184 kB' 'Mapped: 64012 kB' 'AnonPages: 128300 kB' 'Shmem: 1321072 kB' 'KernelStack: 7240 kB' 'PageTables: 3376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386704 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304424 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.432 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.432 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.433 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.433 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.433 00:56:10 -- setup/common.sh@33 -- # echo 0 00:03:20.433 00:56:10 -- setup/common.sh@33 -- # return 0 00:03:20.434 00:56:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.434 00:56:10 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.434 00:56:10 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.434 00:56:10 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:20.434 00:56:10 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.434 00:56:10 -- setup/common.sh@18 -- # local node=1 00:03:20.434 00:56:10 -- setup/common.sh@19 -- # local var val 00:03:20.434 00:56:10 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.434 00:56:10 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.434 00:56:10 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:20.434 00:56:10 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:20.434 00:56:10 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.434 00:56:10 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16572076 kB' 'MemUsed: 11088660 kB' 'SwapCached: 0 kB' 'Active: 5736180 kB' 'Inactive: 3539636 kB' 'Active(anon): 5507632 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8902252 kB' 'Mapped: 98536 kB' 'AnonPages: 373268 kB' 'Shmem: 5134068 kB' 'KernelStack: 5528 kB' 'PageTables: 4296 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115500 kB' 'Slab: 371840 kB' 'SReclaimable: 115500 kB' 'SUnreclaim: 256340 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.434 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.434 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.435 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.435 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.435 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.435 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # continue 00:03:20.435 00:56:10 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.435 00:56:10 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.435 00:56:10 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.435 00:56:10 -- setup/common.sh@33 -- # echo 0 00:03:20.435 00:56:10 -- setup/common.sh@33 -- # return 0 00:03:20.435 00:56:10 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.435 00:56:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.435 00:56:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.435 00:56:10 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:20.435 node0=512 expecting 512 00:03:20.435 00:56:10 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.435 00:56:10 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.435 00:56:10 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.435 00:56:10 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:20.435 node1=512 expecting 512 00:03:20.435 00:56:10 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:20.435 00:03:20.435 real 0m1.484s 00:03:20.435 user 0m0.598s 00:03:20.435 sys 0m0.851s 00:03:20.435 00:56:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:20.435 00:56:10 -- common/autotest_common.sh@10 -- # set +x 00:03:20.435 ************************************ 00:03:20.435 END TEST even_2G_alloc 00:03:20.435 ************************************ 00:03:20.435 00:56:10 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:20.435 00:56:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.435 00:56:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.435 00:56:10 -- common/autotest_common.sh@10 -- # set +x 00:03:20.435 ************************************ 00:03:20.435 START TEST odd_alloc 00:03:20.435 ************************************ 00:03:20.435 00:56:10 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:20.435 00:56:10 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:20.435 00:56:10 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:20.435 00:56:10 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:20.435 00:56:10 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:20.435 00:56:10 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:20.435 00:56:10 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.435 00:56:10 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:20.435 00:56:10 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.435 00:56:10 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.435 00:56:10 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.435 00:56:10 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:20.435 00:56:10 -- setup/hugepages.sh@83 -- # : 513 00:03:20.435 00:56:10 -- setup/hugepages.sh@84 -- # : 1 00:03:20.435 00:56:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:20.435 00:56:10 -- setup/hugepages.sh@83 -- # : 0 00:03:20.435 00:56:10 -- setup/hugepages.sh@84 -- # : 0 00:03:20.435 00:56:10 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.435 00:56:10 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:20.435 00:56:10 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:20.435 00:56:10 -- setup/hugepages.sh@160 -- # setup output 00:03:20.435 00:56:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.435 00:56:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:21.817 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:21.817 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.817 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.817 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.817 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.817 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.817 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.817 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.817 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.817 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:21.817 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:21.817 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:21.817 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:21.817 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:21.817 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:21.817 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:21.817 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:21.817 00:56:12 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:21.817 00:56:12 -- setup/hugepages.sh@89 -- # local node 00:03:21.817 00:56:12 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:21.817 00:56:12 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:21.817 00:56:12 -- setup/hugepages.sh@92 -- # local surp 00:03:21.817 00:56:12 -- setup/hugepages.sh@93 -- # local resv 00:03:21.817 00:56:12 -- setup/hugepages.sh@94 -- # local anon 00:03:21.817 00:56:12 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:21.817 00:56:12 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:21.817 00:56:12 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:21.817 00:56:12 -- setup/common.sh@18 -- # local node= 00:03:21.817 00:56:12 -- setup/common.sh@19 -- # local var val 00:03:21.817 00:56:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.817 00:56:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.817 00:56:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.817 00:56:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.817 00:56:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.817 00:56:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45263816 kB' 'MemAvailable: 49037180 kB' 'Buffers: 2708 kB' 'Cached: 10620764 kB' 'SwapCached: 0 kB' 'Active: 7354236 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952464 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500560 kB' 'Mapped: 161540 kB' 'Shmem: 6455176 kB' 'KReclaimable: 197780 kB' 'Slab: 758696 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560916 kB' 'KernelStack: 13264 kB' 'PageTables: 8604 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8013872 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199052 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.817 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.817 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.818 00:56:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:21.818 00:56:12 -- setup/common.sh@33 -- # echo 0 00:03:21.818 00:56:12 -- setup/common.sh@33 -- # return 0 00:03:21.818 00:56:12 -- setup/hugepages.sh@97 -- # anon=0 00:03:21.818 00:56:12 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:21.818 00:56:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.818 00:56:12 -- setup/common.sh@18 -- # local node= 00:03:21.818 00:56:12 -- setup/common.sh@19 -- # local var val 00:03:21.818 00:56:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.818 00:56:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.818 00:56:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.818 00:56:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.818 00:56:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.818 00:56:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.818 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45263196 kB' 'MemAvailable: 49036560 kB' 'Buffers: 2708 kB' 'Cached: 10620768 kB' 'SwapCached: 0 kB' 'Active: 7354460 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952688 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500740 kB' 'Mapped: 161624 kB' 'Shmem: 6455180 kB' 'KReclaimable: 197780 kB' 'Slab: 758748 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560968 kB' 'KernelStack: 13120 kB' 'PageTables: 8468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8013884 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 199164 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.819 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.819 00:56:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.820 00:56:12 -- setup/common.sh@33 -- # echo 0 00:03:21.820 00:56:12 -- setup/common.sh@33 -- # return 0 00:03:21.820 00:56:12 -- setup/hugepages.sh@99 -- # surp=0 00:03:21.820 00:56:12 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:21.820 00:56:12 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:21.820 00:56:12 -- setup/common.sh@18 -- # local node= 00:03:21.820 00:56:12 -- setup/common.sh@19 -- # local var val 00:03:21.820 00:56:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.820 00:56:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.820 00:56:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.820 00:56:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.820 00:56:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.820 00:56:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45264568 kB' 'MemAvailable: 49037932 kB' 'Buffers: 2708 kB' 'Cached: 10620780 kB' 'SwapCached: 0 kB' 'Active: 7353668 kB' 'Inactive: 3766524 kB' 'Active(anon): 6951896 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499920 kB' 'Mapped: 161516 kB' 'Shmem: 6455192 kB' 'KReclaimable: 197780 kB' 'Slab: 758864 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 561084 kB' 'KernelStack: 12768 kB' 'PageTables: 7624 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8011252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.820 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.820 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:21.821 00:56:12 -- setup/common.sh@33 -- # echo 0 00:03:21.821 00:56:12 -- setup/common.sh@33 -- # return 0 00:03:21.821 00:56:12 -- setup/hugepages.sh@100 -- # resv=0 00:03:21.821 00:56:12 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:21.821 nr_hugepages=1025 00:03:21.821 00:56:12 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:21.821 resv_hugepages=0 00:03:21.821 00:56:12 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:21.821 surplus_hugepages=0 00:03:21.821 00:56:12 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:21.821 anon_hugepages=0 00:03:21.821 00:56:12 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:21.821 00:56:12 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:21.821 00:56:12 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:21.821 00:56:12 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:21.821 00:56:12 -- setup/common.sh@18 -- # local node= 00:03:21.821 00:56:12 -- setup/common.sh@19 -- # local var val 00:03:21.821 00:56:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.821 00:56:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.821 00:56:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.821 00:56:12 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.821 00:56:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.821 00:56:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45264808 kB' 'MemAvailable: 49038172 kB' 'Buffers: 2708 kB' 'Cached: 10620792 kB' 'SwapCached: 0 kB' 'Active: 7353180 kB' 'Inactive: 3766524 kB' 'Active(anon): 6951408 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499448 kB' 'Mapped: 161516 kB' 'Shmem: 6455204 kB' 'KReclaimable: 197780 kB' 'Slab: 758860 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 561080 kB' 'KernelStack: 12816 kB' 'PageTables: 7536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606832 kB' 'Committed_AS: 8011264 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198860 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.821 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.821 00:56:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.822 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.822 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:21.823 00:56:12 -- setup/common.sh@33 -- # echo 1025 00:03:21.823 00:56:12 -- setup/common.sh@33 -- # return 0 00:03:21.823 00:56:12 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:21.823 00:56:12 -- setup/hugepages.sh@112 -- # get_nodes 00:03:21.823 00:56:12 -- setup/hugepages.sh@27 -- # local node 00:03:21.823 00:56:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.823 00:56:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:21.823 00:56:12 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.823 00:56:12 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:21.823 00:56:12 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.823 00:56:12 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.823 00:56:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:21.823 00:56:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:21.823 00:56:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:21.823 00:56:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:21.823 00:56:12 -- setup/common.sh@18 -- # local node=0 00:03:21.823 00:56:12 -- setup/common.sh@19 -- # local var val 00:03:21.823 00:56:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.823 00:56:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.823 00:56:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:21.823 00:56:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:21.823 00:56:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.823 00:56:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28699084 kB' 'MemUsed: 4175840 kB' 'SwapCached: 0 kB' 'Active: 1618084 kB' 'Inactive: 226888 kB' 'Active(anon): 1444860 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721192 kB' 'Mapped: 63276 kB' 'AnonPages: 126952 kB' 'Shmem: 1321080 kB' 'KernelStack: 7240 kB' 'PageTables: 3164 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386856 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304576 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.823 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.823 00:56:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.824 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:21.824 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.083 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.083 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.083 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.083 00:56:12 -- setup/common.sh@33 -- # echo 0 00:03:22.083 00:56:12 -- setup/common.sh@33 -- # return 0 00:03:22.083 00:56:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.083 00:56:12 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:22.083 00:56:12 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:22.083 00:56:12 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:22.083 00:56:12 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:22.083 00:56:12 -- setup/common.sh@18 -- # local node=1 00:03:22.083 00:56:12 -- setup/common.sh@19 -- # local var val 00:03:22.083 00:56:12 -- setup/common.sh@20 -- # local mem_f mem 00:03:22.083 00:56:12 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:22.083 00:56:12 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:22.083 00:56:12 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:22.083 00:56:12 -- setup/common.sh@28 -- # mapfile -t mem 00:03:22.083 00:56:12 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:22.083 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.083 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 16565976 kB' 'MemUsed: 11094760 kB' 'SwapCached: 0 kB' 'Active: 5734948 kB' 'Inactive: 3539636 kB' 'Active(anon): 5506400 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8902336 kB' 'Mapped: 98240 kB' 'AnonPages: 372284 kB' 'Shmem: 5134152 kB' 'KernelStack: 5576 kB' 'PageTables: 4368 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115500 kB' 'Slab: 372004 kB' 'SReclaimable: 115500 kB' 'SUnreclaim: 256504 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # continue 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # IFS=': ' 00:03:22.084 00:56:12 -- setup/common.sh@31 -- # read -r var val _ 00:03:22.084 00:56:12 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:22.084 00:56:12 -- setup/common.sh@33 -- # echo 0 00:03:22.084 00:56:12 -- setup/common.sh@33 -- # return 0 00:03:22.084 00:56:12 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:22.084 00:56:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.084 00:56:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.084 00:56:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.084 00:56:12 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:22.084 node0=512 expecting 513 00:03:22.084 00:56:12 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:22.084 00:56:12 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:22.084 00:56:12 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:22.084 00:56:12 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:22.084 node1=513 expecting 512 00:03:22.084 00:56:12 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:22.084 00:03:22.084 real 0m1.489s 00:03:22.084 user 0m0.582s 00:03:22.084 sys 0m0.872s 00:03:22.084 00:56:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:22.084 00:56:12 -- common/autotest_common.sh@10 -- # set +x 00:03:22.085 ************************************ 00:03:22.085 END TEST odd_alloc 00:03:22.085 ************************************ 00:03:22.085 00:56:12 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:22.085 00:56:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:22.085 00:56:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:22.085 00:56:12 -- common/autotest_common.sh@10 -- # set +x 00:03:22.085 ************************************ 00:03:22.085 START TEST custom_alloc 00:03:22.085 ************************************ 00:03:22.085 00:56:12 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:22.085 00:56:12 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:22.085 00:56:12 -- setup/hugepages.sh@169 -- # local node 00:03:22.085 00:56:12 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:22.085 00:56:12 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:22.085 00:56:12 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:22.085 00:56:12 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:22.085 00:56:12 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:22.085 00:56:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:22.085 00:56:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.085 00:56:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:22.085 00:56:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.085 00:56:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.085 00:56:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:22.085 00:56:12 -- setup/hugepages.sh@83 -- # : 256 00:03:22.085 00:56:12 -- setup/hugepages.sh@84 -- # : 1 00:03:22.085 00:56:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:22.085 00:56:12 -- setup/hugepages.sh@83 -- # : 0 00:03:22.085 00:56:12 -- setup/hugepages.sh@84 -- # : 0 00:03:22.085 00:56:12 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:22.085 00:56:12 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:22.085 00:56:12 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:22.085 00:56:12 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:22.085 00:56:12 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:22.085 00:56:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.085 00:56:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:22.085 00:56:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.085 00:56:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.085 00:56:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:22.085 00:56:12 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:22.085 00:56:12 -- setup/hugepages.sh@78 -- # return 0 00:03:22.085 00:56:12 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:22.085 00:56:12 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:22.085 00:56:12 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:22.085 00:56:12 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:22.085 00:56:12 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:22.085 00:56:12 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:22.085 00:56:12 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:22.085 00:56:12 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:22.085 00:56:12 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:22.085 00:56:12 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:22.085 00:56:12 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:22.085 00:56:12 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:22.085 00:56:12 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:22.085 00:56:12 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:22.085 00:56:12 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:22.085 00:56:12 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:22.085 00:56:12 -- setup/hugepages.sh@78 -- # return 0 00:03:22.085 00:56:12 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:22.085 00:56:12 -- setup/hugepages.sh@187 -- # setup output 00:03:22.085 00:56:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:22.085 00:56:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.020 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.020 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.020 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.020 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.020 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.020 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.020 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.020 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.020 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.020 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:23.020 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:23.020 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:23.020 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:23.020 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:23.020 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:23.020 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:23.020 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:23.282 00:56:13 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:23.282 00:56:13 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:23.282 00:56:13 -- setup/hugepages.sh@89 -- # local node 00:03:23.282 00:56:13 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.282 00:56:13 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.282 00:56:13 -- setup/hugepages.sh@92 -- # local surp 00:03:23.282 00:56:13 -- setup/hugepages.sh@93 -- # local resv 00:03:23.282 00:56:13 -- setup/hugepages.sh@94 -- # local anon 00:03:23.282 00:56:13 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.282 00:56:13 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.282 00:56:13 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.282 00:56:13 -- setup/common.sh@18 -- # local node= 00:03:23.282 00:56:13 -- setup/common.sh@19 -- # local var val 00:03:23.282 00:56:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.282 00:56:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.282 00:56:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.282 00:56:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.282 00:56:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.282 00:56:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.282 00:56:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44235148 kB' 'MemAvailable: 48008512 kB' 'Buffers: 2708 kB' 'Cached: 10620860 kB' 'SwapCached: 0 kB' 'Active: 7353500 kB' 'Inactive: 3766524 kB' 'Active(anon): 6951728 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499604 kB' 'Mapped: 161540 kB' 'Shmem: 6455272 kB' 'KReclaimable: 197780 kB' 'Slab: 758464 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560684 kB' 'KernelStack: 12800 kB' 'PageTables: 7488 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8011320 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198940 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.282 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.282 00:56:13 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.283 00:56:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.283 00:56:13 -- setup/common.sh@33 -- # echo 0 00:03:23.283 00:56:13 -- setup/common.sh@33 -- # return 0 00:03:23.283 00:56:13 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.283 00:56:13 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.283 00:56:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.283 00:56:13 -- setup/common.sh@18 -- # local node= 00:03:23.283 00:56:13 -- setup/common.sh@19 -- # local var val 00:03:23.283 00:56:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.283 00:56:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.283 00:56:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.283 00:56:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.283 00:56:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.283 00:56:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.283 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44239224 kB' 'MemAvailable: 48012588 kB' 'Buffers: 2708 kB' 'Cached: 10620864 kB' 'SwapCached: 0 kB' 'Active: 7353560 kB' 'Inactive: 3766524 kB' 'Active(anon): 6951788 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499700 kB' 'Mapped: 161540 kB' 'Shmem: 6455276 kB' 'KReclaimable: 197780 kB' 'Slab: 758456 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560676 kB' 'KernelStack: 12784 kB' 'PageTables: 7444 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8011332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.284 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.284 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.285 00:56:13 -- setup/common.sh@33 -- # echo 0 00:03:23.285 00:56:13 -- setup/common.sh@33 -- # return 0 00:03:23.285 00:56:13 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.285 00:56:13 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.285 00:56:13 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.285 00:56:13 -- setup/common.sh@18 -- # local node= 00:03:23.285 00:56:13 -- setup/common.sh@19 -- # local var val 00:03:23.285 00:56:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.285 00:56:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.285 00:56:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.285 00:56:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.285 00:56:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.285 00:56:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44239260 kB' 'MemAvailable: 48012624 kB' 'Buffers: 2708 kB' 'Cached: 10620876 kB' 'SwapCached: 0 kB' 'Active: 7353376 kB' 'Inactive: 3766524 kB' 'Active(anon): 6951604 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499508 kB' 'Mapped: 161528 kB' 'Shmem: 6455288 kB' 'KReclaimable: 197780 kB' 'Slab: 758508 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560728 kB' 'KernelStack: 12816 kB' 'PageTables: 7528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8011348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.285 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.285 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.286 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.286 00:56:13 -- setup/common.sh@33 -- # echo 0 00:03:23.286 00:56:13 -- setup/common.sh@33 -- # return 0 00:03:23.286 00:56:13 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.286 00:56:13 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:23.286 nr_hugepages=1536 00:03:23.286 00:56:13 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.286 resv_hugepages=0 00:03:23.286 00:56:13 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.286 surplus_hugepages=0 00:03:23.286 00:56:13 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.286 anon_hugepages=0 00:03:23.286 00:56:13 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:23.286 00:56:13 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:23.286 00:56:13 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.286 00:56:13 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.286 00:56:13 -- setup/common.sh@18 -- # local node= 00:03:23.286 00:56:13 -- setup/common.sh@19 -- # local var val 00:03:23.286 00:56:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.286 00:56:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.286 00:56:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.286 00:56:13 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.286 00:56:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.286 00:56:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.286 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 44238504 kB' 'MemAvailable: 48011868 kB' 'Buffers: 2708 kB' 'Cached: 10620888 kB' 'SwapCached: 0 kB' 'Active: 7353328 kB' 'Inactive: 3766524 kB' 'Active(anon): 6951556 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499464 kB' 'Mapped: 161528 kB' 'Shmem: 6455300 kB' 'KReclaimable: 197780 kB' 'Slab: 758508 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560728 kB' 'KernelStack: 12800 kB' 'PageTables: 7484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083568 kB' 'Committed_AS: 8011360 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.287 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.287 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.288 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.288 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.288 00:56:13 -- setup/common.sh@33 -- # echo 1536 00:03:23.288 00:56:13 -- setup/common.sh@33 -- # return 0 00:03:23.288 00:56:13 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:23.548 00:56:13 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.548 00:56:13 -- setup/hugepages.sh@27 -- # local node 00:03:23.548 00:56:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.548 00:56:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.548 00:56:13 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.548 00:56:13 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.548 00:56:13 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.548 00:56:13 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.548 00:56:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.548 00:56:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.548 00:56:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.548 00:56:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.548 00:56:13 -- setup/common.sh@18 -- # local node=0 00:03:23.548 00:56:13 -- setup/common.sh@19 -- # local var val 00:03:23.548 00:56:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.548 00:56:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.548 00:56:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.548 00:56:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.548 00:56:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.548 00:56:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 28707432 kB' 'MemUsed: 4167492 kB' 'SwapCached: 0 kB' 'Active: 1618004 kB' 'Inactive: 226888 kB' 'Active(anon): 1444780 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721204 kB' 'Mapped: 63288 kB' 'AnonPages: 126788 kB' 'Shmem: 1321092 kB' 'KernelStack: 7224 kB' 'PageTables: 3104 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386676 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304396 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.548 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.548 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@33 -- # echo 0 00:03:23.549 00:56:13 -- setup/common.sh@33 -- # return 0 00:03:23.549 00:56:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.549 00:56:13 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.549 00:56:13 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.549 00:56:13 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:23.549 00:56:13 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.549 00:56:13 -- setup/common.sh@18 -- # local node=1 00:03:23.549 00:56:13 -- setup/common.sh@19 -- # local var val 00:03:23.549 00:56:13 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.549 00:56:13 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.549 00:56:13 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:23.549 00:56:13 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:23.549 00:56:13 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.549 00:56:13 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660736 kB' 'MemFree: 15530344 kB' 'MemUsed: 12130392 kB' 'SwapCached: 0 kB' 'Active: 5735752 kB' 'Inactive: 3539636 kB' 'Active(anon): 5507204 kB' 'Inactive(anon): 0 kB' 'Active(file): 228548 kB' 'Inactive(file): 3539636 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8902420 kB' 'Mapped: 98240 kB' 'AnonPages: 373068 kB' 'Shmem: 5134236 kB' 'KernelStack: 5624 kB' 'PageTables: 4512 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115500 kB' 'Slab: 371832 kB' 'SReclaimable: 115500 kB' 'SUnreclaim: 256332 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.549 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.549 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # continue 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.550 00:56:13 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.550 00:56:13 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.550 00:56:13 -- setup/common.sh@33 -- # echo 0 00:03:23.550 00:56:13 -- setup/common.sh@33 -- # return 0 00:03:23.550 00:56:13 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.550 00:56:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.550 00:56:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.550 00:56:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.550 00:56:13 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:23.550 node0=512 expecting 512 00:03:23.550 00:56:13 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.550 00:56:13 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.550 00:56:13 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.550 00:56:13 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:23.550 node1=1024 expecting 1024 00:03:23.550 00:56:13 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:23.550 00:03:23.550 real 0m1.460s 00:03:23.550 user 0m0.551s 00:03:23.550 sys 0m0.872s 00:03:23.550 00:56:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.550 00:56:13 -- common/autotest_common.sh@10 -- # set +x 00:03:23.550 ************************************ 00:03:23.550 END TEST custom_alloc 00:03:23.550 ************************************ 00:03:23.550 00:56:13 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:23.550 00:56:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.550 00:56:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.550 00:56:13 -- common/autotest_common.sh@10 -- # set +x 00:03:23.550 ************************************ 00:03:23.550 START TEST no_shrink_alloc 00:03:23.550 ************************************ 00:03:23.550 00:56:13 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:23.550 00:56:13 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:23.550 00:56:13 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:23.550 00:56:13 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:23.550 00:56:13 -- setup/hugepages.sh@51 -- # shift 00:03:23.550 00:56:13 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:23.550 00:56:13 -- setup/hugepages.sh@52 -- # local node_ids 00:03:23.550 00:56:13 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.550 00:56:13 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:23.550 00:56:13 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:23.550 00:56:13 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:23.550 00:56:13 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.550 00:56:13 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:23.550 00:56:13 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.550 00:56:13 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.550 00:56:13 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.550 00:56:13 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:23.550 00:56:13 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.550 00:56:13 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:23.550 00:56:13 -- setup/hugepages.sh@73 -- # return 0 00:03:23.550 00:56:13 -- setup/hugepages.sh@198 -- # setup output 00:03:23.550 00:56:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.551 00:56:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:24.934 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.934 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:24.934 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.934 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.934 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.934 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.934 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.934 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.934 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.934 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:24.934 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:24.934 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:24.934 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:24.934 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:24.934 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:24.934 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:24.934 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:24.934 00:56:15 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:24.934 00:56:15 -- setup/hugepages.sh@89 -- # local node 00:03:24.934 00:56:15 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:24.934 00:56:15 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:24.934 00:56:15 -- setup/hugepages.sh@92 -- # local surp 00:03:24.934 00:56:15 -- setup/hugepages.sh@93 -- # local resv 00:03:24.934 00:56:15 -- setup/hugepages.sh@94 -- # local anon 00:03:24.934 00:56:15 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:24.934 00:56:15 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:24.934 00:56:15 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:24.934 00:56:15 -- setup/common.sh@18 -- # local node= 00:03:24.934 00:56:15 -- setup/common.sh@19 -- # local var val 00:03:24.934 00:56:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.934 00:56:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.934 00:56:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.934 00:56:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.934 00:56:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.934 00:56:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45269756 kB' 'MemAvailable: 49043120 kB' 'Buffers: 2708 kB' 'Cached: 10620956 kB' 'SwapCached: 0 kB' 'Active: 7359452 kB' 'Inactive: 3766524 kB' 'Active(anon): 6957680 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505528 kB' 'Mapped: 162364 kB' 'Shmem: 6455368 kB' 'KReclaimable: 197780 kB' 'Slab: 758044 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560264 kB' 'KernelStack: 12816 kB' 'PageTables: 7548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8017664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198864 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.934 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.934 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:24.935 00:56:15 -- setup/common.sh@33 -- # echo 0 00:03:24.935 00:56:15 -- setup/common.sh@33 -- # return 0 00:03:24.935 00:56:15 -- setup/hugepages.sh@97 -- # anon=0 00:03:24.935 00:56:15 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:24.935 00:56:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.935 00:56:15 -- setup/common.sh@18 -- # local node= 00:03:24.935 00:56:15 -- setup/common.sh@19 -- # local var val 00:03:24.935 00:56:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.935 00:56:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.935 00:56:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.935 00:56:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.935 00:56:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.935 00:56:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45278844 kB' 'MemAvailable: 49052208 kB' 'Buffers: 2708 kB' 'Cached: 10620956 kB' 'SwapCached: 0 kB' 'Active: 7355084 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953312 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501196 kB' 'Mapped: 162364 kB' 'Shmem: 6455368 kB' 'KReclaimable: 197780 kB' 'Slab: 758052 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560272 kB' 'KernelStack: 12816 kB' 'PageTables: 7540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8012912 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198828 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.935 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.935 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.936 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.936 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.937 00:56:15 -- setup/common.sh@33 -- # echo 0 00:03:24.937 00:56:15 -- setup/common.sh@33 -- # return 0 00:03:24.937 00:56:15 -- setup/hugepages.sh@99 -- # surp=0 00:03:24.937 00:56:15 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:24.937 00:56:15 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:24.937 00:56:15 -- setup/common.sh@18 -- # local node= 00:03:24.937 00:56:15 -- setup/common.sh@19 -- # local var val 00:03:24.937 00:56:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.937 00:56:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.937 00:56:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.937 00:56:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.937 00:56:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.937 00:56:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45275028 kB' 'MemAvailable: 49048392 kB' 'Buffers: 2708 kB' 'Cached: 10620972 kB' 'SwapCached: 0 kB' 'Active: 7358084 kB' 'Inactive: 3766524 kB' 'Active(anon): 6956312 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 504204 kB' 'Mapped: 161916 kB' 'Shmem: 6455384 kB' 'KReclaimable: 197780 kB' 'Slab: 758012 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560232 kB' 'KernelStack: 12848 kB' 'PageTables: 7616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8016492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198812 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.937 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.937 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:24.938 00:56:15 -- setup/common.sh@33 -- # echo 0 00:03:24.938 00:56:15 -- setup/common.sh@33 -- # return 0 00:03:24.938 00:56:15 -- setup/hugepages.sh@100 -- # resv=0 00:03:24.938 00:56:15 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:24.938 nr_hugepages=1024 00:03:24.938 00:56:15 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:24.938 resv_hugepages=0 00:03:24.938 00:56:15 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:24.938 surplus_hugepages=0 00:03:24.938 00:56:15 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:24.938 anon_hugepages=0 00:03:24.938 00:56:15 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.938 00:56:15 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:24.938 00:56:15 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:24.938 00:56:15 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:24.938 00:56:15 -- setup/common.sh@18 -- # local node= 00:03:24.938 00:56:15 -- setup/common.sh@19 -- # local var val 00:03:24.938 00:56:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.938 00:56:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.938 00:56:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:24.938 00:56:15 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:24.938 00:56:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.938 00:56:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45271124 kB' 'MemAvailable: 49044488 kB' 'Buffers: 2708 kB' 'Cached: 10620984 kB' 'SwapCached: 0 kB' 'Active: 7359252 kB' 'Inactive: 3766524 kB' 'Active(anon): 6957480 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 505356 kB' 'Mapped: 162384 kB' 'Shmem: 6455396 kB' 'KReclaimable: 197780 kB' 'Slab: 758084 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560304 kB' 'KernelStack: 12832 kB' 'PageTables: 7592 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8017708 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198816 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.938 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.938 00:56:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.939 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.939 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:24.940 00:56:15 -- setup/common.sh@33 -- # echo 1024 00:03:24.940 00:56:15 -- setup/common.sh@33 -- # return 0 00:03:24.940 00:56:15 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:24.940 00:56:15 -- setup/hugepages.sh@112 -- # get_nodes 00:03:24.940 00:56:15 -- setup/hugepages.sh@27 -- # local node 00:03:24.940 00:56:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.940 00:56:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:24.940 00:56:15 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:24.940 00:56:15 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:24.940 00:56:15 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:24.940 00:56:15 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:24.940 00:56:15 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:24.940 00:56:15 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:24.940 00:56:15 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:24.940 00:56:15 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:24.940 00:56:15 -- setup/common.sh@18 -- # local node=0 00:03:24.940 00:56:15 -- setup/common.sh@19 -- # local var val 00:03:24.940 00:56:15 -- setup/common.sh@20 -- # local mem_f mem 00:03:24.940 00:56:15 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:24.940 00:56:15 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:24.940 00:56:15 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:24.940 00:56:15 -- setup/common.sh@28 -- # mapfile -t mem 00:03:24.940 00:56:15 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27670384 kB' 'MemUsed: 5204540 kB' 'SwapCached: 0 kB' 'Active: 1618192 kB' 'Inactive: 226888 kB' 'Active(anon): 1444968 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721248 kB' 'Mapped: 63444 kB' 'AnonPages: 127076 kB' 'Shmem: 1321136 kB' 'KernelStack: 7224 kB' 'PageTables: 3108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386584 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304304 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.940 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.940 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # continue 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # IFS=': ' 00:03:24.941 00:56:15 -- setup/common.sh@31 -- # read -r var val _ 00:03:24.941 00:56:15 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:24.941 00:56:15 -- setup/common.sh@33 -- # echo 0 00:03:24.941 00:56:15 -- setup/common.sh@33 -- # return 0 00:03:24.941 00:56:15 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:24.941 00:56:15 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:24.941 00:56:15 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:24.941 00:56:15 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:24.941 00:56:15 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:24.941 node0=1024 expecting 1024 00:03:24.941 00:56:15 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:24.941 00:56:15 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:24.941 00:56:15 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:24.941 00:56:15 -- setup/hugepages.sh@202 -- # setup output 00:03:24.941 00:56:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:24.941 00:56:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.319 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.319 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.319 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.319 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.319 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.319 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.319 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.319 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.319 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.319 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.319 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.319 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.319 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.319 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.319 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.319 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.319 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.319 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:26.319 00:56:16 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:26.319 00:56:16 -- setup/hugepages.sh@89 -- # local node 00:03:26.319 00:56:16 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.319 00:56:16 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.319 00:56:16 -- setup/hugepages.sh@92 -- # local surp 00:03:26.319 00:56:16 -- setup/hugepages.sh@93 -- # local resv 00:03:26.319 00:56:16 -- setup/hugepages.sh@94 -- # local anon 00:03:26.319 00:56:16 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.319 00:56:16 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.319 00:56:16 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.319 00:56:16 -- setup/common.sh@18 -- # local node= 00:03:26.319 00:56:16 -- setup/common.sh@19 -- # local var val 00:03:26.319 00:56:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.319 00:56:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.319 00:56:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.319 00:56:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.319 00:56:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.319 00:56:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.319 00:56:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45252372 kB' 'MemAvailable: 49025736 kB' 'Buffers: 2708 kB' 'Cached: 10621032 kB' 'SwapCached: 0 kB' 'Active: 7355856 kB' 'Inactive: 3766524 kB' 'Active(anon): 6954084 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501848 kB' 'Mapped: 161540 kB' 'Shmem: 6455444 kB' 'KReclaimable: 197780 kB' 'Slab: 757956 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560176 kB' 'KernelStack: 13232 kB' 'PageTables: 9484 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8011752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198972 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.319 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.319 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.320 00:56:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.320 00:56:16 -- setup/common.sh@33 -- # echo 0 00:03:26.320 00:56:16 -- setup/common.sh@33 -- # return 0 00:03:26.320 00:56:16 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.320 00:56:16 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.320 00:56:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.320 00:56:16 -- setup/common.sh@18 -- # local node= 00:03:26.320 00:56:16 -- setup/common.sh@19 -- # local var val 00:03:26.320 00:56:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.320 00:56:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.320 00:56:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.320 00:56:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.320 00:56:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.320 00:56:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.320 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45260024 kB' 'MemAvailable: 49033388 kB' 'Buffers: 2708 kB' 'Cached: 10621032 kB' 'SwapCached: 0 kB' 'Active: 7355480 kB' 'Inactive: 3766524 kB' 'Active(anon): 6953708 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 501904 kB' 'Mapped: 161616 kB' 'Shmem: 6455444 kB' 'KReclaimable: 197780 kB' 'Slab: 758036 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560256 kB' 'KernelStack: 12864 kB' 'PageTables: 8440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8011764 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.321 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.321 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.322 00:56:16 -- setup/common.sh@33 -- # echo 0 00:03:26.322 00:56:16 -- setup/common.sh@33 -- # return 0 00:03:26.322 00:56:16 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.322 00:56:16 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.322 00:56:16 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.322 00:56:16 -- setup/common.sh@18 -- # local node= 00:03:26.322 00:56:16 -- setup/common.sh@19 -- # local var val 00:03:26.322 00:56:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.322 00:56:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.322 00:56:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.322 00:56:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.322 00:56:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.322 00:56:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45259824 kB' 'MemAvailable: 49033188 kB' 'Buffers: 2708 kB' 'Cached: 10621048 kB' 'SwapCached: 0 kB' 'Active: 7353988 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952216 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 499880 kB' 'Mapped: 161564 kB' 'Shmem: 6455460 kB' 'KReclaimable: 197780 kB' 'Slab: 758144 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560364 kB' 'KernelStack: 12768 kB' 'PageTables: 7660 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8011780 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198892 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.322 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.322 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.323 00:56:16 -- setup/common.sh@33 -- # echo 0 00:03:26.323 00:56:16 -- setup/common.sh@33 -- # return 0 00:03:26.323 00:56:16 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.323 00:56:16 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:26.323 nr_hugepages=1024 00:03:26.323 00:56:16 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.323 resv_hugepages=0 00:03:26.323 00:56:16 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.323 surplus_hugepages=0 00:03:26.323 00:56:16 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.323 anon_hugepages=0 00:03:26.323 00:56:16 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.323 00:56:16 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:26.323 00:56:16 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.323 00:56:16 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.323 00:56:16 -- setup/common.sh@18 -- # local node= 00:03:26.323 00:56:16 -- setup/common.sh@19 -- # local var val 00:03:26.323 00:56:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.323 00:56:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.323 00:56:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.323 00:56:16 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.323 00:56:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.323 00:56:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.323 00:56:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535660 kB' 'MemFree: 45260148 kB' 'MemAvailable: 49033512 kB' 'Buffers: 2708 kB' 'Cached: 10621060 kB' 'SwapCached: 0 kB' 'Active: 7354084 kB' 'Inactive: 3766524 kB' 'Active(anon): 6952312 kB' 'Inactive(anon): 0 kB' 'Active(file): 401772 kB' 'Inactive(file): 3766524 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 500020 kB' 'Mapped: 161488 kB' 'Shmem: 6455472 kB' 'KReclaimable: 197780 kB' 'Slab: 758112 kB' 'SReclaimable: 197780 kB' 'SUnreclaim: 560332 kB' 'KernelStack: 12816 kB' 'PageTables: 7852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607856 kB' 'Committed_AS: 8011796 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198908 kB' 'VmallocChunk: 0 kB' 'Percpu: 35904 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2582108 kB' 'DirectMap2M: 18309120 kB' 'DirectMap1G: 49283072 kB' 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.323 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.323 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.324 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.324 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.584 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.584 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.585 00:56:16 -- setup/common.sh@33 -- # echo 1024 00:03:26.585 00:56:16 -- setup/common.sh@33 -- # return 0 00:03:26.585 00:56:16 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.585 00:56:16 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.585 00:56:16 -- setup/hugepages.sh@27 -- # local node 00:03:26.585 00:56:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.585 00:56:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:26.585 00:56:16 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.585 00:56:16 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:26.585 00:56:16 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.585 00:56:16 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.585 00:56:16 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.585 00:56:16 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.585 00:56:16 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.585 00:56:16 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.585 00:56:16 -- setup/common.sh@18 -- # local node=0 00:03:26.585 00:56:16 -- setup/common.sh@19 -- # local var val 00:03:26.585 00:56:16 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.585 00:56:16 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.585 00:56:16 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.585 00:56:16 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.585 00:56:16 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.585 00:56:16 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 27671416 kB' 'MemUsed: 5203508 kB' 'SwapCached: 0 kB' 'Active: 1618184 kB' 'Inactive: 226888 kB' 'Active(anon): 1444960 kB' 'Inactive(anon): 0 kB' 'Active(file): 173224 kB' 'Inactive(file): 226888 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1721336 kB' 'Mapped: 63300 kB' 'AnonPages: 126944 kB' 'Shmem: 1321224 kB' 'KernelStack: 7224 kB' 'PageTables: 3064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 82280 kB' 'Slab: 386708 kB' 'SReclaimable: 82280 kB' 'SUnreclaim: 304428 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.585 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.585 00:56:16 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # continue 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.586 00:56:16 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.586 00:56:16 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.586 00:56:16 -- setup/common.sh@33 -- # echo 0 00:03:26.586 00:56:16 -- setup/common.sh@33 -- # return 0 00:03:26.586 00:56:16 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.586 00:56:16 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.586 00:56:16 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.586 00:56:16 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.586 00:56:16 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:26.586 node0=1024 expecting 1024 00:03:26.586 00:56:16 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:26.586 00:03:26.586 real 0m3.007s 00:03:26.586 user 0m1.196s 00:03:26.586 sys 0m1.746s 00:03:26.586 00:56:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.586 00:56:16 -- common/autotest_common.sh@10 -- # set +x 00:03:26.586 ************************************ 00:03:26.586 END TEST no_shrink_alloc 00:03:26.586 ************************************ 00:03:26.586 00:56:16 -- setup/hugepages.sh@217 -- # clear_hp 00:03:26.586 00:56:16 -- setup/hugepages.sh@37 -- # local node hp 00:03:26.586 00:56:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:26.586 00:56:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.586 00:56:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.586 00:56:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.586 00:56:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.586 00:56:16 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:26.586 00:56:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.586 00:56:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.586 00:56:16 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.586 00:56:16 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.586 00:56:16 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:26.586 00:56:16 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:26.586 00:03:26.586 real 0m11.752s 00:03:26.586 user 0m4.395s 00:03:26.586 sys 0m6.293s 00:03:26.586 00:56:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.586 00:56:16 -- common/autotest_common.sh@10 -- # set +x 00:03:26.586 ************************************ 00:03:26.586 END TEST hugepages 00:03:26.586 ************************************ 00:03:26.586 00:56:16 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:26.586 00:56:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.586 00:56:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.586 00:56:16 -- common/autotest_common.sh@10 -- # set +x 00:03:26.586 ************************************ 00:03:26.586 START TEST driver 00:03:26.586 ************************************ 00:03:26.586 00:56:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:26.586 * Looking for test storage... 00:03:26.586 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:26.586 00:56:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:26.586 00:56:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:26.586 00:56:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:26.586 00:56:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:26.586 00:56:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:26.586 00:56:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:26.586 00:56:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:26.586 00:56:17 -- scripts/common.sh@335 -- # IFS=.-: 00:03:26.586 00:56:17 -- scripts/common.sh@335 -- # read -ra ver1 00:03:26.586 00:56:17 -- scripts/common.sh@336 -- # IFS=.-: 00:03:26.586 00:56:17 -- scripts/common.sh@336 -- # read -ra ver2 00:03:26.586 00:56:17 -- scripts/common.sh@337 -- # local 'op=<' 00:03:26.586 00:56:17 -- scripts/common.sh@339 -- # ver1_l=2 00:03:26.586 00:56:17 -- scripts/common.sh@340 -- # ver2_l=1 00:03:26.586 00:56:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:26.586 00:56:17 -- scripts/common.sh@343 -- # case "$op" in 00:03:26.586 00:56:17 -- scripts/common.sh@344 -- # : 1 00:03:26.586 00:56:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:26.586 00:56:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:26.586 00:56:17 -- scripts/common.sh@364 -- # decimal 1 00:03:26.586 00:56:17 -- scripts/common.sh@352 -- # local d=1 00:03:26.586 00:56:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:26.586 00:56:17 -- scripts/common.sh@354 -- # echo 1 00:03:26.586 00:56:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:26.586 00:56:17 -- scripts/common.sh@365 -- # decimal 2 00:03:26.586 00:56:17 -- scripts/common.sh@352 -- # local d=2 00:03:26.586 00:56:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:26.586 00:56:17 -- scripts/common.sh@354 -- # echo 2 00:03:26.586 00:56:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:26.586 00:56:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:26.586 00:56:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:26.586 00:56:17 -- scripts/common.sh@367 -- # return 0 00:03:26.586 00:56:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:26.586 00:56:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:26.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.586 --rc genhtml_branch_coverage=1 00:03:26.586 --rc genhtml_function_coverage=1 00:03:26.586 --rc genhtml_legend=1 00:03:26.586 --rc geninfo_all_blocks=1 00:03:26.586 --rc geninfo_unexecuted_blocks=1 00:03:26.586 00:03:26.586 ' 00:03:26.586 00:56:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:26.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.586 --rc genhtml_branch_coverage=1 00:03:26.586 --rc genhtml_function_coverage=1 00:03:26.586 --rc genhtml_legend=1 00:03:26.586 --rc geninfo_all_blocks=1 00:03:26.586 --rc geninfo_unexecuted_blocks=1 00:03:26.586 00:03:26.586 ' 00:03:26.586 00:56:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:26.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.587 --rc genhtml_branch_coverage=1 00:03:26.587 --rc genhtml_function_coverage=1 00:03:26.587 --rc genhtml_legend=1 00:03:26.587 --rc geninfo_all_blocks=1 00:03:26.587 --rc geninfo_unexecuted_blocks=1 00:03:26.587 00:03:26.587 ' 00:03:26.587 00:56:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:26.587 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.587 --rc genhtml_branch_coverage=1 00:03:26.587 --rc genhtml_function_coverage=1 00:03:26.587 --rc genhtml_legend=1 00:03:26.587 --rc geninfo_all_blocks=1 00:03:26.587 --rc geninfo_unexecuted_blocks=1 00:03:26.587 00:03:26.587 ' 00:03:26.587 00:56:17 -- setup/driver.sh@68 -- # setup reset 00:03:26.587 00:56:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:26.587 00:56:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:29.117 00:56:19 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:29.117 00:56:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:29.117 00:56:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:29.117 00:56:19 -- common/autotest_common.sh@10 -- # set +x 00:03:29.117 ************************************ 00:03:29.117 START TEST guess_driver 00:03:29.117 ************************************ 00:03:29.117 00:56:19 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:29.117 00:56:19 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:29.117 00:56:19 -- setup/driver.sh@47 -- # local fail=0 00:03:29.117 00:56:19 -- setup/driver.sh@49 -- # pick_driver 00:03:29.117 00:56:19 -- setup/driver.sh@36 -- # vfio 00:03:29.117 00:56:19 -- setup/driver.sh@21 -- # local iommu_grups 00:03:29.117 00:56:19 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:29.117 00:56:19 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:29.117 00:56:19 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:29.117 00:56:19 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:29.117 00:56:19 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:29.117 00:56:19 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:29.117 00:56:19 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:29.117 00:56:19 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:29.117 00:56:19 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:29.117 00:56:19 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:29.117 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:29.117 00:56:19 -- setup/driver.sh@30 -- # return 0 00:03:29.117 00:56:19 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:29.117 00:56:19 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:29.117 00:56:19 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:29.117 00:56:19 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:29.117 Looking for driver=vfio-pci 00:03:29.117 00:56:19 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:29.117 00:56:19 -- setup/driver.sh@45 -- # setup output config 00:03:29.117 00:56:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.117 00:56:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.494 00:56:20 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:30.494 00:56:20 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:30.494 00:56:20 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:31.430 00:56:21 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:31.430 00:56:21 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:31.430 00:56:21 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:31.430 00:56:21 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:31.430 00:56:21 -- setup/driver.sh@65 -- # setup reset 00:03:31.430 00:56:21 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:31.430 00:56:21 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:34.020 00:03:34.020 real 0m4.809s 00:03:34.020 user 0m1.105s 00:03:34.020 sys 0m1.868s 00:03:34.020 00:56:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:34.020 00:56:24 -- common/autotest_common.sh@10 -- # set +x 00:03:34.020 ************************************ 00:03:34.020 END TEST guess_driver 00:03:34.020 ************************************ 00:03:34.020 00:03:34.020 real 0m7.406s 00:03:34.020 user 0m1.725s 00:03:34.020 sys 0m2.905s 00:03:34.020 00:56:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:34.020 00:56:24 -- common/autotest_common.sh@10 -- # set +x 00:03:34.020 ************************************ 00:03:34.020 END TEST driver 00:03:34.020 ************************************ 00:03:34.020 00:56:24 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:34.020 00:56:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:34.020 00:56:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:34.020 00:56:24 -- common/autotest_common.sh@10 -- # set +x 00:03:34.020 ************************************ 00:03:34.020 START TEST devices 00:03:34.020 ************************************ 00:03:34.020 00:56:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:34.020 * Looking for test storage... 00:03:34.020 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:34.020 00:56:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:34.020 00:56:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:34.020 00:56:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:34.020 00:56:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:34.020 00:56:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:34.020 00:56:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:34.020 00:56:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:34.020 00:56:24 -- scripts/common.sh@335 -- # IFS=.-: 00:03:34.020 00:56:24 -- scripts/common.sh@335 -- # read -ra ver1 00:03:34.020 00:56:24 -- scripts/common.sh@336 -- # IFS=.-: 00:03:34.020 00:56:24 -- scripts/common.sh@336 -- # read -ra ver2 00:03:34.020 00:56:24 -- scripts/common.sh@337 -- # local 'op=<' 00:03:34.020 00:56:24 -- scripts/common.sh@339 -- # ver1_l=2 00:03:34.020 00:56:24 -- scripts/common.sh@340 -- # ver2_l=1 00:03:34.020 00:56:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:34.020 00:56:24 -- scripts/common.sh@343 -- # case "$op" in 00:03:34.020 00:56:24 -- scripts/common.sh@344 -- # : 1 00:03:34.020 00:56:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:34.020 00:56:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:34.020 00:56:24 -- scripts/common.sh@364 -- # decimal 1 00:03:34.020 00:56:24 -- scripts/common.sh@352 -- # local d=1 00:03:34.020 00:56:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:34.020 00:56:24 -- scripts/common.sh@354 -- # echo 1 00:03:34.020 00:56:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:34.020 00:56:24 -- scripts/common.sh@365 -- # decimal 2 00:03:34.020 00:56:24 -- scripts/common.sh@352 -- # local d=2 00:03:34.020 00:56:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:34.020 00:56:24 -- scripts/common.sh@354 -- # echo 2 00:03:34.020 00:56:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:34.020 00:56:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:34.020 00:56:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:34.020 00:56:24 -- scripts/common.sh@367 -- # return 0 00:03:34.020 00:56:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:34.020 00:56:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:34.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:34.020 --rc genhtml_branch_coverage=1 00:03:34.020 --rc genhtml_function_coverage=1 00:03:34.020 --rc genhtml_legend=1 00:03:34.020 --rc geninfo_all_blocks=1 00:03:34.020 --rc geninfo_unexecuted_blocks=1 00:03:34.020 00:03:34.020 ' 00:03:34.020 00:56:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:34.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:34.020 --rc genhtml_branch_coverage=1 00:03:34.020 --rc genhtml_function_coverage=1 00:03:34.020 --rc genhtml_legend=1 00:03:34.020 --rc geninfo_all_blocks=1 00:03:34.020 --rc geninfo_unexecuted_blocks=1 00:03:34.020 00:03:34.020 ' 00:03:34.020 00:56:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:34.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:34.020 --rc genhtml_branch_coverage=1 00:03:34.020 --rc genhtml_function_coverage=1 00:03:34.020 --rc genhtml_legend=1 00:03:34.020 --rc geninfo_all_blocks=1 00:03:34.020 --rc geninfo_unexecuted_blocks=1 00:03:34.020 00:03:34.020 ' 00:03:34.020 00:56:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:34.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:34.020 --rc genhtml_branch_coverage=1 00:03:34.020 --rc genhtml_function_coverage=1 00:03:34.020 --rc genhtml_legend=1 00:03:34.020 --rc geninfo_all_blocks=1 00:03:34.020 --rc geninfo_unexecuted_blocks=1 00:03:34.020 00:03:34.020 ' 00:03:34.020 00:56:24 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:34.020 00:56:24 -- setup/devices.sh@192 -- # setup reset 00:03:34.020 00:56:24 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:34.020 00:56:24 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:35.396 00:56:25 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:35.396 00:56:25 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:35.396 00:56:25 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:35.396 00:56:25 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:35.396 00:56:25 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:35.396 00:56:25 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:35.396 00:56:25 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:35.396 00:56:25 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:35.396 00:56:25 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:35.396 00:56:25 -- setup/devices.sh@196 -- # blocks=() 00:03:35.396 00:56:25 -- setup/devices.sh@196 -- # declare -a blocks 00:03:35.396 00:56:25 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:35.396 00:56:25 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:35.396 00:56:25 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:35.396 00:56:25 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:35.396 00:56:25 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:35.396 00:56:25 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:35.396 00:56:25 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:35.396 00:56:25 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:35.396 00:56:25 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:35.396 00:56:25 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:35.396 00:56:25 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:35.654 No valid GPT data, bailing 00:03:35.654 00:56:25 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:35.654 00:56:25 -- scripts/common.sh@393 -- # pt= 00:03:35.654 00:56:25 -- scripts/common.sh@394 -- # return 1 00:03:35.654 00:56:25 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:35.654 00:56:25 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:35.654 00:56:25 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:35.654 00:56:25 -- setup/common.sh@80 -- # echo 1000204886016 00:03:35.654 00:56:25 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:35.654 00:56:25 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:35.654 00:56:25 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:35.654 00:56:25 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:35.654 00:56:25 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:35.654 00:56:25 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:35.654 00:56:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.654 00:56:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.654 00:56:25 -- common/autotest_common.sh@10 -- # set +x 00:03:35.654 ************************************ 00:03:35.654 START TEST nvme_mount 00:03:35.654 ************************************ 00:03:35.654 00:56:25 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:35.654 00:56:25 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:35.654 00:56:25 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:35.654 00:56:25 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:35.654 00:56:25 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:35.654 00:56:25 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:35.654 00:56:25 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:35.654 00:56:25 -- setup/common.sh@40 -- # local part_no=1 00:03:35.654 00:56:25 -- setup/common.sh@41 -- # local size=1073741824 00:03:35.654 00:56:25 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:35.654 00:56:25 -- setup/common.sh@44 -- # parts=() 00:03:35.654 00:56:25 -- setup/common.sh@44 -- # local parts 00:03:35.654 00:56:25 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:35.654 00:56:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.655 00:56:25 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:35.655 00:56:25 -- setup/common.sh@46 -- # (( part++ )) 00:03:35.655 00:56:25 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:35.655 00:56:25 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:35.655 00:56:25 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:35.655 00:56:25 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:36.591 Creating new GPT entries in memory. 00:03:36.591 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:36.591 other utilities. 00:03:36.591 00:56:26 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:36.591 00:56:26 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:36.591 00:56:26 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:36.591 00:56:26 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:36.591 00:56:26 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:37.525 Creating new GPT entries in memory. 00:03:37.525 The operation has completed successfully. 00:03:37.525 00:56:27 -- setup/common.sh@57 -- # (( part++ )) 00:03:37.525 00:56:27 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:37.525 00:56:27 -- setup/common.sh@62 -- # wait 914648 00:03:37.525 00:56:28 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.525 00:56:28 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:37.525 00:56:28 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.525 00:56:28 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:37.525 00:56:28 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:37.783 00:56:28 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.783 00:56:28 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.783 00:56:28 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:37.783 00:56:28 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:37.783 00:56:28 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:37.783 00:56:28 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:37.783 00:56:28 -- setup/devices.sh@53 -- # local found=0 00:03:37.783 00:56:28 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:37.783 00:56:28 -- setup/devices.sh@56 -- # : 00:03:37.783 00:56:28 -- setup/devices.sh@59 -- # local pci status 00:03:37.783 00:56:28 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:37.783 00:56:28 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:37.783 00:56:28 -- setup/devices.sh@47 -- # setup output config 00:03:37.783 00:56:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:37.783 00:56:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:38.718 00:56:29 -- setup/devices.sh@63 -- # found=1 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.718 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.718 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.719 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.719 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.719 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.719 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.719 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:38.719 00:56:29 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:38.719 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.000 00:56:29 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:39.000 00:56:29 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:39.000 00:56:29 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.000 00:56:29 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:39.000 00:56:29 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.000 00:56:29 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:39.000 00:56:29 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.000 00:56:29 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.000 00:56:29 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:39.000 00:56:29 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:39.000 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:39.000 00:56:29 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:39.000 00:56:29 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:39.258 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:39.258 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:39.258 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:39.258 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:39.258 00:56:29 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:39.258 00:56:29 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:39.258 00:56:29 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.258 00:56:29 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:39.258 00:56:29 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:39.258 00:56:29 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.517 00:56:29 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.517 00:56:29 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:39.517 00:56:29 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:39.517 00:56:29 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:39.517 00:56:29 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:39.517 00:56:29 -- setup/devices.sh@53 -- # local found=0 00:03:39.517 00:56:29 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:39.517 00:56:29 -- setup/devices.sh@56 -- # : 00:03:39.517 00:56:29 -- setup/devices.sh@59 -- # local pci status 00:03:39.517 00:56:29 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:39.517 00:56:29 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:39.517 00:56:29 -- setup/devices.sh@47 -- # setup output config 00:03:39.517 00:56:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:39.517 00:56:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:40.451 00:56:30 -- setup/devices.sh@63 -- # found=1 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.451 00:56:30 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:40.451 00:56:30 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.710 00:56:31 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:40.710 00:56:31 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:40.710 00:56:31 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.710 00:56:31 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:40.710 00:56:31 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:40.710 00:56:31 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:40.710 00:56:31 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:40.710 00:56:31 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:40.710 00:56:31 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:40.710 00:56:31 -- setup/devices.sh@50 -- # local mount_point= 00:03:40.710 00:56:31 -- setup/devices.sh@51 -- # local test_file= 00:03:40.710 00:56:31 -- setup/devices.sh@53 -- # local found=0 00:03:40.710 00:56:31 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:40.710 00:56:31 -- setup/devices.sh@59 -- # local pci status 00:03:40.710 00:56:31 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:40.710 00:56:31 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:40.710 00:56:31 -- setup/devices.sh@47 -- # setup output config 00:03:40.710 00:56:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:40.711 00:56:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:42.088 00:56:32 -- setup/devices.sh@63 -- # found=1 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:42.088 00:56:32 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:42.088 00:56:32 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:42.088 00:56:32 -- setup/devices.sh@68 -- # return 0 00:03:42.088 00:56:32 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:42.088 00:56:32 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.088 00:56:32 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:42.088 00:56:32 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:42.088 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:42.088 00:03:42.088 real 0m6.543s 00:03:42.088 user 0m1.538s 00:03:42.088 sys 0m2.598s 00:03:42.088 00:56:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:42.088 00:56:32 -- common/autotest_common.sh@10 -- # set +x 00:03:42.088 ************************************ 00:03:42.088 END TEST nvme_mount 00:03:42.088 ************************************ 00:03:42.088 00:56:32 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:42.088 00:56:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:42.088 00:56:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:42.088 00:56:32 -- common/autotest_common.sh@10 -- # set +x 00:03:42.088 ************************************ 00:03:42.088 START TEST dm_mount 00:03:42.088 ************************************ 00:03:42.088 00:56:32 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:42.088 00:56:32 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:42.088 00:56:32 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:42.088 00:56:32 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:42.088 00:56:32 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:42.088 00:56:32 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:42.088 00:56:32 -- setup/common.sh@40 -- # local part_no=2 00:03:42.088 00:56:32 -- setup/common.sh@41 -- # local size=1073741824 00:03:42.088 00:56:32 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:42.088 00:56:32 -- setup/common.sh@44 -- # parts=() 00:03:42.088 00:56:32 -- setup/common.sh@44 -- # local parts 00:03:42.088 00:56:32 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:42.088 00:56:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:42.089 00:56:32 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:42.089 00:56:32 -- setup/common.sh@46 -- # (( part++ )) 00:03:42.089 00:56:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:42.089 00:56:32 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:42.089 00:56:32 -- setup/common.sh@46 -- # (( part++ )) 00:03:42.089 00:56:32 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:42.089 00:56:32 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:42.089 00:56:32 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:42.089 00:56:32 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:43.025 Creating new GPT entries in memory. 00:03:43.025 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:43.025 other utilities. 00:03:43.025 00:56:33 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:43.025 00:56:33 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:43.025 00:56:33 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:43.025 00:56:33 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:43.025 00:56:33 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:44.400 Creating new GPT entries in memory. 00:03:44.400 The operation has completed successfully. 00:03:44.400 00:56:34 -- setup/common.sh@57 -- # (( part++ )) 00:03:44.400 00:56:34 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:44.400 00:56:34 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:44.400 00:56:34 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:44.400 00:56:34 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:45.335 The operation has completed successfully. 00:03:45.336 00:56:35 -- setup/common.sh@57 -- # (( part++ )) 00:03:45.336 00:56:35 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:45.336 00:56:35 -- setup/common.sh@62 -- # wait 917114 00:03:45.336 00:56:35 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:45.336 00:56:35 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.336 00:56:35 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:45.336 00:56:35 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:45.336 00:56:35 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:45.336 00:56:35 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:45.336 00:56:35 -- setup/devices.sh@161 -- # break 00:03:45.336 00:56:35 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:45.336 00:56:35 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:45.336 00:56:35 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:45.336 00:56:35 -- setup/devices.sh@166 -- # dm=dm-0 00:03:45.336 00:56:35 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:45.336 00:56:35 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:45.336 00:56:35 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.336 00:56:35 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:45.336 00:56:35 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.336 00:56:35 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:45.336 00:56:35 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:45.336 00:56:35 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.336 00:56:35 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:45.336 00:56:35 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:45.336 00:56:35 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:45.336 00:56:35 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:45.336 00:56:35 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:45.336 00:56:35 -- setup/devices.sh@53 -- # local found=0 00:03:45.336 00:56:35 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:45.336 00:56:35 -- setup/devices.sh@56 -- # : 00:03:45.336 00:56:35 -- setup/devices.sh@59 -- # local pci status 00:03:45.336 00:56:35 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.336 00:56:35 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:45.336 00:56:35 -- setup/devices.sh@47 -- # setup output config 00:03:45.336 00:56:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:45.336 00:56:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:46.270 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.270 00:56:36 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:46.270 00:56:36 -- setup/devices.sh@63 -- # found=1 00:03:46.270 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.271 00:56:36 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.271 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.530 00:56:36 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.530 00:56:36 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:46.530 00:56:36 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:46.530 00:56:36 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:46.530 00:56:36 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:46.530 00:56:36 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:46.530 00:56:36 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:46.530 00:56:36 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:46.530 00:56:36 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:46.530 00:56:36 -- setup/devices.sh@50 -- # local mount_point= 00:03:46.530 00:56:36 -- setup/devices.sh@51 -- # local test_file= 00:03:46.530 00:56:36 -- setup/devices.sh@53 -- # local found=0 00:03:46.530 00:56:36 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:46.530 00:56:36 -- setup/devices.sh@59 -- # local pci status 00:03:46.530 00:56:36 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.530 00:56:36 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:46.530 00:56:36 -- setup/devices.sh@47 -- # setup output config 00:03:46.530 00:56:36 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.530 00:56:36 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:47.906 00:56:38 -- setup/devices.sh@63 -- # found=1 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.906 00:56:38 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:47.906 00:56:38 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:47.906 00:56:38 -- setup/devices.sh@68 -- # return 0 00:03:47.906 00:56:38 -- setup/devices.sh@187 -- # cleanup_dm 00:03:47.906 00:56:38 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:47.906 00:56:38 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:47.906 00:56:38 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:47.906 00:56:38 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:47.906 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:47.906 00:56:38 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:47.906 00:03:47.906 real 0m5.776s 00:03:47.906 user 0m0.955s 00:03:47.906 sys 0m1.687s 00:03:47.906 00:56:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:47.906 00:56:38 -- common/autotest_common.sh@10 -- # set +x 00:03:47.906 ************************************ 00:03:47.906 END TEST dm_mount 00:03:47.906 ************************************ 00:03:47.906 00:56:38 -- setup/devices.sh@1 -- # cleanup 00:03:47.906 00:56:38 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:47.906 00:56:38 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.906 00:56:38 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:47.906 00:56:38 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:47.906 00:56:38 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:48.165 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:48.165 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:48.165 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:48.165 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:48.165 00:56:38 -- setup/devices.sh@12 -- # cleanup_dm 00:03:48.165 00:56:38 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:48.165 00:56:38 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:48.165 00:56:38 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:48.165 00:56:38 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:48.165 00:56:38 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:48.165 00:56:38 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:48.165 00:03:48.165 real 0m14.257s 00:03:48.165 user 0m3.202s 00:03:48.165 sys 0m5.287s 00:03:48.165 00:56:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:48.165 00:56:38 -- common/autotest_common.sh@10 -- # set +x 00:03:48.165 ************************************ 00:03:48.165 END TEST devices 00:03:48.165 ************************************ 00:03:48.165 00:03:48.165 real 0m44.231s 00:03:48.165 user 0m12.674s 00:03:48.165 sys 0m20.078s 00:03:48.165 00:56:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:48.165 00:56:38 -- common/autotest_common.sh@10 -- # set +x 00:03:48.165 ************************************ 00:03:48.165 END TEST setup.sh 00:03:48.165 ************************************ 00:03:48.165 00:56:38 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:49.542 Hugepages 00:03:49.542 node hugesize free / total 00:03:49.542 node0 1048576kB 0 / 0 00:03:49.542 node0 2048kB 2048 / 2048 00:03:49.542 node1 1048576kB 0 / 0 00:03:49.542 node1 2048kB 0 / 0 00:03:49.542 00:03:49.542 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:49.542 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:49.542 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:49.542 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:49.542 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:49.542 00:56:39 -- spdk/autotest.sh@128 -- # uname -s 00:03:49.542 00:56:39 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:49.542 00:56:39 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:49.542 00:56:39 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:50.918 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:50.918 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:50.918 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:51.856 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:51.856 00:56:42 -- common/autotest_common.sh@1527 -- # sleep 1 00:03:52.794 00:56:43 -- common/autotest_common.sh@1528 -- # bdfs=() 00:03:52.794 00:56:43 -- common/autotest_common.sh@1528 -- # local bdfs 00:03:52.794 00:56:43 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:03:52.794 00:56:43 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:03:52.794 00:56:43 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:52.794 00:56:43 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:52.794 00:56:43 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:52.794 00:56:43 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:52.794 00:56:43 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:52.794 00:56:43 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:52.794 00:56:43 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:52.794 00:56:43 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:54.170 Waiting for block devices as requested 00:03:54.170 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:03:54.170 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:54.170 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:54.429 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:54.429 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:54.429 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:54.689 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:54.689 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:54.689 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:54.689 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:03:54.689 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:03:54.948 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:03:54.948 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:03:54.948 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:03:55.207 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:03:55.207 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:03:55.207 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:03:55.465 00:56:45 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:03:55.465 00:56:45 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:03:55.465 00:56:45 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:03:55.465 00:56:45 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:03:55.465 00:56:45 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1540 -- # grep oacs 00:03:55.465 00:56:45 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:03:55.465 00:56:45 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:03:55.465 00:56:45 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:03:55.465 00:56:45 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:03:55.465 00:56:45 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:03:55.465 00:56:45 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:03:55.465 00:56:45 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:03:55.465 00:56:45 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:03:55.465 00:56:45 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:03:55.465 00:56:45 -- common/autotest_common.sh@1552 -- # continue 00:03:55.465 00:56:45 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:03:55.465 00:56:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:55.465 00:56:45 -- common/autotest_common.sh@10 -- # set +x 00:03:55.465 00:56:45 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:03:55.465 00:56:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:55.465 00:56:45 -- common/autotest_common.sh@10 -- # set +x 00:03:55.465 00:56:45 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:56.839 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:56.839 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:56.839 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:57.773 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:57.773 00:56:48 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:03:57.773 00:56:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:03:57.773 00:56:48 -- common/autotest_common.sh@10 -- # set +x 00:03:57.773 00:56:48 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:03:57.773 00:56:48 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:03:57.773 00:56:48 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:03:57.773 00:56:48 -- common/autotest_common.sh@1572 -- # bdfs=() 00:03:57.773 00:56:48 -- common/autotest_common.sh@1572 -- # local bdfs 00:03:57.773 00:56:48 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:03:57.773 00:56:48 -- common/autotest_common.sh@1508 -- # bdfs=() 00:03:57.773 00:56:48 -- common/autotest_common.sh@1508 -- # local bdfs 00:03:57.773 00:56:48 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:03:57.773 00:56:48 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:03:57.773 00:56:48 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:03:57.773 00:56:48 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:03:57.773 00:56:48 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:03:57.773 00:56:48 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:03:57.773 00:56:48 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:03:57.773 00:56:48 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:03:57.773 00:56:48 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:03:57.773 00:56:48 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:03:57.773 00:56:48 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:03:57.773 00:56:48 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:03:57.773 00:56:48 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=922414 00:03:57.773 00:56:48 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:03:57.773 00:56:48 -- common/autotest_common.sh@1593 -- # waitforlisten 922414 00:03:57.773 00:56:48 -- common/autotest_common.sh@829 -- # '[' -z 922414 ']' 00:03:57.774 00:56:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:03:57.774 00:56:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:03:57.774 00:56:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:03:57.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:03:57.774 00:56:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:03:57.774 00:56:48 -- common/autotest_common.sh@10 -- # set +x 00:03:57.774 [2024-11-26 00:56:48.302673] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:03:57.774 [2024-11-26 00:56:48.302782] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid922414 ] 00:03:58.032 EAL: No free 2048 kB hugepages reported on node 1 00:03:58.032 [2024-11-26 00:56:48.365397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:03:58.032 [2024-11-26 00:56:48.478196] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:03:58.032 [2024-11-26 00:56:48.478384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:03:58.965 00:56:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:03:58.965 00:56:49 -- common/autotest_common.sh@862 -- # return 0 00:03:58.965 00:56:49 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:03:58.965 00:56:49 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:03:58.965 00:56:49 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:02.248 nvme0n1 00:04:02.248 00:56:52 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:02.248 [2024-11-26 00:56:52.574058] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:02.248 [2024-11-26 00:56:52.574105] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:02.248 request: 00:04:02.248 { 00:04:02.248 "nvme_ctrlr_name": "nvme0", 00:04:02.248 "password": "test", 00:04:02.248 "method": "bdev_nvme_opal_revert", 00:04:02.248 "req_id": 1 00:04:02.248 } 00:04:02.248 Got JSON-RPC error response 00:04:02.248 response: 00:04:02.248 { 00:04:02.248 "code": -32603, 00:04:02.248 "message": "Internal error" 00:04:02.248 } 00:04:02.248 00:56:52 -- common/autotest_common.sh@1599 -- # true 00:04:02.248 00:56:52 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:02.248 00:56:52 -- common/autotest_common.sh@1603 -- # killprocess 922414 00:04:02.248 00:56:52 -- common/autotest_common.sh@936 -- # '[' -z 922414 ']' 00:04:02.248 00:56:52 -- common/autotest_common.sh@940 -- # kill -0 922414 00:04:02.248 00:56:52 -- common/autotest_common.sh@941 -- # uname 00:04:02.248 00:56:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:02.248 00:56:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 922414 00:04:02.248 00:56:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:02.248 00:56:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:02.248 00:56:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 922414' 00:04:02.248 killing process with pid 922414 00:04:02.248 00:56:52 -- common/autotest_common.sh@955 -- # kill 922414 00:04:02.248 00:56:52 -- common/autotest_common.sh@960 -- # wait 922414 00:04:04.219 00:56:54 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:04.219 00:56:54 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:04.219 00:56:54 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:04.219 00:56:54 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:04.219 00:56:54 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:04.219 00:56:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:04.219 00:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:04.219 00:56:54 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:04.219 00:56:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.219 00:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:04.219 ************************************ 00:04:04.219 START TEST env 00:04:04.219 ************************************ 00:04:04.219 00:56:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:04.219 * Looking for test storage... 00:04:04.219 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:04.219 00:56:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:04.219 00:56:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:04.219 00:56:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:04.219 00:56:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:04.219 00:56:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:04.219 00:56:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:04.219 00:56:54 -- scripts/common.sh@335 -- # IFS=.-: 00:04:04.219 00:56:54 -- scripts/common.sh@335 -- # read -ra ver1 00:04:04.219 00:56:54 -- scripts/common.sh@336 -- # IFS=.-: 00:04:04.219 00:56:54 -- scripts/common.sh@336 -- # read -ra ver2 00:04:04.219 00:56:54 -- scripts/common.sh@337 -- # local 'op=<' 00:04:04.219 00:56:54 -- scripts/common.sh@339 -- # ver1_l=2 00:04:04.219 00:56:54 -- scripts/common.sh@340 -- # ver2_l=1 00:04:04.219 00:56:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:04.219 00:56:54 -- scripts/common.sh@343 -- # case "$op" in 00:04:04.219 00:56:54 -- scripts/common.sh@344 -- # : 1 00:04:04.219 00:56:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:04.219 00:56:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:04.219 00:56:54 -- scripts/common.sh@364 -- # decimal 1 00:04:04.219 00:56:54 -- scripts/common.sh@352 -- # local d=1 00:04:04.219 00:56:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:04.219 00:56:54 -- scripts/common.sh@354 -- # echo 1 00:04:04.219 00:56:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:04.219 00:56:54 -- scripts/common.sh@365 -- # decimal 2 00:04:04.219 00:56:54 -- scripts/common.sh@352 -- # local d=2 00:04:04.219 00:56:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:04.219 00:56:54 -- scripts/common.sh@354 -- # echo 2 00:04:04.219 00:56:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:04.219 00:56:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:04.219 00:56:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:04.219 00:56:54 -- scripts/common.sh@367 -- # return 0 00:04:04.219 00:56:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:04.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.219 --rc genhtml_branch_coverage=1 00:04:04.219 --rc genhtml_function_coverage=1 00:04:04.219 --rc genhtml_legend=1 00:04:04.219 --rc geninfo_all_blocks=1 00:04:04.219 --rc geninfo_unexecuted_blocks=1 00:04:04.219 00:04:04.219 ' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:04.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.219 --rc genhtml_branch_coverage=1 00:04:04.219 --rc genhtml_function_coverage=1 00:04:04.219 --rc genhtml_legend=1 00:04:04.219 --rc geninfo_all_blocks=1 00:04:04.219 --rc geninfo_unexecuted_blocks=1 00:04:04.219 00:04:04.219 ' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:04.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.219 --rc genhtml_branch_coverage=1 00:04:04.219 --rc genhtml_function_coverage=1 00:04:04.219 --rc genhtml_legend=1 00:04:04.219 --rc geninfo_all_blocks=1 00:04:04.219 --rc geninfo_unexecuted_blocks=1 00:04:04.219 00:04:04.219 ' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:04.219 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:04.219 --rc genhtml_branch_coverage=1 00:04:04.219 --rc genhtml_function_coverage=1 00:04:04.219 --rc genhtml_legend=1 00:04:04.219 --rc geninfo_all_blocks=1 00:04:04.219 --rc geninfo_unexecuted_blocks=1 00:04:04.219 00:04:04.219 ' 00:04:04.219 00:56:54 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:04.219 00:56:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.219 00:56:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.219 00:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:04.219 ************************************ 00:04:04.219 START TEST env_memory 00:04:04.219 ************************************ 00:04:04.219 00:56:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:04.219 00:04:04.219 00:04:04.219 CUnit - A unit testing framework for C - Version 2.1-3 00:04:04.219 http://cunit.sourceforge.net/ 00:04:04.219 00:04:04.219 00:04:04.219 Suite: memory 00:04:04.219 Test: alloc and free memory map ...[2024-11-26 00:56:54.630218] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:04.219 passed 00:04:04.220 Test: mem map translation ...[2024-11-26 00:56:54.650186] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:04.220 [2024-11-26 00:56:54.650208] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:04.220 [2024-11-26 00:56:54.650258] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:04.220 [2024-11-26 00:56:54.650269] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:04.220 passed 00:04:04.220 Test: mem map registration ...[2024-11-26 00:56:54.691312] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:04.220 [2024-11-26 00:56:54.691333] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:04.220 passed 00:04:04.220 Test: mem map adjacent registrations ...passed 00:04:04.220 00:04:04.220 Run Summary: Type Total Ran Passed Failed Inactive 00:04:04.220 suites 1 1 n/a 0 0 00:04:04.220 tests 4 4 4 0 0 00:04:04.220 asserts 152 152 152 0 n/a 00:04:04.220 00:04:04.220 Elapsed time = 0.146 seconds 00:04:04.478 00:04:04.478 real 0m0.154s 00:04:04.478 user 0m0.147s 00:04:04.478 sys 0m0.007s 00:04:04.478 00:56:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:04.478 00:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:04.478 ************************************ 00:04:04.478 END TEST env_memory 00:04:04.478 ************************************ 00:04:04.478 00:56:54 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:04.478 00:56:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:04.478 00:56:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:04.478 00:56:54 -- common/autotest_common.sh@10 -- # set +x 00:04:04.478 ************************************ 00:04:04.478 START TEST env_vtophys 00:04:04.478 ************************************ 00:04:04.478 00:56:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:04.478 EAL: lib.eal log level changed from notice to debug 00:04:04.478 EAL: Detected lcore 0 as core 0 on socket 0 00:04:04.478 EAL: Detected lcore 1 as core 1 on socket 0 00:04:04.478 EAL: Detected lcore 2 as core 2 on socket 0 00:04:04.478 EAL: Detected lcore 3 as core 3 on socket 0 00:04:04.478 EAL: Detected lcore 4 as core 4 on socket 0 00:04:04.478 EAL: Detected lcore 5 as core 5 on socket 0 00:04:04.478 EAL: Detected lcore 6 as core 8 on socket 0 00:04:04.478 EAL: Detected lcore 7 as core 9 on socket 0 00:04:04.478 EAL: Detected lcore 8 as core 10 on socket 0 00:04:04.478 EAL: Detected lcore 9 as core 11 on socket 0 00:04:04.478 EAL: Detected lcore 10 as core 12 on socket 0 00:04:04.478 EAL: Detected lcore 11 as core 13 on socket 0 00:04:04.478 EAL: Detected lcore 12 as core 0 on socket 1 00:04:04.478 EAL: Detected lcore 13 as core 1 on socket 1 00:04:04.478 EAL: Detected lcore 14 as core 2 on socket 1 00:04:04.478 EAL: Detected lcore 15 as core 3 on socket 1 00:04:04.478 EAL: Detected lcore 16 as core 4 on socket 1 00:04:04.478 EAL: Detected lcore 17 as core 5 on socket 1 00:04:04.478 EAL: Detected lcore 18 as core 8 on socket 1 00:04:04.478 EAL: Detected lcore 19 as core 9 on socket 1 00:04:04.478 EAL: Detected lcore 20 as core 10 on socket 1 00:04:04.478 EAL: Detected lcore 21 as core 11 on socket 1 00:04:04.478 EAL: Detected lcore 22 as core 12 on socket 1 00:04:04.478 EAL: Detected lcore 23 as core 13 on socket 1 00:04:04.478 EAL: Detected lcore 24 as core 0 on socket 0 00:04:04.478 EAL: Detected lcore 25 as core 1 on socket 0 00:04:04.478 EAL: Detected lcore 26 as core 2 on socket 0 00:04:04.478 EAL: Detected lcore 27 as core 3 on socket 0 00:04:04.478 EAL: Detected lcore 28 as core 4 on socket 0 00:04:04.478 EAL: Detected lcore 29 as core 5 on socket 0 00:04:04.478 EAL: Detected lcore 30 as core 8 on socket 0 00:04:04.478 EAL: Detected lcore 31 as core 9 on socket 0 00:04:04.478 EAL: Detected lcore 32 as core 10 on socket 0 00:04:04.478 EAL: Detected lcore 33 as core 11 on socket 0 00:04:04.478 EAL: Detected lcore 34 as core 12 on socket 0 00:04:04.478 EAL: Detected lcore 35 as core 13 on socket 0 00:04:04.478 EAL: Detected lcore 36 as core 0 on socket 1 00:04:04.478 EAL: Detected lcore 37 as core 1 on socket 1 00:04:04.478 EAL: Detected lcore 38 as core 2 on socket 1 00:04:04.478 EAL: Detected lcore 39 as core 3 on socket 1 00:04:04.478 EAL: Detected lcore 40 as core 4 on socket 1 00:04:04.478 EAL: Detected lcore 41 as core 5 on socket 1 00:04:04.478 EAL: Detected lcore 42 as core 8 on socket 1 00:04:04.478 EAL: Detected lcore 43 as core 9 on socket 1 00:04:04.478 EAL: Detected lcore 44 as core 10 on socket 1 00:04:04.478 EAL: Detected lcore 45 as core 11 on socket 1 00:04:04.478 EAL: Detected lcore 46 as core 12 on socket 1 00:04:04.478 EAL: Detected lcore 47 as core 13 on socket 1 00:04:04.478 EAL: Maximum logical cores by configuration: 128 00:04:04.478 EAL: Detected CPU lcores: 48 00:04:04.478 EAL: Detected NUMA nodes: 2 00:04:04.478 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:04.478 EAL: Detected shared linkage of DPDK 00:04:04.478 EAL: No shared files mode enabled, IPC will be disabled 00:04:04.478 EAL: Bus pci wants IOVA as 'DC' 00:04:04.478 EAL: Buses did not request a specific IOVA mode. 00:04:04.478 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:04.478 EAL: Selected IOVA mode 'VA' 00:04:04.478 EAL: No free 2048 kB hugepages reported on node 1 00:04:04.478 EAL: Probing VFIO support... 00:04:04.478 EAL: IOMMU type 1 (Type 1) is supported 00:04:04.478 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:04.479 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:04.479 EAL: VFIO support initialized 00:04:04.479 EAL: Ask a virtual area of 0x2e000 bytes 00:04:04.479 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:04.479 EAL: Setting up physically contiguous memory... 00:04:04.479 EAL: Setting maximum number of open files to 524288 00:04:04.479 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:04.479 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:04.479 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:04.479 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:04.479 EAL: Ask a virtual area of 0x61000 bytes 00:04:04.479 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:04.479 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:04.479 EAL: Ask a virtual area of 0x400000000 bytes 00:04:04.479 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:04.479 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:04.479 EAL: Hugepages will be freed exactly as allocated. 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: TSC frequency is ~2700000 KHz 00:04:04.479 EAL: Main lcore 0 is ready (tid=7efe4f796a00;cpuset=[0]) 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 0 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 2MB 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:04.479 EAL: Mem event callback 'spdk:(nil)' registered 00:04:04.479 00:04:04.479 00:04:04.479 CUnit - A unit testing framework for C - Version 2.1-3 00:04:04.479 http://cunit.sourceforge.net/ 00:04:04.479 00:04:04.479 00:04:04.479 Suite: components_suite 00:04:04.479 Test: vtophys_malloc_test ...passed 00:04:04.479 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 4MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was shrunk by 4MB 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 6MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was shrunk by 6MB 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 10MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was shrunk by 10MB 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 18MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was shrunk by 18MB 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 34MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was shrunk by 34MB 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 66MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was shrunk by 66MB 00:04:04.479 EAL: Trying to obtain current memory policy. 00:04:04.479 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.479 EAL: Restoring previous memory policy: 4 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.479 EAL: request: mp_malloc_sync 00:04:04.479 EAL: No shared files mode enabled, IPC is disabled 00:04:04.479 EAL: Heap on socket 0 was expanded by 130MB 00:04:04.479 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.738 EAL: request: mp_malloc_sync 00:04:04.738 EAL: No shared files mode enabled, IPC is disabled 00:04:04.738 EAL: Heap on socket 0 was shrunk by 130MB 00:04:04.738 EAL: Trying to obtain current memory policy. 00:04:04.738 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.738 EAL: Restoring previous memory policy: 4 00:04:04.738 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.738 EAL: request: mp_malloc_sync 00:04:04.738 EAL: No shared files mode enabled, IPC is disabled 00:04:04.738 EAL: Heap on socket 0 was expanded by 258MB 00:04:04.738 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.738 EAL: request: mp_malloc_sync 00:04:04.738 EAL: No shared files mode enabled, IPC is disabled 00:04:04.738 EAL: Heap on socket 0 was shrunk by 258MB 00:04:04.738 EAL: Trying to obtain current memory policy. 00:04:04.738 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:04.995 EAL: Restoring previous memory policy: 4 00:04:04.995 EAL: Calling mem event callback 'spdk:(nil)' 00:04:04.996 EAL: request: mp_malloc_sync 00:04:04.996 EAL: No shared files mode enabled, IPC is disabled 00:04:04.996 EAL: Heap on socket 0 was expanded by 514MB 00:04:04.996 EAL: Calling mem event callback 'spdk:(nil)' 00:04:05.253 EAL: request: mp_malloc_sync 00:04:05.253 EAL: No shared files mode enabled, IPC is disabled 00:04:05.253 EAL: Heap on socket 0 was shrunk by 514MB 00:04:05.253 EAL: Trying to obtain current memory policy. 00:04:05.253 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:05.512 EAL: Restoring previous memory policy: 4 00:04:05.512 EAL: Calling mem event callback 'spdk:(nil)' 00:04:05.512 EAL: request: mp_malloc_sync 00:04:05.512 EAL: No shared files mode enabled, IPC is disabled 00:04:05.512 EAL: Heap on socket 0 was expanded by 1026MB 00:04:05.512 EAL: Calling mem event callback 'spdk:(nil)' 00:04:05.770 EAL: request: mp_malloc_sync 00:04:05.770 EAL: No shared files mode enabled, IPC is disabled 00:04:05.770 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:05.770 passed 00:04:05.770 00:04:05.770 Run Summary: Type Total Ran Passed Failed Inactive 00:04:05.770 suites 1 1 n/a 0 0 00:04:05.770 tests 2 2 2 0 0 00:04:05.770 asserts 497 497 497 0 n/a 00:04:05.770 00:04:05.770 Elapsed time = 1.371 seconds 00:04:05.770 EAL: Calling mem event callback 'spdk:(nil)' 00:04:05.770 EAL: request: mp_malloc_sync 00:04:05.770 EAL: No shared files mode enabled, IPC is disabled 00:04:05.770 EAL: Heap on socket 0 was shrunk by 2MB 00:04:05.770 EAL: No shared files mode enabled, IPC is disabled 00:04:05.770 EAL: No shared files mode enabled, IPC is disabled 00:04:05.770 EAL: No shared files mode enabled, IPC is disabled 00:04:05.770 00:04:05.770 real 0m1.490s 00:04:05.770 user 0m0.866s 00:04:05.770 sys 0m0.589s 00:04:05.770 00:56:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:05.770 00:56:56 -- common/autotest_common.sh@10 -- # set +x 00:04:05.770 ************************************ 00:04:05.770 END TEST env_vtophys 00:04:05.770 ************************************ 00:04:05.770 00:56:56 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:05.770 00:56:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:05.770 00:56:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:05.770 00:56:56 -- common/autotest_common.sh@10 -- # set +x 00:04:05.770 ************************************ 00:04:05.770 START TEST env_pci 00:04:05.770 ************************************ 00:04:05.770 00:56:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:06.028 00:04:06.028 00:04:06.028 CUnit - A unit testing framework for C - Version 2.1-3 00:04:06.028 http://cunit.sourceforge.net/ 00:04:06.028 00:04:06.028 00:04:06.028 Suite: pci 00:04:06.028 Test: pci_hook ...[2024-11-26 00:56:56.306975] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 923460 has claimed it 00:04:06.028 EAL: Cannot find device (10000:00:01.0) 00:04:06.028 EAL: Failed to attach device on primary process 00:04:06.028 passed 00:04:06.028 00:04:06.028 Run Summary: Type Total Ran Passed Failed Inactive 00:04:06.028 suites 1 1 n/a 0 0 00:04:06.028 tests 1 1 1 0 0 00:04:06.028 asserts 25 25 25 0 n/a 00:04:06.028 00:04:06.028 Elapsed time = 0.023 seconds 00:04:06.028 00:04:06.028 real 0m0.035s 00:04:06.028 user 0m0.012s 00:04:06.028 sys 0m0.023s 00:04:06.028 00:56:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:06.028 00:56:56 -- common/autotest_common.sh@10 -- # set +x 00:04:06.028 ************************************ 00:04:06.028 END TEST env_pci 00:04:06.028 ************************************ 00:04:06.028 00:56:56 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:06.028 00:56:56 -- env/env.sh@15 -- # uname 00:04:06.028 00:56:56 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:06.028 00:56:56 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:06.028 00:56:56 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:06.028 00:56:56 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:06.028 00:56:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:06.028 00:56:56 -- common/autotest_common.sh@10 -- # set +x 00:04:06.028 ************************************ 00:04:06.028 START TEST env_dpdk_post_init 00:04:06.028 ************************************ 00:04:06.028 00:56:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:06.028 EAL: Detected CPU lcores: 48 00:04:06.028 EAL: Detected NUMA nodes: 2 00:04:06.028 EAL: Detected shared linkage of DPDK 00:04:06.028 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:06.028 EAL: Selected IOVA mode 'VA' 00:04:06.028 EAL: No free 2048 kB hugepages reported on node 1 00:04:06.028 EAL: VFIO support initialized 00:04:06.028 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:06.028 EAL: Using IOMMU type 1 (Type 1) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:06.028 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:06.286 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:07.219 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:10.500 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:10.500 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:10.500 Starting DPDK initialization... 00:04:10.500 Starting SPDK post initialization... 00:04:10.500 SPDK NVMe probe 00:04:10.500 Attaching to 0000:88:00.0 00:04:10.500 Attached to 0000:88:00.0 00:04:10.500 Cleaning up... 00:04:10.500 00:04:10.500 real 0m4.402s 00:04:10.500 user 0m3.271s 00:04:10.501 sys 0m0.182s 00:04:10.501 00:57:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.501 00:57:00 -- common/autotest_common.sh@10 -- # set +x 00:04:10.501 ************************************ 00:04:10.501 END TEST env_dpdk_post_init 00:04:10.501 ************************************ 00:04:10.501 00:57:00 -- env/env.sh@26 -- # uname 00:04:10.501 00:57:00 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:10.501 00:57:00 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:10.501 00:57:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.501 00:57:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.501 00:57:00 -- common/autotest_common.sh@10 -- # set +x 00:04:10.501 ************************************ 00:04:10.501 START TEST env_mem_callbacks 00:04:10.501 ************************************ 00:04:10.501 00:57:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:10.501 EAL: Detected CPU lcores: 48 00:04:10.501 EAL: Detected NUMA nodes: 2 00:04:10.501 EAL: Detected shared linkage of DPDK 00:04:10.501 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:10.501 EAL: Selected IOVA mode 'VA' 00:04:10.501 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.501 EAL: VFIO support initialized 00:04:10.501 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:10.501 00:04:10.501 00:04:10.501 CUnit - A unit testing framework for C - Version 2.1-3 00:04:10.501 http://cunit.sourceforge.net/ 00:04:10.501 00:04:10.501 00:04:10.501 Suite: memory 00:04:10.501 Test: test ... 00:04:10.501 register 0x200000200000 2097152 00:04:10.501 malloc 3145728 00:04:10.501 register 0x200000400000 4194304 00:04:10.501 buf 0x200000500000 len 3145728 PASSED 00:04:10.501 malloc 64 00:04:10.501 buf 0x2000004fff40 len 64 PASSED 00:04:10.501 malloc 4194304 00:04:10.501 register 0x200000800000 6291456 00:04:10.501 buf 0x200000a00000 len 4194304 PASSED 00:04:10.501 free 0x200000500000 3145728 00:04:10.501 free 0x2000004fff40 64 00:04:10.501 unregister 0x200000400000 4194304 PASSED 00:04:10.501 free 0x200000a00000 4194304 00:04:10.501 unregister 0x200000800000 6291456 PASSED 00:04:10.501 malloc 8388608 00:04:10.501 register 0x200000400000 10485760 00:04:10.501 buf 0x200000600000 len 8388608 PASSED 00:04:10.501 free 0x200000600000 8388608 00:04:10.501 unregister 0x200000400000 10485760 PASSED 00:04:10.501 passed 00:04:10.501 00:04:10.501 Run Summary: Type Total Ran Passed Failed Inactive 00:04:10.501 suites 1 1 n/a 0 0 00:04:10.501 tests 1 1 1 0 0 00:04:10.501 asserts 15 15 15 0 n/a 00:04:10.501 00:04:10.501 Elapsed time = 0.005 seconds 00:04:10.501 00:04:10.501 real 0m0.050s 00:04:10.501 user 0m0.013s 00:04:10.501 sys 0m0.037s 00:04:10.501 00:57:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.501 00:57:00 -- common/autotest_common.sh@10 -- # set +x 00:04:10.501 ************************************ 00:04:10.501 END TEST env_mem_callbacks 00:04:10.501 ************************************ 00:04:10.501 00:04:10.501 real 0m6.389s 00:04:10.501 user 0m4.453s 00:04:10.501 sys 0m0.980s 00:04:10.501 00:57:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:10.501 00:57:00 -- common/autotest_common.sh@10 -- # set +x 00:04:10.501 ************************************ 00:04:10.501 END TEST env 00:04:10.501 ************************************ 00:04:10.501 00:57:00 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:10.501 00:57:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:10.501 00:57:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:10.501 00:57:00 -- common/autotest_common.sh@10 -- # set +x 00:04:10.501 ************************************ 00:04:10.501 START TEST rpc 00:04:10.501 ************************************ 00:04:10.501 00:57:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:10.501 * Looking for test storage... 00:04:10.501 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:10.501 00:57:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:10.501 00:57:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:10.501 00:57:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:10.501 00:57:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:10.501 00:57:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:10.501 00:57:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:10.501 00:57:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:10.501 00:57:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:10.501 00:57:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:10.501 00:57:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:10.501 00:57:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:10.501 00:57:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:10.501 00:57:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:10.501 00:57:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:10.501 00:57:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:10.501 00:57:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:10.501 00:57:01 -- scripts/common.sh@344 -- # : 1 00:04:10.501 00:57:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:10.501 00:57:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:10.501 00:57:01 -- scripts/common.sh@364 -- # decimal 1 00:04:10.501 00:57:01 -- scripts/common.sh@352 -- # local d=1 00:04:10.501 00:57:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:10.501 00:57:01 -- scripts/common.sh@354 -- # echo 1 00:04:10.501 00:57:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:10.501 00:57:01 -- scripts/common.sh@365 -- # decimal 2 00:04:10.501 00:57:01 -- scripts/common.sh@352 -- # local d=2 00:04:10.501 00:57:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:10.501 00:57:01 -- scripts/common.sh@354 -- # echo 2 00:04:10.501 00:57:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:10.501 00:57:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:10.501 00:57:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:10.501 00:57:01 -- scripts/common.sh@367 -- # return 0 00:04:10.501 00:57:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:10.501 00:57:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:10.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.501 --rc genhtml_branch_coverage=1 00:04:10.501 --rc genhtml_function_coverage=1 00:04:10.501 --rc genhtml_legend=1 00:04:10.501 --rc geninfo_all_blocks=1 00:04:10.501 --rc geninfo_unexecuted_blocks=1 00:04:10.501 00:04:10.501 ' 00:04:10.501 00:57:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:10.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.501 --rc genhtml_branch_coverage=1 00:04:10.501 --rc genhtml_function_coverage=1 00:04:10.501 --rc genhtml_legend=1 00:04:10.501 --rc geninfo_all_blocks=1 00:04:10.501 --rc geninfo_unexecuted_blocks=1 00:04:10.501 00:04:10.501 ' 00:04:10.501 00:57:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:10.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.501 --rc genhtml_branch_coverage=1 00:04:10.501 --rc genhtml_function_coverage=1 00:04:10.501 --rc genhtml_legend=1 00:04:10.501 --rc geninfo_all_blocks=1 00:04:10.501 --rc geninfo_unexecuted_blocks=1 00:04:10.501 00:04:10.501 ' 00:04:10.501 00:57:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:10.501 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:10.501 --rc genhtml_branch_coverage=1 00:04:10.501 --rc genhtml_function_coverage=1 00:04:10.501 --rc genhtml_legend=1 00:04:10.501 --rc geninfo_all_blocks=1 00:04:10.501 --rc geninfo_unexecuted_blocks=1 00:04:10.501 00:04:10.501 ' 00:04:10.501 00:57:01 -- rpc/rpc.sh@65 -- # spdk_pid=924197 00:04:10.501 00:57:01 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:10.501 00:57:01 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:10.501 00:57:01 -- rpc/rpc.sh@67 -- # waitforlisten 924197 00:04:10.501 00:57:01 -- common/autotest_common.sh@829 -- # '[' -z 924197 ']' 00:04:10.501 00:57:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:10.501 00:57:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:10.501 00:57:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:10.501 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:10.501 00:57:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:10.501 00:57:01 -- common/autotest_common.sh@10 -- # set +x 00:04:10.759 [2024-11-26 00:57:01.068839] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:10.759 [2024-11-26 00:57:01.068941] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid924197 ] 00:04:10.759 EAL: No free 2048 kB hugepages reported on node 1 00:04:10.759 [2024-11-26 00:57:01.127569] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:10.759 [2024-11-26 00:57:01.237720] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:10.759 [2024-11-26 00:57:01.237883] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:10.759 [2024-11-26 00:57:01.237904] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 924197' to capture a snapshot of events at runtime. 00:04:10.759 [2024-11-26 00:57:01.237918] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid924197 for offline analysis/debug. 00:04:10.759 [2024-11-26 00:57:01.237946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:11.692 00:57:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:11.692 00:57:02 -- common/autotest_common.sh@862 -- # return 0 00:04:11.692 00:57:02 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:11.692 00:57:02 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:11.692 00:57:02 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:11.692 00:57:02 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:11.692 00:57:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.692 00:57:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.692 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.692 ************************************ 00:04:11.692 START TEST rpc_integrity 00:04:11.692 ************************************ 00:04:11.692 00:57:02 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:11.692 00:57:02 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:11.692 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.692 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.692 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.692 00:57:02 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:11.692 00:57:02 -- rpc/rpc.sh@13 -- # jq length 00:04:11.692 00:57:02 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:11.692 00:57:02 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:11.692 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.692 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.692 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.692 00:57:02 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:11.692 00:57:02 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:11.692 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.692 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.692 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.692 00:57:02 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:11.692 { 00:04:11.692 "name": "Malloc0", 00:04:11.692 "aliases": [ 00:04:11.692 "44fadcdd-68d0-45e2-b930-136c2e95c39e" 00:04:11.692 ], 00:04:11.692 "product_name": "Malloc disk", 00:04:11.692 "block_size": 512, 00:04:11.692 "num_blocks": 16384, 00:04:11.692 "uuid": "44fadcdd-68d0-45e2-b930-136c2e95c39e", 00:04:11.692 "assigned_rate_limits": { 00:04:11.692 "rw_ios_per_sec": 0, 00:04:11.692 "rw_mbytes_per_sec": 0, 00:04:11.692 "r_mbytes_per_sec": 0, 00:04:11.692 "w_mbytes_per_sec": 0 00:04:11.692 }, 00:04:11.692 "claimed": false, 00:04:11.692 "zoned": false, 00:04:11.692 "supported_io_types": { 00:04:11.692 "read": true, 00:04:11.692 "write": true, 00:04:11.692 "unmap": true, 00:04:11.692 "write_zeroes": true, 00:04:11.692 "flush": true, 00:04:11.692 "reset": true, 00:04:11.692 "compare": false, 00:04:11.692 "compare_and_write": false, 00:04:11.692 "abort": true, 00:04:11.692 "nvme_admin": false, 00:04:11.692 "nvme_io": false 00:04:11.692 }, 00:04:11.692 "memory_domains": [ 00:04:11.692 { 00:04:11.692 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.692 "dma_device_type": 2 00:04:11.692 } 00:04:11.692 ], 00:04:11.692 "driver_specific": {} 00:04:11.692 } 00:04:11.692 ]' 00:04:11.692 00:57:02 -- rpc/rpc.sh@17 -- # jq length 00:04:11.692 00:57:02 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:11.692 00:57:02 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:11.692 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.692 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.692 [2024-11-26 00:57:02.152154] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:11.692 [2024-11-26 00:57:02.152202] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:11.692 [2024-11-26 00:57:02.152227] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xb4ccb0 00:04:11.692 [2024-11-26 00:57:02.152243] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:11.692 [2024-11-26 00:57:02.153671] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:11.692 [2024-11-26 00:57:02.153715] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:11.692 Passthru0 00:04:11.692 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.692 00:57:02 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:11.692 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.692 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.692 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.692 00:57:02 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:11.692 { 00:04:11.692 "name": "Malloc0", 00:04:11.692 "aliases": [ 00:04:11.692 "44fadcdd-68d0-45e2-b930-136c2e95c39e" 00:04:11.692 ], 00:04:11.692 "product_name": "Malloc disk", 00:04:11.692 "block_size": 512, 00:04:11.692 "num_blocks": 16384, 00:04:11.692 "uuid": "44fadcdd-68d0-45e2-b930-136c2e95c39e", 00:04:11.692 "assigned_rate_limits": { 00:04:11.692 "rw_ios_per_sec": 0, 00:04:11.693 "rw_mbytes_per_sec": 0, 00:04:11.693 "r_mbytes_per_sec": 0, 00:04:11.693 "w_mbytes_per_sec": 0 00:04:11.693 }, 00:04:11.693 "claimed": true, 00:04:11.693 "claim_type": "exclusive_write", 00:04:11.693 "zoned": false, 00:04:11.693 "supported_io_types": { 00:04:11.693 "read": true, 00:04:11.693 "write": true, 00:04:11.693 "unmap": true, 00:04:11.693 "write_zeroes": true, 00:04:11.693 "flush": true, 00:04:11.693 "reset": true, 00:04:11.693 "compare": false, 00:04:11.693 "compare_and_write": false, 00:04:11.693 "abort": true, 00:04:11.693 "nvme_admin": false, 00:04:11.693 "nvme_io": false 00:04:11.693 }, 00:04:11.693 "memory_domains": [ 00:04:11.693 { 00:04:11.693 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.693 "dma_device_type": 2 00:04:11.693 } 00:04:11.693 ], 00:04:11.693 "driver_specific": {} 00:04:11.693 }, 00:04:11.693 { 00:04:11.693 "name": "Passthru0", 00:04:11.693 "aliases": [ 00:04:11.693 "4ebcb524-7cd6-5ed1-b388-49b6bc9404af" 00:04:11.693 ], 00:04:11.693 "product_name": "passthru", 00:04:11.693 "block_size": 512, 00:04:11.693 "num_blocks": 16384, 00:04:11.693 "uuid": "4ebcb524-7cd6-5ed1-b388-49b6bc9404af", 00:04:11.693 "assigned_rate_limits": { 00:04:11.693 "rw_ios_per_sec": 0, 00:04:11.693 "rw_mbytes_per_sec": 0, 00:04:11.693 "r_mbytes_per_sec": 0, 00:04:11.693 "w_mbytes_per_sec": 0 00:04:11.693 }, 00:04:11.693 "claimed": false, 00:04:11.693 "zoned": false, 00:04:11.693 "supported_io_types": { 00:04:11.693 "read": true, 00:04:11.693 "write": true, 00:04:11.693 "unmap": true, 00:04:11.693 "write_zeroes": true, 00:04:11.693 "flush": true, 00:04:11.693 "reset": true, 00:04:11.693 "compare": false, 00:04:11.693 "compare_and_write": false, 00:04:11.693 "abort": true, 00:04:11.693 "nvme_admin": false, 00:04:11.693 "nvme_io": false 00:04:11.693 }, 00:04:11.693 "memory_domains": [ 00:04:11.693 { 00:04:11.693 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.693 "dma_device_type": 2 00:04:11.693 } 00:04:11.693 ], 00:04:11.693 "driver_specific": { 00:04:11.693 "passthru": { 00:04:11.693 "name": "Passthru0", 00:04:11.693 "base_bdev_name": "Malloc0" 00:04:11.693 } 00:04:11.693 } 00:04:11.693 } 00:04:11.693 ]' 00:04:11.693 00:57:02 -- rpc/rpc.sh@21 -- # jq length 00:04:11.693 00:57:02 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:11.693 00:57:02 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:11.693 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.693 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.693 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.693 00:57:02 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:11.693 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.693 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.950 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.950 00:57:02 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:11.950 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.950 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.950 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.950 00:57:02 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:11.950 00:57:02 -- rpc/rpc.sh@26 -- # jq length 00:04:11.951 00:57:02 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:11.951 00:04:11.951 real 0m0.231s 00:04:11.951 user 0m0.157s 00:04:11.951 sys 0m0.017s 00:04:11.951 00:57:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 ************************************ 00:04:11.951 END TEST rpc_integrity 00:04:11.951 ************************************ 00:04:11.951 00:57:02 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:11.951 00:57:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.951 00:57:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 ************************************ 00:04:11.951 START TEST rpc_plugins 00:04:11.951 ************************************ 00:04:11.951 00:57:02 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:11.951 00:57:02 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:11.951 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.951 00:57:02 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:11.951 00:57:02 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:11.951 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.951 00:57:02 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:11.951 { 00:04:11.951 "name": "Malloc1", 00:04:11.951 "aliases": [ 00:04:11.951 "3e95fba0-43ff-4680-b965-6c878777c413" 00:04:11.951 ], 00:04:11.951 "product_name": "Malloc disk", 00:04:11.951 "block_size": 4096, 00:04:11.951 "num_blocks": 256, 00:04:11.951 "uuid": "3e95fba0-43ff-4680-b965-6c878777c413", 00:04:11.951 "assigned_rate_limits": { 00:04:11.951 "rw_ios_per_sec": 0, 00:04:11.951 "rw_mbytes_per_sec": 0, 00:04:11.951 "r_mbytes_per_sec": 0, 00:04:11.951 "w_mbytes_per_sec": 0 00:04:11.951 }, 00:04:11.951 "claimed": false, 00:04:11.951 "zoned": false, 00:04:11.951 "supported_io_types": { 00:04:11.951 "read": true, 00:04:11.951 "write": true, 00:04:11.951 "unmap": true, 00:04:11.951 "write_zeroes": true, 00:04:11.951 "flush": true, 00:04:11.951 "reset": true, 00:04:11.951 "compare": false, 00:04:11.951 "compare_and_write": false, 00:04:11.951 "abort": true, 00:04:11.951 "nvme_admin": false, 00:04:11.951 "nvme_io": false 00:04:11.951 }, 00:04:11.951 "memory_domains": [ 00:04:11.951 { 00:04:11.951 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:11.951 "dma_device_type": 2 00:04:11.951 } 00:04:11.951 ], 00:04:11.951 "driver_specific": {} 00:04:11.951 } 00:04:11.951 ]' 00:04:11.951 00:57:02 -- rpc/rpc.sh@32 -- # jq length 00:04:11.951 00:57:02 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:11.951 00:57:02 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:11.951 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.951 00:57:02 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:11.951 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.951 00:57:02 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:11.951 00:57:02 -- rpc/rpc.sh@36 -- # jq length 00:04:11.951 00:57:02 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:11.951 00:04:11.951 real 0m0.113s 00:04:11.951 user 0m0.076s 00:04:11.951 sys 0m0.009s 00:04:11.951 00:57:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 ************************************ 00:04:11.951 END TEST rpc_plugins 00:04:11.951 ************************************ 00:04:11.951 00:57:02 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:11.951 00:57:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.951 00:57:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 ************************************ 00:04:11.951 START TEST rpc_trace_cmd_test 00:04:11.951 ************************************ 00:04:11.951 00:57:02 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:11.951 00:57:02 -- rpc/rpc.sh@40 -- # local info 00:04:11.951 00:57:02 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:11.951 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:11.951 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:11.951 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:11.951 00:57:02 -- rpc/rpc.sh@42 -- # info='{ 00:04:11.951 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid924197", 00:04:11.951 "tpoint_group_mask": "0x8", 00:04:11.951 "iscsi_conn": { 00:04:11.951 "mask": "0x2", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "scsi": { 00:04:11.951 "mask": "0x4", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "bdev": { 00:04:11.951 "mask": "0x8", 00:04:11.951 "tpoint_mask": "0xffffffffffffffff" 00:04:11.951 }, 00:04:11.951 "nvmf_rdma": { 00:04:11.951 "mask": "0x10", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "nvmf_tcp": { 00:04:11.951 "mask": "0x20", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "ftl": { 00:04:11.951 "mask": "0x40", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "blobfs": { 00:04:11.951 "mask": "0x80", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "dsa": { 00:04:11.951 "mask": "0x200", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "thread": { 00:04:11.951 "mask": "0x400", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "nvme_pcie": { 00:04:11.951 "mask": "0x800", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "iaa": { 00:04:11.951 "mask": "0x1000", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "nvme_tcp": { 00:04:11.951 "mask": "0x2000", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 }, 00:04:11.951 "bdev_nvme": { 00:04:11.951 "mask": "0x4000", 00:04:11.951 "tpoint_mask": "0x0" 00:04:11.951 } 00:04:11.951 }' 00:04:11.951 00:57:02 -- rpc/rpc.sh@43 -- # jq length 00:04:12.209 00:57:02 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:12.209 00:57:02 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:12.209 00:57:02 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:12.209 00:57:02 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:12.209 00:57:02 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:12.209 00:57:02 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:12.209 00:57:02 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:12.209 00:57:02 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:12.209 00:57:02 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:12.209 00:04:12.209 real 0m0.203s 00:04:12.209 user 0m0.184s 00:04:12.209 sys 0m0.011s 00:04:12.209 00:57:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.209 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.209 ************************************ 00:04:12.209 END TEST rpc_trace_cmd_test 00:04:12.209 ************************************ 00:04:12.209 00:57:02 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:12.209 00:57:02 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:12.209 00:57:02 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:12.209 00:57:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:12.209 00:57:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:12.209 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.209 ************************************ 00:04:12.209 START TEST rpc_daemon_integrity 00:04:12.209 ************************************ 00:04:12.209 00:57:02 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:12.209 00:57:02 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:12.209 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.209 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.209 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.209 00:57:02 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:12.209 00:57:02 -- rpc/rpc.sh@13 -- # jq length 00:04:12.209 00:57:02 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:12.209 00:57:02 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:12.209 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.209 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.209 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.209 00:57:02 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:12.209 00:57:02 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:12.209 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.209 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.209 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.209 00:57:02 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:12.209 { 00:04:12.209 "name": "Malloc2", 00:04:12.209 "aliases": [ 00:04:12.209 "d63a5526-1741-45a2-bde4-712103c1963c" 00:04:12.209 ], 00:04:12.209 "product_name": "Malloc disk", 00:04:12.209 "block_size": 512, 00:04:12.209 "num_blocks": 16384, 00:04:12.209 "uuid": "d63a5526-1741-45a2-bde4-712103c1963c", 00:04:12.209 "assigned_rate_limits": { 00:04:12.209 "rw_ios_per_sec": 0, 00:04:12.209 "rw_mbytes_per_sec": 0, 00:04:12.209 "r_mbytes_per_sec": 0, 00:04:12.209 "w_mbytes_per_sec": 0 00:04:12.209 }, 00:04:12.209 "claimed": false, 00:04:12.209 "zoned": false, 00:04:12.209 "supported_io_types": { 00:04:12.209 "read": true, 00:04:12.209 "write": true, 00:04:12.209 "unmap": true, 00:04:12.209 "write_zeroes": true, 00:04:12.209 "flush": true, 00:04:12.209 "reset": true, 00:04:12.209 "compare": false, 00:04:12.209 "compare_and_write": false, 00:04:12.209 "abort": true, 00:04:12.209 "nvme_admin": false, 00:04:12.209 "nvme_io": false 00:04:12.209 }, 00:04:12.209 "memory_domains": [ 00:04:12.209 { 00:04:12.209 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:12.209 "dma_device_type": 2 00:04:12.209 } 00:04:12.209 ], 00:04:12.209 "driver_specific": {} 00:04:12.209 } 00:04:12.209 ]' 00:04:12.209 00:57:02 -- rpc/rpc.sh@17 -- # jq length 00:04:12.468 00:57:02 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:12.468 00:57:02 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:12.468 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.468 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.468 [2024-11-26 00:57:02.774036] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:12.468 [2024-11-26 00:57:02.774083] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:12.468 [2024-11-26 00:57:02.774108] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xb4e590 00:04:12.468 [2024-11-26 00:57:02.774123] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:12.468 [2024-11-26 00:57:02.775451] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:12.468 [2024-11-26 00:57:02.775479] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:12.468 Passthru0 00:04:12.468 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.468 00:57:02 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:12.468 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.468 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.468 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.468 00:57:02 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:12.468 { 00:04:12.468 "name": "Malloc2", 00:04:12.468 "aliases": [ 00:04:12.468 "d63a5526-1741-45a2-bde4-712103c1963c" 00:04:12.468 ], 00:04:12.468 "product_name": "Malloc disk", 00:04:12.468 "block_size": 512, 00:04:12.468 "num_blocks": 16384, 00:04:12.468 "uuid": "d63a5526-1741-45a2-bde4-712103c1963c", 00:04:12.468 "assigned_rate_limits": { 00:04:12.468 "rw_ios_per_sec": 0, 00:04:12.468 "rw_mbytes_per_sec": 0, 00:04:12.468 "r_mbytes_per_sec": 0, 00:04:12.468 "w_mbytes_per_sec": 0 00:04:12.468 }, 00:04:12.468 "claimed": true, 00:04:12.468 "claim_type": "exclusive_write", 00:04:12.468 "zoned": false, 00:04:12.468 "supported_io_types": { 00:04:12.468 "read": true, 00:04:12.468 "write": true, 00:04:12.468 "unmap": true, 00:04:12.468 "write_zeroes": true, 00:04:12.468 "flush": true, 00:04:12.468 "reset": true, 00:04:12.468 "compare": false, 00:04:12.468 "compare_and_write": false, 00:04:12.468 "abort": true, 00:04:12.468 "nvme_admin": false, 00:04:12.468 "nvme_io": false 00:04:12.468 }, 00:04:12.468 "memory_domains": [ 00:04:12.468 { 00:04:12.468 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:12.468 "dma_device_type": 2 00:04:12.468 } 00:04:12.468 ], 00:04:12.468 "driver_specific": {} 00:04:12.468 }, 00:04:12.468 { 00:04:12.468 "name": "Passthru0", 00:04:12.468 "aliases": [ 00:04:12.468 "03581b50-5d9c-5d2d-ba67-d2aa98a9b226" 00:04:12.468 ], 00:04:12.468 "product_name": "passthru", 00:04:12.468 "block_size": 512, 00:04:12.468 "num_blocks": 16384, 00:04:12.468 "uuid": "03581b50-5d9c-5d2d-ba67-d2aa98a9b226", 00:04:12.468 "assigned_rate_limits": { 00:04:12.468 "rw_ios_per_sec": 0, 00:04:12.468 "rw_mbytes_per_sec": 0, 00:04:12.468 "r_mbytes_per_sec": 0, 00:04:12.468 "w_mbytes_per_sec": 0 00:04:12.468 }, 00:04:12.468 "claimed": false, 00:04:12.468 "zoned": false, 00:04:12.468 "supported_io_types": { 00:04:12.468 "read": true, 00:04:12.468 "write": true, 00:04:12.468 "unmap": true, 00:04:12.468 "write_zeroes": true, 00:04:12.468 "flush": true, 00:04:12.468 "reset": true, 00:04:12.468 "compare": false, 00:04:12.468 "compare_and_write": false, 00:04:12.468 "abort": true, 00:04:12.468 "nvme_admin": false, 00:04:12.468 "nvme_io": false 00:04:12.468 }, 00:04:12.468 "memory_domains": [ 00:04:12.468 { 00:04:12.468 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:12.468 "dma_device_type": 2 00:04:12.468 } 00:04:12.468 ], 00:04:12.468 "driver_specific": { 00:04:12.468 "passthru": { 00:04:12.468 "name": "Passthru0", 00:04:12.468 "base_bdev_name": "Malloc2" 00:04:12.468 } 00:04:12.468 } 00:04:12.468 } 00:04:12.468 ]' 00:04:12.468 00:57:02 -- rpc/rpc.sh@21 -- # jq length 00:04:12.468 00:57:02 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:12.468 00:57:02 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:12.468 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.468 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.468 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.468 00:57:02 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:12.468 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.468 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.468 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.468 00:57:02 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:12.468 00:57:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:12.468 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.468 00:57:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:12.468 00:57:02 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:12.468 00:57:02 -- rpc/rpc.sh@26 -- # jq length 00:04:12.468 00:57:02 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:12.468 00:04:12.468 real 0m0.228s 00:04:12.468 user 0m0.150s 00:04:12.468 sys 0m0.022s 00:04:12.468 00:57:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:12.468 00:57:02 -- common/autotest_common.sh@10 -- # set +x 00:04:12.468 ************************************ 00:04:12.468 END TEST rpc_daemon_integrity 00:04:12.468 ************************************ 00:04:12.468 00:57:02 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:12.468 00:57:02 -- rpc/rpc.sh@84 -- # killprocess 924197 00:04:12.468 00:57:02 -- common/autotest_common.sh@936 -- # '[' -z 924197 ']' 00:04:12.468 00:57:02 -- common/autotest_common.sh@940 -- # kill -0 924197 00:04:12.468 00:57:02 -- common/autotest_common.sh@941 -- # uname 00:04:12.468 00:57:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:12.468 00:57:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 924197 00:04:12.468 00:57:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:12.468 00:57:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:12.468 00:57:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 924197' 00:04:12.468 killing process with pid 924197 00:04:12.468 00:57:02 -- common/autotest_common.sh@955 -- # kill 924197 00:04:12.468 00:57:02 -- common/autotest_common.sh@960 -- # wait 924197 00:04:13.032 00:04:13.032 real 0m2.536s 00:04:13.032 user 0m3.216s 00:04:13.032 sys 0m0.591s 00:04:13.032 00:57:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.032 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.032 ************************************ 00:04:13.032 END TEST rpc 00:04:13.032 ************************************ 00:04:13.032 00:57:03 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:13.032 00:57:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.032 00:57:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.032 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.032 ************************************ 00:04:13.032 START TEST rpc_client 00:04:13.032 ************************************ 00:04:13.032 00:57:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:13.032 * Looking for test storage... 00:04:13.032 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:13.032 00:57:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:13.032 00:57:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:13.032 00:57:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:13.291 00:57:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:13.291 00:57:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:13.291 00:57:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:13.291 00:57:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:13.291 00:57:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:13.291 00:57:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:13.291 00:57:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:13.291 00:57:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:13.291 00:57:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:13.291 00:57:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:13.291 00:57:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:13.291 00:57:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:13.291 00:57:03 -- scripts/common.sh@344 -- # : 1 00:04:13.291 00:57:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:13.291 00:57:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:13.291 00:57:03 -- scripts/common.sh@364 -- # decimal 1 00:04:13.291 00:57:03 -- scripts/common.sh@352 -- # local d=1 00:04:13.291 00:57:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:13.291 00:57:03 -- scripts/common.sh@354 -- # echo 1 00:04:13.291 00:57:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:13.291 00:57:03 -- scripts/common.sh@365 -- # decimal 2 00:04:13.291 00:57:03 -- scripts/common.sh@352 -- # local d=2 00:04:13.291 00:57:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:13.291 00:57:03 -- scripts/common.sh@354 -- # echo 2 00:04:13.291 00:57:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:13.291 00:57:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:13.291 00:57:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:13.291 00:57:03 -- scripts/common.sh@367 -- # return 0 00:04:13.291 00:57:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:13.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.291 --rc genhtml_branch_coverage=1 00:04:13.291 --rc genhtml_function_coverage=1 00:04:13.291 --rc genhtml_legend=1 00:04:13.291 --rc geninfo_all_blocks=1 00:04:13.291 --rc geninfo_unexecuted_blocks=1 00:04:13.291 00:04:13.291 ' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:13.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.291 --rc genhtml_branch_coverage=1 00:04:13.291 --rc genhtml_function_coverage=1 00:04:13.291 --rc genhtml_legend=1 00:04:13.291 --rc geninfo_all_blocks=1 00:04:13.291 --rc geninfo_unexecuted_blocks=1 00:04:13.291 00:04:13.291 ' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:13.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.291 --rc genhtml_branch_coverage=1 00:04:13.291 --rc genhtml_function_coverage=1 00:04:13.291 --rc genhtml_legend=1 00:04:13.291 --rc geninfo_all_blocks=1 00:04:13.291 --rc geninfo_unexecuted_blocks=1 00:04:13.291 00:04:13.291 ' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:13.291 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.291 --rc genhtml_branch_coverage=1 00:04:13.291 --rc genhtml_function_coverage=1 00:04:13.291 --rc genhtml_legend=1 00:04:13.291 --rc geninfo_all_blocks=1 00:04:13.291 --rc geninfo_unexecuted_blocks=1 00:04:13.291 00:04:13.291 ' 00:04:13.291 00:57:03 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:13.291 OK 00:04:13.291 00:57:03 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:13.291 00:04:13.291 real 0m0.149s 00:04:13.291 user 0m0.093s 00:04:13.291 sys 0m0.064s 00:04:13.291 00:57:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.291 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.291 ************************************ 00:04:13.291 END TEST rpc_client 00:04:13.291 ************************************ 00:04:13.291 00:57:03 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:13.291 00:57:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.291 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.291 ************************************ 00:04:13.291 START TEST json_config 00:04:13.291 ************************************ 00:04:13.291 00:57:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:13.291 00:57:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:13.291 00:57:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:13.291 00:57:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:13.291 00:57:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:13.291 00:57:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:13.291 00:57:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:13.291 00:57:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:13.291 00:57:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:13.291 00:57:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:13.291 00:57:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:13.291 00:57:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:13.291 00:57:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:13.291 00:57:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:13.291 00:57:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:13.291 00:57:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:13.291 00:57:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:13.291 00:57:03 -- scripts/common.sh@344 -- # : 1 00:04:13.291 00:57:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:13.291 00:57:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:13.291 00:57:03 -- scripts/common.sh@364 -- # decimal 1 00:04:13.291 00:57:03 -- scripts/common.sh@352 -- # local d=1 00:04:13.291 00:57:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:13.291 00:57:03 -- scripts/common.sh@354 -- # echo 1 00:04:13.291 00:57:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:13.292 00:57:03 -- scripts/common.sh@365 -- # decimal 2 00:04:13.292 00:57:03 -- scripts/common.sh@352 -- # local d=2 00:04:13.292 00:57:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:13.292 00:57:03 -- scripts/common.sh@354 -- # echo 2 00:04:13.292 00:57:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:13.292 00:57:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:13.292 00:57:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:13.292 00:57:03 -- scripts/common.sh@367 -- # return 0 00:04:13.292 00:57:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:13.292 00:57:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:13.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.292 --rc genhtml_branch_coverage=1 00:04:13.292 --rc genhtml_function_coverage=1 00:04:13.292 --rc genhtml_legend=1 00:04:13.292 --rc geninfo_all_blocks=1 00:04:13.292 --rc geninfo_unexecuted_blocks=1 00:04:13.292 00:04:13.292 ' 00:04:13.292 00:57:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:13.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.292 --rc genhtml_branch_coverage=1 00:04:13.292 --rc genhtml_function_coverage=1 00:04:13.292 --rc genhtml_legend=1 00:04:13.292 --rc geninfo_all_blocks=1 00:04:13.292 --rc geninfo_unexecuted_blocks=1 00:04:13.292 00:04:13.292 ' 00:04:13.292 00:57:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:13.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.292 --rc genhtml_branch_coverage=1 00:04:13.292 --rc genhtml_function_coverage=1 00:04:13.292 --rc genhtml_legend=1 00:04:13.292 --rc geninfo_all_blocks=1 00:04:13.292 --rc geninfo_unexecuted_blocks=1 00:04:13.292 00:04:13.292 ' 00:04:13.292 00:57:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:13.292 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:13.292 --rc genhtml_branch_coverage=1 00:04:13.292 --rc genhtml_function_coverage=1 00:04:13.292 --rc genhtml_legend=1 00:04:13.292 --rc geninfo_all_blocks=1 00:04:13.292 --rc geninfo_unexecuted_blocks=1 00:04:13.292 00:04:13.292 ' 00:04:13.292 00:57:03 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:13.292 00:57:03 -- nvmf/common.sh@7 -- # uname -s 00:04:13.292 00:57:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:13.292 00:57:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:13.292 00:57:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:13.292 00:57:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:13.292 00:57:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:13.292 00:57:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:13.292 00:57:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:13.292 00:57:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:13.292 00:57:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:13.292 00:57:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:13.292 00:57:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:13.292 00:57:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:13.292 00:57:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:13.292 00:57:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:13.292 00:57:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:13.292 00:57:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:13.292 00:57:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:13.292 00:57:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:13.292 00:57:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:13.292 00:57:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:13.292 00:57:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:13.292 00:57:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:13.292 00:57:03 -- paths/export.sh@5 -- # export PATH 00:04:13.292 00:57:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:13.292 00:57:03 -- nvmf/common.sh@46 -- # : 0 00:04:13.292 00:57:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:13.292 00:57:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:13.292 00:57:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:13.292 00:57:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:13.292 00:57:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:13.292 00:57:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:13.292 00:57:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:13.292 00:57:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:13.292 00:57:03 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:13.292 00:57:03 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:13.292 00:57:03 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:13.292 00:57:03 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:13.292 00:57:03 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:13.292 00:57:03 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:13.292 00:57:03 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:13.292 00:57:03 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:13.292 00:57:03 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:13.292 00:57:03 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:13.292 00:57:03 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:13.292 00:57:03 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:13.292 INFO: JSON configuration test init 00:04:13.292 00:57:03 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:13.292 00:57:03 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:13.292 00:57:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:13.292 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.292 00:57:03 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:13.292 00:57:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:13.292 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.292 00:57:03 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:13.292 00:57:03 -- json_config/json_config.sh@98 -- # local app=target 00:04:13.292 00:57:03 -- json_config/json_config.sh@99 -- # shift 00:04:13.292 00:57:03 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:13.292 00:57:03 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:13.292 00:57:03 -- json_config/json_config.sh@111 -- # app_pid[$app]=924753 00:04:13.292 00:57:03 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:13.292 00:57:03 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:13.292 Waiting for target to run... 00:04:13.292 00:57:03 -- json_config/json_config.sh@114 -- # waitforlisten 924753 /var/tmp/spdk_tgt.sock 00:04:13.292 00:57:03 -- common/autotest_common.sh@829 -- # '[' -z 924753 ']' 00:04:13.292 00:57:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:13.292 00:57:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:13.292 00:57:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:13.292 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:13.292 00:57:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:13.292 00:57:03 -- common/autotest_common.sh@10 -- # set +x 00:04:13.292 [2024-11-26 00:57:03.804526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:13.292 [2024-11-26 00:57:03.804627] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid924753 ] 00:04:13.550 EAL: No free 2048 kB hugepages reported on node 1 00:04:13.807 [2024-11-26 00:57:04.165424] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:13.807 [2024-11-26 00:57:04.252289] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:13.807 [2024-11-26 00:57:04.252492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:14.373 00:57:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:14.373 00:57:04 -- common/autotest_common.sh@862 -- # return 0 00:04:14.373 00:57:04 -- json_config/json_config.sh@115 -- # echo '' 00:04:14.373 00:04:14.373 00:57:04 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:14.373 00:57:04 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:14.373 00:57:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:14.373 00:57:04 -- common/autotest_common.sh@10 -- # set +x 00:04:14.373 00:57:04 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:14.373 00:57:04 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:14.373 00:57:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:14.373 00:57:04 -- common/autotest_common.sh@10 -- # set +x 00:04:14.373 00:57:04 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:14.373 00:57:04 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:14.373 00:57:04 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:17.658 00:57:07 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:17.658 00:57:07 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:17.658 00:57:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:17.658 00:57:07 -- common/autotest_common.sh@10 -- # set +x 00:04:17.658 00:57:07 -- json_config/json_config.sh@48 -- # local ret=0 00:04:17.658 00:57:07 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:17.658 00:57:07 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:17.658 00:57:07 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:17.658 00:57:07 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:17.658 00:57:07 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:17.916 00:57:08 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:17.916 00:57:08 -- json_config/json_config.sh@51 -- # local get_types 00:04:17.916 00:57:08 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:17.916 00:57:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:17.916 00:57:08 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 00:57:08 -- json_config/json_config.sh@58 -- # return 0 00:04:17.916 00:57:08 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:17.916 00:57:08 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:17.916 00:57:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:17.916 00:57:08 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 00:57:08 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:17.916 00:57:08 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:17.916 00:57:08 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:17.916 00:57:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:18.173 MallocForNvmf0 00:04:18.173 00:57:08 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:18.173 00:57:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:18.430 MallocForNvmf1 00:04:18.430 00:57:08 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:18.430 00:57:08 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:18.687 [2024-11-26 00:57:09.041465] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:18.687 00:57:09 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:18.687 00:57:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:18.943 00:57:09 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:18.943 00:57:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:19.200 00:57:09 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:19.200 00:57:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:19.457 00:57:09 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:19.457 00:57:09 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:19.714 [2024-11-26 00:57:10.056984] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:19.714 00:57:10 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:19.714 00:57:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:19.714 00:57:10 -- common/autotest_common.sh@10 -- # set +x 00:04:19.714 00:57:10 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:19.714 00:57:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:19.714 00:57:10 -- common/autotest_common.sh@10 -- # set +x 00:04:19.714 00:57:10 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:19.714 00:57:10 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:19.714 00:57:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:19.972 MallocBdevForConfigChangeCheck 00:04:19.972 00:57:10 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:19.972 00:57:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:19.972 00:57:10 -- common/autotest_common.sh@10 -- # set +x 00:04:19.972 00:57:10 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:19.972 00:57:10 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:20.538 00:57:10 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:20.538 INFO: shutting down applications... 00:04:20.538 00:57:10 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:20.538 00:57:10 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:20.538 00:57:10 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:20.538 00:57:10 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:21.914 Calling clear_iscsi_subsystem 00:04:21.914 Calling clear_nvmf_subsystem 00:04:21.914 Calling clear_nbd_subsystem 00:04:21.914 Calling clear_ublk_subsystem 00:04:21.914 Calling clear_vhost_blk_subsystem 00:04:21.914 Calling clear_vhost_scsi_subsystem 00:04:21.914 Calling clear_scheduler_subsystem 00:04:21.914 Calling clear_bdev_subsystem 00:04:21.914 Calling clear_accel_subsystem 00:04:21.914 Calling clear_vmd_subsystem 00:04:21.914 Calling clear_sock_subsystem 00:04:21.914 Calling clear_iobuf_subsystem 00:04:21.914 00:57:12 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:21.914 00:57:12 -- json_config/json_config.sh@396 -- # count=100 00:04:21.914 00:57:12 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:21.914 00:57:12 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:21.914 00:57:12 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:21.914 00:57:12 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:22.480 00:57:12 -- json_config/json_config.sh@398 -- # break 00:04:22.480 00:57:12 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:22.480 00:57:12 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:22.480 00:57:12 -- json_config/json_config.sh@120 -- # local app=target 00:04:22.480 00:57:12 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:22.480 00:57:12 -- json_config/json_config.sh@124 -- # [[ -n 924753 ]] 00:04:22.480 00:57:12 -- json_config/json_config.sh@127 -- # kill -SIGINT 924753 00:04:22.480 00:57:12 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:22.480 00:57:12 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:22.480 00:57:12 -- json_config/json_config.sh@130 -- # kill -0 924753 00:04:22.480 00:57:12 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:23.049 00:57:13 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:23.049 00:57:13 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:23.049 00:57:13 -- json_config/json_config.sh@130 -- # kill -0 924753 00:04:23.049 00:57:13 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:23.049 00:57:13 -- json_config/json_config.sh@132 -- # break 00:04:23.049 00:57:13 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:23.049 00:57:13 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:23.049 SPDK target shutdown done 00:04:23.049 00:57:13 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:23.049 INFO: relaunching applications... 00:04:23.049 00:57:13 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.049 00:57:13 -- json_config/json_config.sh@98 -- # local app=target 00:04:23.049 00:57:13 -- json_config/json_config.sh@99 -- # shift 00:04:23.049 00:57:13 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:23.049 00:57:13 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:23.049 00:57:13 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:23.049 00:57:13 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:23.049 00:57:13 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:23.049 00:57:13 -- json_config/json_config.sh@111 -- # app_pid[$app]=926602 00:04:23.049 00:57:13 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:23.049 00:57:13 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:23.049 Waiting for target to run... 00:04:23.049 00:57:13 -- json_config/json_config.sh@114 -- # waitforlisten 926602 /var/tmp/spdk_tgt.sock 00:04:23.049 00:57:13 -- common/autotest_common.sh@829 -- # '[' -z 926602 ']' 00:04:23.049 00:57:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:23.049 00:57:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:23.049 00:57:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:23.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:23.049 00:57:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:23.049 00:57:13 -- common/autotest_common.sh@10 -- # set +x 00:04:23.049 [2024-11-26 00:57:13.323028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:23.049 [2024-11-26 00:57:13.323143] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid926602 ] 00:04:23.049 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.308 [2024-11-26 00:57:13.687493] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:23.308 [2024-11-26 00:57:13.773636] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:23.308 [2024-11-26 00:57:13.773857] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:26.589 [2024-11-26 00:57:16.806568] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:26.589 [2024-11-26 00:57:16.839136] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:26.846 00:57:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:26.846 00:57:17 -- common/autotest_common.sh@862 -- # return 0 00:04:26.846 00:57:17 -- json_config/json_config.sh@115 -- # echo '' 00:04:26.846 00:04:26.846 00:57:17 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:26.846 00:57:17 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:26.846 INFO: Checking if target configuration is the same... 00:04:26.846 00:57:17 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.846 00:57:17 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:26.846 00:57:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:26.846 + '[' 2 -ne 2 ']' 00:04:26.846 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:26.846 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:26.846 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:26.846 +++ basename /dev/fd/62 00:04:26.846 ++ mktemp /tmp/62.XXX 00:04:26.846 + tmp_file_1=/tmp/62.1hA 00:04:26.846 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:26.846 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:26.846 + tmp_file_2=/tmp/spdk_tgt_config.json.zmn 00:04:26.846 + ret=0 00:04:26.846 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:27.410 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:27.410 + diff -u /tmp/62.1hA /tmp/spdk_tgt_config.json.zmn 00:04:27.410 + echo 'INFO: JSON config files are the same' 00:04:27.410 INFO: JSON config files are the same 00:04:27.410 + rm /tmp/62.1hA /tmp/spdk_tgt_config.json.zmn 00:04:27.410 + exit 0 00:04:27.410 00:57:17 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:27.410 00:57:17 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:27.410 INFO: changing configuration and checking if this can be detected... 00:04:27.410 00:57:17 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:27.410 00:57:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:27.668 00:57:17 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:27.668 00:57:17 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:27.668 00:57:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:27.668 + '[' 2 -ne 2 ']' 00:04:27.668 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:27.668 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:27.668 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:27.668 +++ basename /dev/fd/62 00:04:27.668 ++ mktemp /tmp/62.XXX 00:04:27.668 + tmp_file_1=/tmp/62.cVS 00:04:27.668 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:27.668 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:27.668 + tmp_file_2=/tmp/spdk_tgt_config.json.WV4 00:04:27.668 + ret=0 00:04:27.668 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:27.926 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:27.926 + diff -u /tmp/62.cVS /tmp/spdk_tgt_config.json.WV4 00:04:27.926 + ret=1 00:04:27.926 + echo '=== Start of file: /tmp/62.cVS ===' 00:04:27.926 + cat /tmp/62.cVS 00:04:27.926 + echo '=== End of file: /tmp/62.cVS ===' 00:04:27.926 + echo '' 00:04:27.926 + echo '=== Start of file: /tmp/spdk_tgt_config.json.WV4 ===' 00:04:27.926 + cat /tmp/spdk_tgt_config.json.WV4 00:04:27.926 + echo '=== End of file: /tmp/spdk_tgt_config.json.WV4 ===' 00:04:27.926 + echo '' 00:04:27.926 + rm /tmp/62.cVS /tmp/spdk_tgt_config.json.WV4 00:04:27.926 + exit 1 00:04:27.926 00:57:18 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:27.926 INFO: configuration change detected. 00:04:27.926 00:57:18 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:27.926 00:57:18 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:27.926 00:57:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.926 00:57:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.926 00:57:18 -- json_config/json_config.sh@360 -- # local ret=0 00:04:27.926 00:57:18 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:27.926 00:57:18 -- json_config/json_config.sh@370 -- # [[ -n 926602 ]] 00:04:27.926 00:57:18 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:27.926 00:57:18 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:27.926 00:57:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:27.926 00:57:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.926 00:57:18 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:27.926 00:57:18 -- json_config/json_config.sh@246 -- # uname -s 00:04:27.926 00:57:18 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:27.926 00:57:18 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:27.926 00:57:18 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:27.926 00:57:18 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:27.926 00:57:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:27.926 00:57:18 -- common/autotest_common.sh@10 -- # set +x 00:04:27.926 00:57:18 -- json_config/json_config.sh@376 -- # killprocess 926602 00:04:27.926 00:57:18 -- common/autotest_common.sh@936 -- # '[' -z 926602 ']' 00:04:27.926 00:57:18 -- common/autotest_common.sh@940 -- # kill -0 926602 00:04:27.926 00:57:18 -- common/autotest_common.sh@941 -- # uname 00:04:27.926 00:57:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:27.926 00:57:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 926602 00:04:28.184 00:57:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:28.184 00:57:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:28.184 00:57:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 926602' 00:04:28.184 killing process with pid 926602 00:04:28.184 00:57:18 -- common/autotest_common.sh@955 -- # kill 926602 00:04:28.184 00:57:18 -- common/autotest_common.sh@960 -- # wait 926602 00:04:30.084 00:57:20 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:30.084 00:57:20 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:30.084 00:57:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:30.084 00:57:20 -- common/autotest_common.sh@10 -- # set +x 00:04:30.084 00:57:20 -- json_config/json_config.sh@381 -- # return 0 00:04:30.084 00:57:20 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:30.084 INFO: Success 00:04:30.084 00:04:30.084 real 0m16.513s 00:04:30.084 user 0m19.282s 00:04:30.084 sys 0m2.003s 00:04:30.084 00:57:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.084 00:57:20 -- common/autotest_common.sh@10 -- # set +x 00:04:30.084 ************************************ 00:04:30.084 END TEST json_config 00:04:30.084 ************************************ 00:04:30.084 00:57:20 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:30.084 00:57:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.084 00:57:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.084 00:57:20 -- common/autotest_common.sh@10 -- # set +x 00:04:30.084 ************************************ 00:04:30.084 START TEST json_config_extra_key 00:04:30.084 ************************************ 00:04:30.084 00:57:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:30.084 00:57:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.084 00:57:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.084 00:57:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.084 00:57:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.084 00:57:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.084 00:57:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.084 00:57:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.084 00:57:20 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.084 00:57:20 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.084 00:57:20 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.084 00:57:20 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.084 00:57:20 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.084 00:57:20 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.084 00:57:20 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.084 00:57:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.084 00:57:20 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.084 00:57:20 -- scripts/common.sh@344 -- # : 1 00:04:30.084 00:57:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.084 00:57:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.084 00:57:20 -- scripts/common.sh@364 -- # decimal 1 00:04:30.084 00:57:20 -- scripts/common.sh@352 -- # local d=1 00:04:30.084 00:57:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.084 00:57:20 -- scripts/common.sh@354 -- # echo 1 00:04:30.084 00:57:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.084 00:57:20 -- scripts/common.sh@365 -- # decimal 2 00:04:30.084 00:57:20 -- scripts/common.sh@352 -- # local d=2 00:04:30.084 00:57:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.084 00:57:20 -- scripts/common.sh@354 -- # echo 2 00:04:30.084 00:57:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.084 00:57:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.084 00:57:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.084 00:57:20 -- scripts/common.sh@367 -- # return 0 00:04:30.084 00:57:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.084 00:57:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.084 --rc genhtml_branch_coverage=1 00:04:30.084 --rc genhtml_function_coverage=1 00:04:30.084 --rc genhtml_legend=1 00:04:30.084 --rc geninfo_all_blocks=1 00:04:30.084 --rc geninfo_unexecuted_blocks=1 00:04:30.084 00:04:30.084 ' 00:04:30.084 00:57:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.084 --rc genhtml_branch_coverage=1 00:04:30.084 --rc genhtml_function_coverage=1 00:04:30.084 --rc genhtml_legend=1 00:04:30.084 --rc geninfo_all_blocks=1 00:04:30.084 --rc geninfo_unexecuted_blocks=1 00:04:30.084 00:04:30.084 ' 00:04:30.084 00:57:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.084 --rc genhtml_branch_coverage=1 00:04:30.084 --rc genhtml_function_coverage=1 00:04:30.084 --rc genhtml_legend=1 00:04:30.084 --rc geninfo_all_blocks=1 00:04:30.084 --rc geninfo_unexecuted_blocks=1 00:04:30.084 00:04:30.084 ' 00:04:30.084 00:57:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.084 --rc genhtml_branch_coverage=1 00:04:30.084 --rc genhtml_function_coverage=1 00:04:30.084 --rc genhtml_legend=1 00:04:30.084 --rc geninfo_all_blocks=1 00:04:30.084 --rc geninfo_unexecuted_blocks=1 00:04:30.084 00:04:30.084 ' 00:04:30.084 00:57:20 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:30.084 00:57:20 -- nvmf/common.sh@7 -- # uname -s 00:04:30.084 00:57:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:30.084 00:57:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:30.084 00:57:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:30.084 00:57:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:30.084 00:57:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:30.084 00:57:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:30.084 00:57:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:30.084 00:57:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:30.084 00:57:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:30.084 00:57:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:30.084 00:57:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:30.084 00:57:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:30.084 00:57:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:30.084 00:57:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:30.084 00:57:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:30.085 00:57:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:30.085 00:57:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:30.085 00:57:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:30.085 00:57:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:30.085 00:57:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.085 00:57:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.085 00:57:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.085 00:57:20 -- paths/export.sh@5 -- # export PATH 00:04:30.085 00:57:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:30.085 00:57:20 -- nvmf/common.sh@46 -- # : 0 00:04:30.085 00:57:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:30.085 00:57:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:30.085 00:57:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:30.085 00:57:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:30.085 00:57:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:30.085 00:57:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:30.085 00:57:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:30.085 00:57:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:30.085 INFO: launching applications... 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=927553 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:30.085 Waiting for target to run... 00:04:30.085 00:57:20 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 927553 /var/tmp/spdk_tgt.sock 00:04:30.085 00:57:20 -- common/autotest_common.sh@829 -- # '[' -z 927553 ']' 00:04:30.085 00:57:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:30.085 00:57:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.085 00:57:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:30.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:30.085 00:57:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.085 00:57:20 -- common/autotest_common.sh@10 -- # set +x 00:04:30.085 [2024-11-26 00:57:20.340305] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.085 [2024-11-26 00:57:20.340381] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid927553 ] 00:04:30.085 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.343 [2024-11-26 00:57:20.832062] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.602 [2024-11-26 00:57:20.933476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.602 [2024-11-26 00:57:20.933679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:30.859 00:57:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:30.859 00:57:21 -- common/autotest_common.sh@862 -- # return 0 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:30.859 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:30.859 INFO: shutting down applications... 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 927553 ]] 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 927553 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@50 -- # kill -0 927553 00:04:30.859 00:57:21 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:31.440 00:57:21 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:31.440 00:57:21 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:31.440 00:57:21 -- json_config/json_config_extra_key.sh@50 -- # kill -0 927553 00:04:31.440 00:57:21 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@50 -- # kill -0 927553 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:32.073 SPDK target shutdown done 00:04:32.073 00:57:22 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:32.073 Success 00:04:32.073 00:04:32.073 real 0m2.130s 00:04:32.073 user 0m1.491s 00:04:32.073 sys 0m0.605s 00:04:32.073 00:57:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:32.073 00:57:22 -- common/autotest_common.sh@10 -- # set +x 00:04:32.073 ************************************ 00:04:32.073 END TEST json_config_extra_key 00:04:32.073 ************************************ 00:04:32.073 00:57:22 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:32.073 00:57:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:32.073 00:57:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:32.073 00:57:22 -- common/autotest_common.sh@10 -- # set +x 00:04:32.073 ************************************ 00:04:32.073 START TEST alias_rpc 00:04:32.073 ************************************ 00:04:32.073 00:57:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:32.073 * Looking for test storage... 00:04:32.073 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:32.073 00:57:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:32.073 00:57:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:32.073 00:57:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:32.073 00:57:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:32.073 00:57:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:32.073 00:57:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:32.073 00:57:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:32.073 00:57:22 -- scripts/common.sh@335 -- # IFS=.-: 00:04:32.073 00:57:22 -- scripts/common.sh@335 -- # read -ra ver1 00:04:32.073 00:57:22 -- scripts/common.sh@336 -- # IFS=.-: 00:04:32.073 00:57:22 -- scripts/common.sh@336 -- # read -ra ver2 00:04:32.073 00:57:22 -- scripts/common.sh@337 -- # local 'op=<' 00:04:32.073 00:57:22 -- scripts/common.sh@339 -- # ver1_l=2 00:04:32.073 00:57:22 -- scripts/common.sh@340 -- # ver2_l=1 00:04:32.073 00:57:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:32.073 00:57:22 -- scripts/common.sh@343 -- # case "$op" in 00:04:32.073 00:57:22 -- scripts/common.sh@344 -- # : 1 00:04:32.073 00:57:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:32.073 00:57:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:32.073 00:57:22 -- scripts/common.sh@364 -- # decimal 1 00:04:32.073 00:57:22 -- scripts/common.sh@352 -- # local d=1 00:04:32.073 00:57:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:32.073 00:57:22 -- scripts/common.sh@354 -- # echo 1 00:04:32.073 00:57:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:32.073 00:57:22 -- scripts/common.sh@365 -- # decimal 2 00:04:32.073 00:57:22 -- scripts/common.sh@352 -- # local d=2 00:04:32.073 00:57:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:32.073 00:57:22 -- scripts/common.sh@354 -- # echo 2 00:04:32.073 00:57:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:32.073 00:57:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:32.073 00:57:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:32.073 00:57:22 -- scripts/common.sh@367 -- # return 0 00:04:32.073 00:57:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:32.073 00:57:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:32.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.073 --rc genhtml_branch_coverage=1 00:04:32.073 --rc genhtml_function_coverage=1 00:04:32.073 --rc genhtml_legend=1 00:04:32.073 --rc geninfo_all_blocks=1 00:04:32.073 --rc geninfo_unexecuted_blocks=1 00:04:32.073 00:04:32.073 ' 00:04:32.073 00:57:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:32.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.073 --rc genhtml_branch_coverage=1 00:04:32.073 --rc genhtml_function_coverage=1 00:04:32.073 --rc genhtml_legend=1 00:04:32.073 --rc geninfo_all_blocks=1 00:04:32.073 --rc geninfo_unexecuted_blocks=1 00:04:32.073 00:04:32.073 ' 00:04:32.073 00:57:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:32.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.073 --rc genhtml_branch_coverage=1 00:04:32.073 --rc genhtml_function_coverage=1 00:04:32.073 --rc genhtml_legend=1 00:04:32.073 --rc geninfo_all_blocks=1 00:04:32.073 --rc geninfo_unexecuted_blocks=1 00:04:32.073 00:04:32.073 ' 00:04:32.073 00:57:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:32.073 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:32.073 --rc genhtml_branch_coverage=1 00:04:32.073 --rc genhtml_function_coverage=1 00:04:32.073 --rc genhtml_legend=1 00:04:32.073 --rc geninfo_all_blocks=1 00:04:32.073 --rc geninfo_unexecuted_blocks=1 00:04:32.073 00:04:32.074 ' 00:04:32.074 00:57:22 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:32.074 00:57:22 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=927882 00:04:32.074 00:57:22 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:32.074 00:57:22 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 927882 00:04:32.074 00:57:22 -- common/autotest_common.sh@829 -- # '[' -z 927882 ']' 00:04:32.074 00:57:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:32.074 00:57:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:32.074 00:57:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:32.074 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:32.074 00:57:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:32.074 00:57:22 -- common/autotest_common.sh@10 -- # set +x 00:04:32.074 [2024-11-26 00:57:22.504742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:32.074 [2024-11-26 00:57:22.504841] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid927882 ] 00:04:32.074 EAL: No free 2048 kB hugepages reported on node 1 00:04:32.074 [2024-11-26 00:57:22.565598] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:32.332 [2024-11-26 00:57:22.679242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:32.332 [2024-11-26 00:57:22.679422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:33.264 00:57:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:33.264 00:57:23 -- common/autotest_common.sh@862 -- # return 0 00:04:33.264 00:57:23 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:33.264 00:57:23 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 927882 00:04:33.264 00:57:23 -- common/autotest_common.sh@936 -- # '[' -z 927882 ']' 00:04:33.264 00:57:23 -- common/autotest_common.sh@940 -- # kill -0 927882 00:04:33.264 00:57:23 -- common/autotest_common.sh@941 -- # uname 00:04:33.264 00:57:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:33.264 00:57:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 927882 00:04:33.264 00:57:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:33.264 00:57:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:33.264 00:57:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 927882' 00:04:33.264 killing process with pid 927882 00:04:33.264 00:57:23 -- common/autotest_common.sh@955 -- # kill 927882 00:04:33.264 00:57:23 -- common/autotest_common.sh@960 -- # wait 927882 00:04:33.830 00:04:33.830 real 0m1.889s 00:04:33.830 user 0m2.153s 00:04:33.830 sys 0m0.470s 00:04:33.830 00:57:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.830 00:57:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.830 ************************************ 00:04:33.830 END TEST alias_rpc 00:04:33.830 ************************************ 00:04:33.830 00:57:24 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:33.830 00:57:24 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:33.830 00:57:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.830 00:57:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.830 00:57:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.830 ************************************ 00:04:33.830 START TEST spdkcli_tcp 00:04:33.830 ************************************ 00:04:33.830 00:57:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:33.830 * Looking for test storage... 00:04:33.830 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:33.830 00:57:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:33.830 00:57:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:33.830 00:57:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:33.830 00:57:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:33.830 00:57:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:33.830 00:57:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:33.830 00:57:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:33.830 00:57:24 -- scripts/common.sh@335 -- # IFS=.-: 00:04:33.830 00:57:24 -- scripts/common.sh@335 -- # read -ra ver1 00:04:33.830 00:57:24 -- scripts/common.sh@336 -- # IFS=.-: 00:04:33.830 00:57:24 -- scripts/common.sh@336 -- # read -ra ver2 00:04:33.830 00:57:24 -- scripts/common.sh@337 -- # local 'op=<' 00:04:33.830 00:57:24 -- scripts/common.sh@339 -- # ver1_l=2 00:04:33.830 00:57:24 -- scripts/common.sh@340 -- # ver2_l=1 00:04:33.830 00:57:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:33.830 00:57:24 -- scripts/common.sh@343 -- # case "$op" in 00:04:33.830 00:57:24 -- scripts/common.sh@344 -- # : 1 00:04:33.830 00:57:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:33.830 00:57:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.089 00:57:24 -- scripts/common.sh@364 -- # decimal 1 00:04:34.089 00:57:24 -- scripts/common.sh@352 -- # local d=1 00:04:34.089 00:57:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.089 00:57:24 -- scripts/common.sh@354 -- # echo 1 00:04:34.089 00:57:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:34.089 00:57:24 -- scripts/common.sh@365 -- # decimal 2 00:04:34.089 00:57:24 -- scripts/common.sh@352 -- # local d=2 00:04:34.089 00:57:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.089 00:57:24 -- scripts/common.sh@354 -- # echo 2 00:04:34.089 00:57:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:34.089 00:57:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:34.089 00:57:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:34.089 00:57:24 -- scripts/common.sh@367 -- # return 0 00:04:34.089 00:57:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.089 00:57:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:34.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.089 --rc genhtml_branch_coverage=1 00:04:34.089 --rc genhtml_function_coverage=1 00:04:34.089 --rc genhtml_legend=1 00:04:34.089 --rc geninfo_all_blocks=1 00:04:34.089 --rc geninfo_unexecuted_blocks=1 00:04:34.089 00:04:34.089 ' 00:04:34.089 00:57:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:34.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.089 --rc genhtml_branch_coverage=1 00:04:34.089 --rc genhtml_function_coverage=1 00:04:34.089 --rc genhtml_legend=1 00:04:34.089 --rc geninfo_all_blocks=1 00:04:34.089 --rc geninfo_unexecuted_blocks=1 00:04:34.089 00:04:34.089 ' 00:04:34.089 00:57:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:34.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.089 --rc genhtml_branch_coverage=1 00:04:34.089 --rc genhtml_function_coverage=1 00:04:34.089 --rc genhtml_legend=1 00:04:34.089 --rc geninfo_all_blocks=1 00:04:34.089 --rc geninfo_unexecuted_blocks=1 00:04:34.089 00:04:34.089 ' 00:04:34.089 00:57:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:34.089 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.089 --rc genhtml_branch_coverage=1 00:04:34.089 --rc genhtml_function_coverage=1 00:04:34.089 --rc genhtml_legend=1 00:04:34.089 --rc geninfo_all_blocks=1 00:04:34.089 --rc geninfo_unexecuted_blocks=1 00:04:34.089 00:04:34.089 ' 00:04:34.089 00:57:24 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:34.089 00:57:24 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:34.089 00:57:24 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:34.089 00:57:24 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:34.089 00:57:24 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:34.089 00:57:24 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:34.089 00:57:24 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:34.090 00:57:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:34.090 00:57:24 -- common/autotest_common.sh@10 -- # set +x 00:04:34.090 00:57:24 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=928213 00:04:34.090 00:57:24 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:34.090 00:57:24 -- spdkcli/tcp.sh@27 -- # waitforlisten 928213 00:04:34.090 00:57:24 -- common/autotest_common.sh@829 -- # '[' -z 928213 ']' 00:04:34.090 00:57:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:34.090 00:57:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:34.090 00:57:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:34.090 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:34.090 00:57:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:34.090 00:57:24 -- common/autotest_common.sh@10 -- # set +x 00:04:34.090 [2024-11-26 00:57:24.419889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:34.090 [2024-11-26 00:57:24.419966] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid928213 ] 00:04:34.090 EAL: No free 2048 kB hugepages reported on node 1 00:04:34.090 [2024-11-26 00:57:24.476234] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:34.090 [2024-11-26 00:57:24.586027] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:34.090 [2024-11-26 00:57:24.586265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:34.090 [2024-11-26 00:57:24.586271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.024 00:57:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:35.024 00:57:25 -- common/autotest_common.sh@862 -- # return 0 00:04:35.024 00:57:25 -- spdkcli/tcp.sh@31 -- # socat_pid=928346 00:04:35.024 00:57:25 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:35.024 00:57:25 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:35.283 [ 00:04:35.283 "bdev_malloc_delete", 00:04:35.283 "bdev_malloc_create", 00:04:35.283 "bdev_null_resize", 00:04:35.283 "bdev_null_delete", 00:04:35.283 "bdev_null_create", 00:04:35.283 "bdev_nvme_cuse_unregister", 00:04:35.283 "bdev_nvme_cuse_register", 00:04:35.283 "bdev_opal_new_user", 00:04:35.283 "bdev_opal_set_lock_state", 00:04:35.283 "bdev_opal_delete", 00:04:35.283 "bdev_opal_get_info", 00:04:35.283 "bdev_opal_create", 00:04:35.283 "bdev_nvme_opal_revert", 00:04:35.283 "bdev_nvme_opal_init", 00:04:35.283 "bdev_nvme_send_cmd", 00:04:35.283 "bdev_nvme_get_path_iostat", 00:04:35.283 "bdev_nvme_get_mdns_discovery_info", 00:04:35.283 "bdev_nvme_stop_mdns_discovery", 00:04:35.283 "bdev_nvme_start_mdns_discovery", 00:04:35.283 "bdev_nvme_set_multipath_policy", 00:04:35.283 "bdev_nvme_set_preferred_path", 00:04:35.283 "bdev_nvme_get_io_paths", 00:04:35.283 "bdev_nvme_remove_error_injection", 00:04:35.283 "bdev_nvme_add_error_injection", 00:04:35.283 "bdev_nvme_get_discovery_info", 00:04:35.283 "bdev_nvme_stop_discovery", 00:04:35.283 "bdev_nvme_start_discovery", 00:04:35.283 "bdev_nvme_get_controller_health_info", 00:04:35.283 "bdev_nvme_disable_controller", 00:04:35.283 "bdev_nvme_enable_controller", 00:04:35.283 "bdev_nvme_reset_controller", 00:04:35.283 "bdev_nvme_get_transport_statistics", 00:04:35.283 "bdev_nvme_apply_firmware", 00:04:35.283 "bdev_nvme_detach_controller", 00:04:35.283 "bdev_nvme_get_controllers", 00:04:35.283 "bdev_nvme_attach_controller", 00:04:35.283 "bdev_nvme_set_hotplug", 00:04:35.283 "bdev_nvme_set_options", 00:04:35.283 "bdev_passthru_delete", 00:04:35.283 "bdev_passthru_create", 00:04:35.283 "bdev_lvol_grow_lvstore", 00:04:35.283 "bdev_lvol_get_lvols", 00:04:35.283 "bdev_lvol_get_lvstores", 00:04:35.283 "bdev_lvol_delete", 00:04:35.283 "bdev_lvol_set_read_only", 00:04:35.283 "bdev_lvol_resize", 00:04:35.283 "bdev_lvol_decouple_parent", 00:04:35.283 "bdev_lvol_inflate", 00:04:35.283 "bdev_lvol_rename", 00:04:35.283 "bdev_lvol_clone_bdev", 00:04:35.283 "bdev_lvol_clone", 00:04:35.283 "bdev_lvol_snapshot", 00:04:35.283 "bdev_lvol_create", 00:04:35.283 "bdev_lvol_delete_lvstore", 00:04:35.283 "bdev_lvol_rename_lvstore", 00:04:35.283 "bdev_lvol_create_lvstore", 00:04:35.283 "bdev_raid_set_options", 00:04:35.283 "bdev_raid_remove_base_bdev", 00:04:35.283 "bdev_raid_add_base_bdev", 00:04:35.283 "bdev_raid_delete", 00:04:35.283 "bdev_raid_create", 00:04:35.283 "bdev_raid_get_bdevs", 00:04:35.283 "bdev_error_inject_error", 00:04:35.283 "bdev_error_delete", 00:04:35.283 "bdev_error_create", 00:04:35.283 "bdev_split_delete", 00:04:35.283 "bdev_split_create", 00:04:35.283 "bdev_delay_delete", 00:04:35.283 "bdev_delay_create", 00:04:35.283 "bdev_delay_update_latency", 00:04:35.283 "bdev_zone_block_delete", 00:04:35.283 "bdev_zone_block_create", 00:04:35.283 "blobfs_create", 00:04:35.283 "blobfs_detect", 00:04:35.283 "blobfs_set_cache_size", 00:04:35.283 "bdev_aio_delete", 00:04:35.283 "bdev_aio_rescan", 00:04:35.283 "bdev_aio_create", 00:04:35.283 "bdev_ftl_set_property", 00:04:35.283 "bdev_ftl_get_properties", 00:04:35.283 "bdev_ftl_get_stats", 00:04:35.283 "bdev_ftl_unmap", 00:04:35.283 "bdev_ftl_unload", 00:04:35.283 "bdev_ftl_delete", 00:04:35.283 "bdev_ftl_load", 00:04:35.283 "bdev_ftl_create", 00:04:35.283 "bdev_virtio_attach_controller", 00:04:35.283 "bdev_virtio_scsi_get_devices", 00:04:35.283 "bdev_virtio_detach_controller", 00:04:35.283 "bdev_virtio_blk_set_hotplug", 00:04:35.283 "bdev_iscsi_delete", 00:04:35.283 "bdev_iscsi_create", 00:04:35.283 "bdev_iscsi_set_options", 00:04:35.283 "accel_error_inject_error", 00:04:35.283 "ioat_scan_accel_module", 00:04:35.283 "dsa_scan_accel_module", 00:04:35.283 "iaa_scan_accel_module", 00:04:35.283 "iscsi_set_options", 00:04:35.283 "iscsi_get_auth_groups", 00:04:35.283 "iscsi_auth_group_remove_secret", 00:04:35.283 "iscsi_auth_group_add_secret", 00:04:35.283 "iscsi_delete_auth_group", 00:04:35.283 "iscsi_create_auth_group", 00:04:35.283 "iscsi_set_discovery_auth", 00:04:35.283 "iscsi_get_options", 00:04:35.283 "iscsi_target_node_request_logout", 00:04:35.283 "iscsi_target_node_set_redirect", 00:04:35.283 "iscsi_target_node_set_auth", 00:04:35.283 "iscsi_target_node_add_lun", 00:04:35.283 "iscsi_get_connections", 00:04:35.283 "iscsi_portal_group_set_auth", 00:04:35.283 "iscsi_start_portal_group", 00:04:35.283 "iscsi_delete_portal_group", 00:04:35.283 "iscsi_create_portal_group", 00:04:35.283 "iscsi_get_portal_groups", 00:04:35.283 "iscsi_delete_target_node", 00:04:35.283 "iscsi_target_node_remove_pg_ig_maps", 00:04:35.283 "iscsi_target_node_add_pg_ig_maps", 00:04:35.283 "iscsi_create_target_node", 00:04:35.283 "iscsi_get_target_nodes", 00:04:35.283 "iscsi_delete_initiator_group", 00:04:35.283 "iscsi_initiator_group_remove_initiators", 00:04:35.283 "iscsi_initiator_group_add_initiators", 00:04:35.283 "iscsi_create_initiator_group", 00:04:35.283 "iscsi_get_initiator_groups", 00:04:35.283 "nvmf_set_crdt", 00:04:35.283 "nvmf_set_config", 00:04:35.283 "nvmf_set_max_subsystems", 00:04:35.283 "nvmf_subsystem_get_listeners", 00:04:35.283 "nvmf_subsystem_get_qpairs", 00:04:35.283 "nvmf_subsystem_get_controllers", 00:04:35.283 "nvmf_get_stats", 00:04:35.283 "nvmf_get_transports", 00:04:35.283 "nvmf_create_transport", 00:04:35.283 "nvmf_get_targets", 00:04:35.283 "nvmf_delete_target", 00:04:35.283 "nvmf_create_target", 00:04:35.283 "nvmf_subsystem_allow_any_host", 00:04:35.283 "nvmf_subsystem_remove_host", 00:04:35.283 "nvmf_subsystem_add_host", 00:04:35.283 "nvmf_subsystem_remove_ns", 00:04:35.283 "nvmf_subsystem_add_ns", 00:04:35.283 "nvmf_subsystem_listener_set_ana_state", 00:04:35.283 "nvmf_discovery_get_referrals", 00:04:35.283 "nvmf_discovery_remove_referral", 00:04:35.283 "nvmf_discovery_add_referral", 00:04:35.283 "nvmf_subsystem_remove_listener", 00:04:35.283 "nvmf_subsystem_add_listener", 00:04:35.283 "nvmf_delete_subsystem", 00:04:35.283 "nvmf_create_subsystem", 00:04:35.283 "nvmf_get_subsystems", 00:04:35.283 "env_dpdk_get_mem_stats", 00:04:35.283 "nbd_get_disks", 00:04:35.283 "nbd_stop_disk", 00:04:35.283 "nbd_start_disk", 00:04:35.283 "ublk_recover_disk", 00:04:35.283 "ublk_get_disks", 00:04:35.283 "ublk_stop_disk", 00:04:35.283 "ublk_start_disk", 00:04:35.283 "ublk_destroy_target", 00:04:35.283 "ublk_create_target", 00:04:35.283 "virtio_blk_create_transport", 00:04:35.283 "virtio_blk_get_transports", 00:04:35.283 "vhost_controller_set_coalescing", 00:04:35.283 "vhost_get_controllers", 00:04:35.283 "vhost_delete_controller", 00:04:35.283 "vhost_create_blk_controller", 00:04:35.283 "vhost_scsi_controller_remove_target", 00:04:35.283 "vhost_scsi_controller_add_target", 00:04:35.283 "vhost_start_scsi_controller", 00:04:35.283 "vhost_create_scsi_controller", 00:04:35.283 "thread_set_cpumask", 00:04:35.283 "framework_get_scheduler", 00:04:35.283 "framework_set_scheduler", 00:04:35.283 "framework_get_reactors", 00:04:35.283 "thread_get_io_channels", 00:04:35.283 "thread_get_pollers", 00:04:35.283 "thread_get_stats", 00:04:35.284 "framework_monitor_context_switch", 00:04:35.284 "spdk_kill_instance", 00:04:35.284 "log_enable_timestamps", 00:04:35.284 "log_get_flags", 00:04:35.284 "log_clear_flag", 00:04:35.284 "log_set_flag", 00:04:35.284 "log_get_level", 00:04:35.284 "log_set_level", 00:04:35.284 "log_get_print_level", 00:04:35.284 "log_set_print_level", 00:04:35.284 "framework_enable_cpumask_locks", 00:04:35.284 "framework_disable_cpumask_locks", 00:04:35.284 "framework_wait_init", 00:04:35.284 "framework_start_init", 00:04:35.284 "scsi_get_devices", 00:04:35.284 "bdev_get_histogram", 00:04:35.284 "bdev_enable_histogram", 00:04:35.284 "bdev_set_qos_limit", 00:04:35.284 "bdev_set_qd_sampling_period", 00:04:35.284 "bdev_get_bdevs", 00:04:35.284 "bdev_reset_iostat", 00:04:35.284 "bdev_get_iostat", 00:04:35.284 "bdev_examine", 00:04:35.284 "bdev_wait_for_examine", 00:04:35.284 "bdev_set_options", 00:04:35.284 "notify_get_notifications", 00:04:35.284 "notify_get_types", 00:04:35.284 "accel_get_stats", 00:04:35.284 "accel_set_options", 00:04:35.284 "accel_set_driver", 00:04:35.284 "accel_crypto_key_destroy", 00:04:35.284 "accel_crypto_keys_get", 00:04:35.284 "accel_crypto_key_create", 00:04:35.284 "accel_assign_opc", 00:04:35.284 "accel_get_module_info", 00:04:35.284 "accel_get_opc_assignments", 00:04:35.284 "vmd_rescan", 00:04:35.284 "vmd_remove_device", 00:04:35.284 "vmd_enable", 00:04:35.284 "sock_set_default_impl", 00:04:35.284 "sock_impl_set_options", 00:04:35.284 "sock_impl_get_options", 00:04:35.284 "iobuf_get_stats", 00:04:35.284 "iobuf_set_options", 00:04:35.284 "framework_get_pci_devices", 00:04:35.284 "framework_get_config", 00:04:35.284 "framework_get_subsystems", 00:04:35.284 "trace_get_info", 00:04:35.284 "trace_get_tpoint_group_mask", 00:04:35.284 "trace_disable_tpoint_group", 00:04:35.284 "trace_enable_tpoint_group", 00:04:35.284 "trace_clear_tpoint_mask", 00:04:35.284 "trace_set_tpoint_mask", 00:04:35.284 "spdk_get_version", 00:04:35.284 "rpc_get_methods" 00:04:35.284 ] 00:04:35.284 00:57:25 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:35.284 00:57:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:35.284 00:57:25 -- common/autotest_common.sh@10 -- # set +x 00:04:35.284 00:57:25 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:35.284 00:57:25 -- spdkcli/tcp.sh@38 -- # killprocess 928213 00:04:35.284 00:57:25 -- common/autotest_common.sh@936 -- # '[' -z 928213 ']' 00:04:35.284 00:57:25 -- common/autotest_common.sh@940 -- # kill -0 928213 00:04:35.284 00:57:25 -- common/autotest_common.sh@941 -- # uname 00:04:35.284 00:57:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:35.284 00:57:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 928213 00:04:35.284 00:57:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:35.284 00:57:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:35.284 00:57:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 928213' 00:04:35.284 killing process with pid 928213 00:04:35.284 00:57:25 -- common/autotest_common.sh@955 -- # kill 928213 00:04:35.284 00:57:25 -- common/autotest_common.sh@960 -- # wait 928213 00:04:35.851 00:04:35.851 real 0m1.972s 00:04:35.851 user 0m3.779s 00:04:35.851 sys 0m0.504s 00:04:35.851 00:57:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.851 00:57:26 -- common/autotest_common.sh@10 -- # set +x 00:04:35.851 ************************************ 00:04:35.851 END TEST spdkcli_tcp 00:04:35.851 ************************************ 00:04:35.851 00:57:26 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:35.851 00:57:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.851 00:57:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.851 00:57:26 -- common/autotest_common.sh@10 -- # set +x 00:04:35.851 ************************************ 00:04:35.851 START TEST dpdk_mem_utility 00:04:35.851 ************************************ 00:04:35.851 00:57:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:35.851 * Looking for test storage... 00:04:35.851 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:35.851 00:57:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:35.851 00:57:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:35.851 00:57:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.851 00:57:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.851 00:57:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.851 00:57:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.851 00:57:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.851 00:57:26 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.851 00:57:26 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.851 00:57:26 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.851 00:57:26 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.851 00:57:26 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.851 00:57:26 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.851 00:57:26 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.851 00:57:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.851 00:57:26 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.851 00:57:26 -- scripts/common.sh@344 -- # : 1 00:04:35.851 00:57:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.851 00:57:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.851 00:57:26 -- scripts/common.sh@364 -- # decimal 1 00:04:35.851 00:57:26 -- scripts/common.sh@352 -- # local d=1 00:04:35.851 00:57:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.851 00:57:26 -- scripts/common.sh@354 -- # echo 1 00:04:35.851 00:57:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.851 00:57:26 -- scripts/common.sh@365 -- # decimal 2 00:04:35.851 00:57:26 -- scripts/common.sh@352 -- # local d=2 00:04:35.851 00:57:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.851 00:57:26 -- scripts/common.sh@354 -- # echo 2 00:04:35.851 00:57:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.851 00:57:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.851 00:57:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.851 00:57:26 -- scripts/common.sh@367 -- # return 0 00:04:35.851 00:57:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.851 00:57:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.851 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.851 --rc genhtml_branch_coverage=1 00:04:35.851 --rc genhtml_function_coverage=1 00:04:35.851 --rc genhtml_legend=1 00:04:35.851 --rc geninfo_all_blocks=1 00:04:35.851 --rc geninfo_unexecuted_blocks=1 00:04:35.851 00:04:35.851 ' 00:04:35.851 00:57:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.851 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.851 --rc genhtml_branch_coverage=1 00:04:35.851 --rc genhtml_function_coverage=1 00:04:35.851 --rc genhtml_legend=1 00:04:35.851 --rc geninfo_all_blocks=1 00:04:35.851 --rc geninfo_unexecuted_blocks=1 00:04:35.851 00:04:35.851 ' 00:04:35.851 00:57:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.851 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.851 --rc genhtml_branch_coverage=1 00:04:35.851 --rc genhtml_function_coverage=1 00:04:35.851 --rc genhtml_legend=1 00:04:35.851 --rc geninfo_all_blocks=1 00:04:35.851 --rc geninfo_unexecuted_blocks=1 00:04:35.851 00:04:35.851 ' 00:04:35.851 00:57:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.851 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.851 --rc genhtml_branch_coverage=1 00:04:35.851 --rc genhtml_function_coverage=1 00:04:35.851 --rc genhtml_legend=1 00:04:35.851 --rc geninfo_all_blocks=1 00:04:35.851 --rc geninfo_unexecuted_blocks=1 00:04:35.851 00:04:35.851 ' 00:04:35.851 00:57:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:35.851 00:57:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=928516 00:04:35.851 00:57:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:35.851 00:57:26 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 928516 00:04:35.851 00:57:26 -- common/autotest_common.sh@829 -- # '[' -z 928516 ']' 00:04:35.851 00:57:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:35.851 00:57:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:35.851 00:57:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:35.851 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:35.851 00:57:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:35.851 00:57:26 -- common/autotest_common.sh@10 -- # set +x 00:04:36.110 [2024-11-26 00:57:26.420984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:36.110 [2024-11-26 00:57:26.421087] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid928516 ] 00:04:36.110 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.110 [2024-11-26 00:57:26.477377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.110 [2024-11-26 00:57:26.582939] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:36.110 [2024-11-26 00:57:26.583115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.045 00:57:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:37.045 00:57:27 -- common/autotest_common.sh@862 -- # return 0 00:04:37.045 00:57:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:37.045 00:57:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:37.045 00:57:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:37.045 00:57:27 -- common/autotest_common.sh@10 -- # set +x 00:04:37.045 { 00:04:37.045 "filename": "/tmp/spdk_mem_dump.txt" 00:04:37.045 } 00:04:37.045 00:57:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:37.045 00:57:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:37.045 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:37.045 1 heaps totaling size 814.000000 MiB 00:04:37.045 size: 814.000000 MiB heap id: 0 00:04:37.045 end heaps---------- 00:04:37.045 8 mempools totaling size 598.116089 MiB 00:04:37.045 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:37.045 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:37.045 size: 84.521057 MiB name: bdev_io_928516 00:04:37.045 size: 51.011292 MiB name: evtpool_928516 00:04:37.045 size: 50.003479 MiB name: msgpool_928516 00:04:37.045 size: 21.763794 MiB name: PDU_Pool 00:04:37.045 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:37.045 size: 0.026123 MiB name: Session_Pool 00:04:37.045 end mempools------- 00:04:37.045 6 memzones totaling size 4.142822 MiB 00:04:37.045 size: 1.000366 MiB name: RG_ring_0_928516 00:04:37.045 size: 1.000366 MiB name: RG_ring_1_928516 00:04:37.045 size: 1.000366 MiB name: RG_ring_4_928516 00:04:37.045 size: 1.000366 MiB name: RG_ring_5_928516 00:04:37.045 size: 0.125366 MiB name: RG_ring_2_928516 00:04:37.045 size: 0.015991 MiB name: RG_ring_3_928516 00:04:37.045 end memzones------- 00:04:37.045 00:57:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:37.045 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:37.045 list of free elements. size: 12.519348 MiB 00:04:37.045 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:37.045 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:37.045 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:37.045 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:37.045 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:37.045 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:37.045 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:37.045 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:37.045 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:37.045 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:37.045 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:37.045 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:37.045 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:37.045 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:37.045 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:37.045 list of standard malloc elements. size: 199.218079 MiB 00:04:37.045 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:37.045 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:37.045 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:37.045 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:37.045 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:37.045 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:37.045 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:37.045 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:37.045 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:37.045 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:37.045 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:37.045 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:37.045 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:37.045 list of memzone associated elements. size: 602.262573 MiB 00:04:37.045 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:37.045 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:37.045 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:37.045 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:37.045 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:37.045 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_928516_0 00:04:37.045 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:37.045 associated memzone info: size: 48.002930 MiB name: MP_evtpool_928516_0 00:04:37.045 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:37.045 associated memzone info: size: 48.002930 MiB name: MP_msgpool_928516_0 00:04:37.045 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:37.045 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:37.045 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:37.045 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:37.045 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:37.045 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_928516 00:04:37.045 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:37.045 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_928516 00:04:37.045 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:37.045 associated memzone info: size: 1.007996 MiB name: MP_evtpool_928516 00:04:37.045 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:37.045 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:37.045 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:37.045 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:37.045 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:37.045 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:37.045 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:37.045 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:37.045 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:37.045 associated memzone info: size: 1.000366 MiB name: RG_ring_0_928516 00:04:37.045 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:37.045 associated memzone info: size: 1.000366 MiB name: RG_ring_1_928516 00:04:37.045 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:37.045 associated memzone info: size: 1.000366 MiB name: RG_ring_4_928516 00:04:37.045 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:37.045 associated memzone info: size: 1.000366 MiB name: RG_ring_5_928516 00:04:37.045 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:37.045 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_928516 00:04:37.045 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:37.045 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:37.045 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:37.046 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:37.046 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:37.046 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:37.046 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:37.046 associated memzone info: size: 0.125366 MiB name: RG_ring_2_928516 00:04:37.046 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:37.046 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:37.046 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:37.046 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:37.046 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:37.046 associated memzone info: size: 0.015991 MiB name: RG_ring_3_928516 00:04:37.046 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:37.046 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:37.046 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:37.046 associated memzone info: size: 0.000183 MiB name: MP_msgpool_928516 00:04:37.046 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:37.046 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_928516 00:04:37.046 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:37.046 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:37.046 00:57:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:37.046 00:57:27 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 928516 00:04:37.046 00:57:27 -- common/autotest_common.sh@936 -- # '[' -z 928516 ']' 00:04:37.046 00:57:27 -- common/autotest_common.sh@940 -- # kill -0 928516 00:04:37.046 00:57:27 -- common/autotest_common.sh@941 -- # uname 00:04:37.046 00:57:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:37.046 00:57:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 928516 00:04:37.046 00:57:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:37.046 00:57:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:37.046 00:57:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 928516' 00:04:37.046 killing process with pid 928516 00:04:37.046 00:57:27 -- common/autotest_common.sh@955 -- # kill 928516 00:04:37.046 00:57:27 -- common/autotest_common.sh@960 -- # wait 928516 00:04:37.611 00:04:37.611 real 0m1.759s 00:04:37.611 user 0m1.939s 00:04:37.611 sys 0m0.449s 00:04:37.611 00:57:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.611 00:57:27 -- common/autotest_common.sh@10 -- # set +x 00:04:37.611 ************************************ 00:04:37.611 END TEST dpdk_mem_utility 00:04:37.611 ************************************ 00:04:37.611 00:57:28 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:37.611 00:57:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.611 00:57:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.611 00:57:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.611 ************************************ 00:04:37.611 START TEST event 00:04:37.611 ************************************ 00:04:37.611 00:57:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:37.611 * Looking for test storage... 00:04:37.611 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:37.611 00:57:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:37.611 00:57:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:37.611 00:57:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:37.870 00:57:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:37.870 00:57:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:37.870 00:57:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:37.870 00:57:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:37.870 00:57:28 -- scripts/common.sh@335 -- # IFS=.-: 00:04:37.870 00:57:28 -- scripts/common.sh@335 -- # read -ra ver1 00:04:37.870 00:57:28 -- scripts/common.sh@336 -- # IFS=.-: 00:04:37.870 00:57:28 -- scripts/common.sh@336 -- # read -ra ver2 00:04:37.870 00:57:28 -- scripts/common.sh@337 -- # local 'op=<' 00:04:37.870 00:57:28 -- scripts/common.sh@339 -- # ver1_l=2 00:04:37.870 00:57:28 -- scripts/common.sh@340 -- # ver2_l=1 00:04:37.870 00:57:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:37.870 00:57:28 -- scripts/common.sh@343 -- # case "$op" in 00:04:37.870 00:57:28 -- scripts/common.sh@344 -- # : 1 00:04:37.870 00:57:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:37.870 00:57:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:37.870 00:57:28 -- scripts/common.sh@364 -- # decimal 1 00:04:37.870 00:57:28 -- scripts/common.sh@352 -- # local d=1 00:04:37.870 00:57:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:37.870 00:57:28 -- scripts/common.sh@354 -- # echo 1 00:04:37.870 00:57:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:37.870 00:57:28 -- scripts/common.sh@365 -- # decimal 2 00:04:37.870 00:57:28 -- scripts/common.sh@352 -- # local d=2 00:04:37.870 00:57:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:37.870 00:57:28 -- scripts/common.sh@354 -- # echo 2 00:04:37.870 00:57:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:37.870 00:57:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:37.870 00:57:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:37.870 00:57:28 -- scripts/common.sh@367 -- # return 0 00:04:37.870 00:57:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:37.870 00:57:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.870 --rc genhtml_branch_coverage=1 00:04:37.870 --rc genhtml_function_coverage=1 00:04:37.870 --rc genhtml_legend=1 00:04:37.870 --rc geninfo_all_blocks=1 00:04:37.870 --rc geninfo_unexecuted_blocks=1 00:04:37.870 00:04:37.870 ' 00:04:37.870 00:57:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.870 --rc genhtml_branch_coverage=1 00:04:37.870 --rc genhtml_function_coverage=1 00:04:37.870 --rc genhtml_legend=1 00:04:37.870 --rc geninfo_all_blocks=1 00:04:37.870 --rc geninfo_unexecuted_blocks=1 00:04:37.870 00:04:37.870 ' 00:04:37.870 00:57:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.870 --rc genhtml_branch_coverage=1 00:04:37.870 --rc genhtml_function_coverage=1 00:04:37.870 --rc genhtml_legend=1 00:04:37.870 --rc geninfo_all_blocks=1 00:04:37.870 --rc geninfo_unexecuted_blocks=1 00:04:37.870 00:04:37.870 ' 00:04:37.870 00:57:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:37.870 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.870 --rc genhtml_branch_coverage=1 00:04:37.870 --rc genhtml_function_coverage=1 00:04:37.870 --rc genhtml_legend=1 00:04:37.870 --rc geninfo_all_blocks=1 00:04:37.870 --rc geninfo_unexecuted_blocks=1 00:04:37.870 00:04:37.870 ' 00:04:37.870 00:57:28 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:37.870 00:57:28 -- bdev/nbd_common.sh@6 -- # set -e 00:04:37.870 00:57:28 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:37.870 00:57:28 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:37.870 00:57:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.870 00:57:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.870 ************************************ 00:04:37.870 START TEST event_perf 00:04:37.870 ************************************ 00:04:37.870 00:57:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:37.870 Running I/O for 1 seconds...[2024-11-26 00:57:28.182320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.871 [2024-11-26 00:57:28.182398] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid928766 ] 00:04:37.871 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.871 [2024-11-26 00:57:28.242354] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:37.871 [2024-11-26 00:57:28.356974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:37.871 [2024-11-26 00:57:28.357032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:37.871 [2024-11-26 00:57:28.357151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:37.871 [2024-11-26 00:57:28.357154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.257 Running I/O for 1 seconds... 00:04:39.257 lcore 0: 228039 00:04:39.257 lcore 1: 228038 00:04:39.257 lcore 2: 228036 00:04:39.257 lcore 3: 228037 00:04:39.257 done. 00:04:39.257 00:04:39.257 real 0m1.315s 00:04:39.257 user 0m4.227s 00:04:39.257 sys 0m0.082s 00:04:39.257 00:57:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.257 00:57:29 -- common/autotest_common.sh@10 -- # set +x 00:04:39.257 ************************************ 00:04:39.257 END TEST event_perf 00:04:39.257 ************************************ 00:04:39.257 00:57:29 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:39.257 00:57:29 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:39.257 00:57:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.257 00:57:29 -- common/autotest_common.sh@10 -- # set +x 00:04:39.257 ************************************ 00:04:39.257 START TEST event_reactor 00:04:39.257 ************************************ 00:04:39.257 00:57:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:39.257 [2024-11-26 00:57:29.527804] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.257 [2024-11-26 00:57:29.527885] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid928925 ] 00:04:39.257 EAL: No free 2048 kB hugepages reported on node 1 00:04:39.257 [2024-11-26 00:57:29.590897] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:39.257 [2024-11-26 00:57:29.704607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:40.631 test_start 00:04:40.631 oneshot 00:04:40.631 tick 100 00:04:40.631 tick 100 00:04:40.631 tick 250 00:04:40.631 tick 100 00:04:40.631 tick 100 00:04:40.631 tick 100 00:04:40.631 tick 250 00:04:40.631 tick 500 00:04:40.631 tick 100 00:04:40.631 tick 100 00:04:40.632 tick 250 00:04:40.632 tick 100 00:04:40.632 tick 100 00:04:40.632 test_end 00:04:40.632 00:04:40.632 real 0m1.315s 00:04:40.632 user 0m1.228s 00:04:40.632 sys 0m0.081s 00:04:40.632 00:57:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.632 00:57:30 -- common/autotest_common.sh@10 -- # set +x 00:04:40.632 ************************************ 00:04:40.632 END TEST event_reactor 00:04:40.632 ************************************ 00:04:40.632 00:57:30 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:40.632 00:57:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:40.632 00:57:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.632 00:57:30 -- common/autotest_common.sh@10 -- # set +x 00:04:40.632 ************************************ 00:04:40.632 START TEST event_reactor_perf 00:04:40.632 ************************************ 00:04:40.632 00:57:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:40.632 [2024-11-26 00:57:30.867298] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.632 [2024-11-26 00:57:30.867386] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid929095 ] 00:04:40.632 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.632 [2024-11-26 00:57:30.933158] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:40.632 [2024-11-26 00:57:31.048678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.007 test_start 00:04:42.007 test_end 00:04:42.007 Performance: 353276 events per second 00:04:42.007 00:04:42.007 real 0m1.316s 00:04:42.007 user 0m1.226s 00:04:42.007 sys 0m0.083s 00:04:42.007 00:57:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.007 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.007 ************************************ 00:04:42.007 END TEST event_reactor_perf 00:04:42.007 ************************************ 00:04:42.007 00:57:32 -- event/event.sh@49 -- # uname -s 00:04:42.007 00:57:32 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:42.007 00:57:32 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:42.007 00:57:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.007 00:57:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.007 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.007 ************************************ 00:04:42.007 START TEST event_scheduler 00:04:42.007 ************************************ 00:04:42.007 00:57:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:42.007 * Looking for test storage... 00:04:42.007 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:42.007 00:57:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.007 00:57:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.007 00:57:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.007 00:57:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.007 00:57:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.007 00:57:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.007 00:57:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.007 00:57:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.007 00:57:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.007 00:57:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.007 00:57:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.007 00:57:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.007 00:57:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.007 00:57:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.007 00:57:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.007 00:57:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.007 00:57:32 -- scripts/common.sh@344 -- # : 1 00:04:42.007 00:57:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.007 00:57:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.007 00:57:32 -- scripts/common.sh@364 -- # decimal 1 00:04:42.007 00:57:32 -- scripts/common.sh@352 -- # local d=1 00:04:42.007 00:57:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.007 00:57:32 -- scripts/common.sh@354 -- # echo 1 00:04:42.007 00:57:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.007 00:57:32 -- scripts/common.sh@365 -- # decimal 2 00:04:42.007 00:57:32 -- scripts/common.sh@352 -- # local d=2 00:04:42.007 00:57:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.007 00:57:32 -- scripts/common.sh@354 -- # echo 2 00:04:42.007 00:57:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.007 00:57:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.007 00:57:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.007 00:57:32 -- scripts/common.sh@367 -- # return 0 00:04:42.007 00:57:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.007 00:57:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.007 --rc genhtml_branch_coverage=1 00:04:42.007 --rc genhtml_function_coverage=1 00:04:42.007 --rc genhtml_legend=1 00:04:42.007 --rc geninfo_all_blocks=1 00:04:42.007 --rc geninfo_unexecuted_blocks=1 00:04:42.007 00:04:42.007 ' 00:04:42.007 00:57:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.007 --rc genhtml_branch_coverage=1 00:04:42.007 --rc genhtml_function_coverage=1 00:04:42.007 --rc genhtml_legend=1 00:04:42.007 --rc geninfo_all_blocks=1 00:04:42.007 --rc geninfo_unexecuted_blocks=1 00:04:42.007 00:04:42.007 ' 00:04:42.007 00:57:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.007 --rc genhtml_branch_coverage=1 00:04:42.007 --rc genhtml_function_coverage=1 00:04:42.007 --rc genhtml_legend=1 00:04:42.007 --rc geninfo_all_blocks=1 00:04:42.007 --rc geninfo_unexecuted_blocks=1 00:04:42.007 00:04:42.007 ' 00:04:42.007 00:57:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.007 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.007 --rc genhtml_branch_coverage=1 00:04:42.007 --rc genhtml_function_coverage=1 00:04:42.007 --rc genhtml_legend=1 00:04:42.007 --rc geninfo_all_blocks=1 00:04:42.007 --rc geninfo_unexecuted_blocks=1 00:04:42.007 00:04:42.007 ' 00:04:42.007 00:57:32 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:42.007 00:57:32 -- scheduler/scheduler.sh@35 -- # scheduler_pid=929403 00:04:42.007 00:57:32 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:42.007 00:57:32 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:42.007 00:57:32 -- scheduler/scheduler.sh@37 -- # waitforlisten 929403 00:04:42.007 00:57:32 -- common/autotest_common.sh@829 -- # '[' -z 929403 ']' 00:04:42.007 00:57:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:42.007 00:57:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:42.008 00:57:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:42.008 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:42.008 00:57:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:42.008 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.008 [2024-11-26 00:57:32.366228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.008 [2024-11-26 00:57:32.366315] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid929403 ] 00:04:42.008 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.008 [2024-11-26 00:57:32.425904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:42.008 [2024-11-26 00:57:32.530340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:42.008 [2024-11-26 00:57:32.530406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:42.008 [2024-11-26 00:57:32.530461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:42.008 [2024-11-26 00:57:32.530465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:42.267 00:57:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:42.267 00:57:32 -- common/autotest_common.sh@862 -- # return 0 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 POWER: Env isn't set yet! 00:04:42.267 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:42.267 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:42.267 POWER: Cannot get available frequencies of lcore 0 00:04:42.267 POWER: Attempting to initialise PSTAT power management... 00:04:42.267 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:42.267 POWER: Initialized successfully for lcore 0 power management 00:04:42.267 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:42.267 POWER: Initialized successfully for lcore 1 power management 00:04:42.267 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:42.267 POWER: Initialized successfully for lcore 2 power management 00:04:42.267 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:42.267 POWER: Initialized successfully for lcore 3 power management 00:04:42.267 [2024-11-26 00:57:32.613888] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:42.267 [2024-11-26 00:57:32.613906] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:42.267 [2024-11-26 00:57:32.613916] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 [2024-11-26 00:57:32.718309] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:42.267 00:57:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.267 00:57:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 ************************************ 00:04:42.267 START TEST scheduler_create_thread 00:04:42.267 ************************************ 00:04:42.267 00:57:32 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 2 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 3 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 4 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 5 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 6 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.267 7 00:04:42.267 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.267 00:57:32 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:42.267 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.267 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.525 8 00:04:42.525 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.525 00:57:32 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:42.525 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.525 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.525 9 00:04:42.525 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.525 00:57:32 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:42.525 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.526 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.526 10 00:04:42.526 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.526 00:57:32 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:42.526 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.526 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.526 00:57:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:42.526 00:57:32 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:42.526 00:57:32 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:42.526 00:57:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:42.526 00:57:32 -- common/autotest_common.sh@10 -- # set +x 00:04:43.091 00:57:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:43.091 00:57:33 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:43.091 00:57:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:43.091 00:57:33 -- common/autotest_common.sh@10 -- # set +x 00:04:44.466 00:57:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:44.466 00:57:34 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:44.466 00:57:34 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:44.466 00:57:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:44.466 00:57:34 -- common/autotest_common.sh@10 -- # set +x 00:04:45.398 00:57:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:45.398 00:04:45.398 real 0m3.102s 00:04:45.398 user 0m0.010s 00:04:45.398 sys 0m0.004s 00:04:45.398 00:57:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.398 00:57:35 -- common/autotest_common.sh@10 -- # set +x 00:04:45.398 ************************************ 00:04:45.398 END TEST scheduler_create_thread 00:04:45.398 ************************************ 00:04:45.398 00:57:35 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:45.398 00:57:35 -- scheduler/scheduler.sh@46 -- # killprocess 929403 00:04:45.398 00:57:35 -- common/autotest_common.sh@936 -- # '[' -z 929403 ']' 00:04:45.398 00:57:35 -- common/autotest_common.sh@940 -- # kill -0 929403 00:04:45.398 00:57:35 -- common/autotest_common.sh@941 -- # uname 00:04:45.398 00:57:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:45.398 00:57:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 929403 00:04:45.398 00:57:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:45.398 00:57:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:45.398 00:57:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 929403' 00:04:45.398 killing process with pid 929403 00:04:45.398 00:57:35 -- common/autotest_common.sh@955 -- # kill 929403 00:04:45.398 00:57:35 -- common/autotest_common.sh@960 -- # wait 929403 00:04:45.964 [2024-11-26 00:57:36.206740] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:45.964 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:45.964 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:45.964 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:45.964 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:45.964 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:45.964 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:45.964 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:45.964 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:46.222 00:04:46.222 real 0m4.306s 00:04:46.222 user 0m6.940s 00:04:46.222 sys 0m0.327s 00:04:46.222 00:57:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.222 00:57:36 -- common/autotest_common.sh@10 -- # set +x 00:04:46.222 ************************************ 00:04:46.222 END TEST event_scheduler 00:04:46.222 ************************************ 00:04:46.222 00:57:36 -- event/event.sh@51 -- # modprobe -n nbd 00:04:46.222 00:57:36 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:46.222 00:57:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.222 00:57:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.222 00:57:36 -- common/autotest_common.sh@10 -- # set +x 00:04:46.222 ************************************ 00:04:46.222 START TEST app_repeat 00:04:46.222 ************************************ 00:04:46.222 00:57:36 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:46.222 00:57:36 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:46.222 00:57:36 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:46.222 00:57:36 -- event/event.sh@13 -- # local nbd_list 00:04:46.222 00:57:36 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:46.222 00:57:36 -- event/event.sh@14 -- # local bdev_list 00:04:46.222 00:57:36 -- event/event.sh@15 -- # local repeat_times=4 00:04:46.222 00:57:36 -- event/event.sh@17 -- # modprobe nbd 00:04:46.222 00:57:36 -- event/event.sh@19 -- # repeat_pid=929881 00:04:46.222 00:57:36 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:46.222 00:57:36 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:46.222 00:57:36 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 929881' 00:04:46.222 Process app_repeat pid: 929881 00:04:46.222 00:57:36 -- event/event.sh@23 -- # for i in {0..2} 00:04:46.222 00:57:36 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:46.222 spdk_app_start Round 0 00:04:46.222 00:57:36 -- event/event.sh@25 -- # waitforlisten 929881 /var/tmp/spdk-nbd.sock 00:04:46.222 00:57:36 -- common/autotest_common.sh@829 -- # '[' -z 929881 ']' 00:04:46.222 00:57:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:46.222 00:57:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.222 00:57:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:46.222 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:46.222 00:57:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.222 00:57:36 -- common/autotest_common.sh@10 -- # set +x 00:04:46.222 [2024-11-26 00:57:36.557082] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.222 [2024-11-26 00:57:36.557164] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid929881 ] 00:04:46.222 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.222 [2024-11-26 00:57:36.617027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:46.222 [2024-11-26 00:57:36.725345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:46.222 [2024-11-26 00:57:36.725348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.154 00:57:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.154 00:57:37 -- common/autotest_common.sh@862 -- # return 0 00:04:47.154 00:57:37 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:47.412 Malloc0 00:04:47.412 00:57:37 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:47.670 Malloc1 00:04:47.670 00:57:38 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@12 -- # local i 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:47.670 00:57:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:47.928 /dev/nbd0 00:04:47.928 00:57:38 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:47.928 00:57:38 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:47.928 00:57:38 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:47.928 00:57:38 -- common/autotest_common.sh@867 -- # local i 00:04:47.928 00:57:38 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:47.928 00:57:38 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:47.928 00:57:38 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:47.928 00:57:38 -- common/autotest_common.sh@871 -- # break 00:04:47.928 00:57:38 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:47.928 00:57:38 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:47.928 00:57:38 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:47.928 1+0 records in 00:04:47.928 1+0 records out 00:04:47.928 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203279 s, 20.1 MB/s 00:04:47.928 00:57:38 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:47.928 00:57:38 -- common/autotest_common.sh@884 -- # size=4096 00:04:47.928 00:57:38 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:47.928 00:57:38 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:47.928 00:57:38 -- common/autotest_common.sh@887 -- # return 0 00:04:47.928 00:57:38 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:47.928 00:57:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:47.928 00:57:38 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:48.186 /dev/nbd1 00:04:48.186 00:57:38 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:48.186 00:57:38 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:48.186 00:57:38 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:48.186 00:57:38 -- common/autotest_common.sh@867 -- # local i 00:04:48.186 00:57:38 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:48.186 00:57:38 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:48.186 00:57:38 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:48.186 00:57:38 -- common/autotest_common.sh@871 -- # break 00:04:48.186 00:57:38 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:48.186 00:57:38 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:48.186 00:57:38 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:48.186 1+0 records in 00:04:48.186 1+0 records out 00:04:48.186 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00021089 s, 19.4 MB/s 00:04:48.186 00:57:38 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:48.186 00:57:38 -- common/autotest_common.sh@884 -- # size=4096 00:04:48.186 00:57:38 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:48.186 00:57:38 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:48.186 00:57:38 -- common/autotest_common.sh@887 -- # return 0 00:04:48.186 00:57:38 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:48.186 00:57:38 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:48.187 00:57:38 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:48.187 00:57:38 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.187 00:57:38 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:48.445 00:57:38 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:48.445 { 00:04:48.445 "nbd_device": "/dev/nbd0", 00:04:48.445 "bdev_name": "Malloc0" 00:04:48.445 }, 00:04:48.445 { 00:04:48.445 "nbd_device": "/dev/nbd1", 00:04:48.445 "bdev_name": "Malloc1" 00:04:48.445 } 00:04:48.445 ]' 00:04:48.445 00:57:38 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:48.445 { 00:04:48.445 "nbd_device": "/dev/nbd0", 00:04:48.445 "bdev_name": "Malloc0" 00:04:48.445 }, 00:04:48.445 { 00:04:48.445 "nbd_device": "/dev/nbd1", 00:04:48.445 "bdev_name": "Malloc1" 00:04:48.445 } 00:04:48.445 ]' 00:04:48.445 00:57:38 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:48.703 00:57:38 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:48.703 /dev/nbd1' 00:04:48.703 00:57:38 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:48.703 /dev/nbd1' 00:04:48.703 00:57:38 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@65 -- # count=2 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@95 -- # count=2 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:48.703 256+0 records in 00:04:48.703 256+0 records out 00:04:48.703 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00505942 s, 207 MB/s 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:48.703 256+0 records in 00:04:48.703 256+0 records out 00:04:48.703 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225127 s, 46.6 MB/s 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:48.703 256+0 records in 00:04:48.703 256+0 records out 00:04:48.703 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218601 s, 48.0 MB/s 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:48.703 00:57:39 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@51 -- # local i 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:48.704 00:57:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@41 -- # break 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@45 -- # return 0 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:48.961 00:57:39 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@41 -- # break 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@45 -- # return 0 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:49.217 00:57:39 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@65 -- # true 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@65 -- # count=0 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@104 -- # count=0 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:49.475 00:57:39 -- bdev/nbd_common.sh@109 -- # return 0 00:04:49.475 00:57:39 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:49.732 00:57:40 -- event/event.sh@35 -- # sleep 3 00:04:49.989 [2024-11-26 00:57:40.462516] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:50.247 [2024-11-26 00:57:40.575498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.247 [2024-11-26 00:57:40.575498] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:50.247 [2024-11-26 00:57:40.636790] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:50.247 [2024-11-26 00:57:40.636876] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:52.774 00:57:43 -- event/event.sh@23 -- # for i in {0..2} 00:04:52.774 00:57:43 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:52.774 spdk_app_start Round 1 00:04:52.774 00:57:43 -- event/event.sh@25 -- # waitforlisten 929881 /var/tmp/spdk-nbd.sock 00:04:52.774 00:57:43 -- common/autotest_common.sh@829 -- # '[' -z 929881 ']' 00:04:52.774 00:57:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:52.774 00:57:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:52.774 00:57:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:52.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:52.774 00:57:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:52.774 00:57:43 -- common/autotest_common.sh@10 -- # set +x 00:04:53.032 00:57:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:53.032 00:57:43 -- common/autotest_common.sh@862 -- # return 0 00:04:53.032 00:57:43 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:53.290 Malloc0 00:04:53.290 00:57:43 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:53.548 Malloc1 00:04:53.548 00:57:43 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@12 -- # local i 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.548 00:57:43 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:53.806 /dev/nbd0 00:04:53.806 00:57:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:53.806 00:57:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:53.806 00:57:44 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:53.806 00:57:44 -- common/autotest_common.sh@867 -- # local i 00:04:53.806 00:57:44 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.806 00:57:44 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.806 00:57:44 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:53.806 00:57:44 -- common/autotest_common.sh@871 -- # break 00:04:53.806 00:57:44 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.806 00:57:44 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.806 00:57:44 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.806 1+0 records in 00:04:53.806 1+0 records out 00:04:53.806 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000159308 s, 25.7 MB/s 00:04:53.806 00:57:44 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.807 00:57:44 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.807 00:57:44 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.807 00:57:44 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.807 00:57:44 -- common/autotest_common.sh@887 -- # return 0 00:04:53.807 00:57:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.807 00:57:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.807 00:57:44 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:54.065 /dev/nbd1 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:54.065 00:57:44 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:54.065 00:57:44 -- common/autotest_common.sh@867 -- # local i 00:04:54.065 00:57:44 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:54.065 00:57:44 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:54.065 00:57:44 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:54.065 00:57:44 -- common/autotest_common.sh@871 -- # break 00:04:54.065 00:57:44 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:54.065 00:57:44 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:54.065 00:57:44 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:54.065 1+0 records in 00:04:54.065 1+0 records out 00:04:54.065 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000203144 s, 20.2 MB/s 00:04:54.065 00:57:44 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:54.065 00:57:44 -- common/autotest_common.sh@884 -- # size=4096 00:04:54.065 00:57:44 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:54.065 00:57:44 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:54.065 00:57:44 -- common/autotest_common.sh@887 -- # return 0 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.065 00:57:44 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.323 00:57:44 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:54.323 { 00:04:54.323 "nbd_device": "/dev/nbd0", 00:04:54.323 "bdev_name": "Malloc0" 00:04:54.323 }, 00:04:54.323 { 00:04:54.323 "nbd_device": "/dev/nbd1", 00:04:54.323 "bdev_name": "Malloc1" 00:04:54.323 } 00:04:54.323 ]' 00:04:54.323 00:57:44 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:54.323 { 00:04:54.323 "nbd_device": "/dev/nbd0", 00:04:54.323 "bdev_name": "Malloc0" 00:04:54.323 }, 00:04:54.323 { 00:04:54.323 "nbd_device": "/dev/nbd1", 00:04:54.323 "bdev_name": "Malloc1" 00:04:54.323 } 00:04:54.323 ]' 00:04:54.323 00:57:44 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:54.581 /dev/nbd1' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:54.581 /dev/nbd1' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@65 -- # count=2 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@95 -- # count=2 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:54.581 256+0 records in 00:04:54.581 256+0 records out 00:04:54.581 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00411611 s, 255 MB/s 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:54.581 256+0 records in 00:04:54.581 256+0 records out 00:04:54.581 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202962 s, 51.7 MB/s 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:54.581 256+0 records in 00:04:54.581 256+0 records out 00:04:54.581 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227819 s, 46.0 MB/s 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@51 -- # local i 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.581 00:57:44 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:54.838 00:57:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@41 -- # break 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.839 00:57:45 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@41 -- # break 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@45 -- # return 0 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:55.097 00:57:45 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@65 -- # true 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@65 -- # count=0 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@104 -- # count=0 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:55.355 00:57:45 -- bdev/nbd_common.sh@109 -- # return 0 00:04:55.355 00:57:45 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:55.613 00:57:46 -- event/event.sh@35 -- # sleep 3 00:04:55.870 [2024-11-26 00:57:46.320184] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:56.129 [2024-11-26 00:57:46.433415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:56.129 [2024-11-26 00:57:46.433420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.129 [2024-11-26 00:57:46.494830] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:56.129 [2024-11-26 00:57:46.494932] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:58.657 00:57:49 -- event/event.sh@23 -- # for i in {0..2} 00:04:58.657 00:57:49 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:04:58.657 spdk_app_start Round 2 00:04:58.657 00:57:49 -- event/event.sh@25 -- # waitforlisten 929881 /var/tmp/spdk-nbd.sock 00:04:58.657 00:57:49 -- common/autotest_common.sh@829 -- # '[' -z 929881 ']' 00:04:58.657 00:57:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:58.657 00:57:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:58.657 00:57:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:58.657 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:58.657 00:57:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:58.657 00:57:49 -- common/autotest_common.sh@10 -- # set +x 00:04:58.921 00:57:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.921 00:57:49 -- common/autotest_common.sh@862 -- # return 0 00:04:58.921 00:57:49 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:59.211 Malloc0 00:04:59.211 00:57:49 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:59.494 Malloc1 00:04:59.494 00:57:49 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@12 -- # local i 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.494 00:57:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:59.753 /dev/nbd0 00:04:59.753 00:57:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:59.753 00:57:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:59.753 00:57:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:59.753 00:57:50 -- common/autotest_common.sh@867 -- # local i 00:04:59.753 00:57:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.753 00:57:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.753 00:57:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:59.753 00:57:50 -- common/autotest_common.sh@871 -- # break 00:04:59.753 00:57:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.753 00:57:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.753 00:57:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.753 1+0 records in 00:04:59.753 1+0 records out 00:04:59.753 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000146578 s, 27.9 MB/s 00:04:59.753 00:57:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.753 00:57:50 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.753 00:57:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.753 00:57:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.753 00:57:50 -- common/autotest_common.sh@887 -- # return 0 00:04:59.753 00:57:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.753 00:57:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.753 00:57:50 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:00.010 /dev/nbd1 00:05:00.010 00:57:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:00.010 00:57:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:00.010 00:57:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:00.010 00:57:50 -- common/autotest_common.sh@867 -- # local i 00:05:00.010 00:57:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:00.010 00:57:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:00.010 00:57:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:00.010 00:57:50 -- common/autotest_common.sh@871 -- # break 00:05:00.010 00:57:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:00.010 00:57:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:00.011 00:57:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:00.011 1+0 records in 00:05:00.011 1+0 records out 00:05:00.011 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00021418 s, 19.1 MB/s 00:05:00.011 00:57:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:00.011 00:57:50 -- common/autotest_common.sh@884 -- # size=4096 00:05:00.011 00:57:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:00.011 00:57:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:00.011 00:57:50 -- common/autotest_common.sh@887 -- # return 0 00:05:00.011 00:57:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:00.011 00:57:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:00.011 00:57:50 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:00.011 00:57:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.011 00:57:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:00.269 { 00:05:00.269 "nbd_device": "/dev/nbd0", 00:05:00.269 "bdev_name": "Malloc0" 00:05:00.269 }, 00:05:00.269 { 00:05:00.269 "nbd_device": "/dev/nbd1", 00:05:00.269 "bdev_name": "Malloc1" 00:05:00.269 } 00:05:00.269 ]' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:00.269 { 00:05:00.269 "nbd_device": "/dev/nbd0", 00:05:00.269 "bdev_name": "Malloc0" 00:05:00.269 }, 00:05:00.269 { 00:05:00.269 "nbd_device": "/dev/nbd1", 00:05:00.269 "bdev_name": "Malloc1" 00:05:00.269 } 00:05:00.269 ]' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:00.269 /dev/nbd1' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:00.269 /dev/nbd1' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@65 -- # count=2 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@95 -- # count=2 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:00.269 256+0 records in 00:05:00.269 256+0 records out 00:05:00.269 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0051163 s, 205 MB/s 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:00.269 256+0 records in 00:05:00.269 256+0 records out 00:05:00.269 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227108 s, 46.2 MB/s 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:00.269 256+0 records in 00:05:00.269 256+0 records out 00:05:00.269 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212898 s, 49.3 MB/s 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@51 -- # local i 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.269 00:57:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@41 -- # break 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.526 00:57:51 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@41 -- # break 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@45 -- # return 0 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:01.091 00:57:51 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@65 -- # true 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@65 -- # count=0 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@104 -- # count=0 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:01.349 00:57:51 -- bdev/nbd_common.sh@109 -- # return 0 00:05:01.349 00:57:51 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:01.607 00:57:51 -- event/event.sh@35 -- # sleep 3 00:05:01.865 [2024-11-26 00:57:52.180544] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:01.865 [2024-11-26 00:57:52.295870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.865 [2024-11-26 00:57:52.295870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:01.865 [2024-11-26 00:57:52.352541] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:01.865 [2024-11-26 00:57:52.352634] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:04.393 00:57:54 -- event/event.sh@38 -- # waitforlisten 929881 /var/tmp/spdk-nbd.sock 00:05:04.393 00:57:54 -- common/autotest_common.sh@829 -- # '[' -z 929881 ']' 00:05:04.393 00:57:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:04.393 00:57:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:04.393 00:57:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:04.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:04.393 00:57:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:04.393 00:57:54 -- common/autotest_common.sh@10 -- # set +x 00:05:04.650 00:57:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.650 00:57:55 -- common/autotest_common.sh@862 -- # return 0 00:05:04.650 00:57:55 -- event/event.sh@39 -- # killprocess 929881 00:05:04.650 00:57:55 -- common/autotest_common.sh@936 -- # '[' -z 929881 ']' 00:05:04.650 00:57:55 -- common/autotest_common.sh@940 -- # kill -0 929881 00:05:04.650 00:57:55 -- common/autotest_common.sh@941 -- # uname 00:05:04.650 00:57:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:04.650 00:57:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 929881 00:05:04.908 00:57:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:04.908 00:57:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:04.908 00:57:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 929881' 00:05:04.908 killing process with pid 929881 00:05:04.908 00:57:55 -- common/autotest_common.sh@955 -- # kill 929881 00:05:04.908 00:57:55 -- common/autotest_common.sh@960 -- # wait 929881 00:05:05.167 spdk_app_start is called in Round 0. 00:05:05.167 Shutdown signal received, stop current app iteration 00:05:05.167 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:05.167 spdk_app_start is called in Round 1. 00:05:05.167 Shutdown signal received, stop current app iteration 00:05:05.167 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:05.167 spdk_app_start is called in Round 2. 00:05:05.167 Shutdown signal received, stop current app iteration 00:05:05.167 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:05.167 spdk_app_start is called in Round 3. 00:05:05.167 Shutdown signal received, stop current app iteration 00:05:05.167 00:57:55 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:05.167 00:57:55 -- event/event.sh@42 -- # return 0 00:05:05.167 00:05:05.167 real 0m18.914s 00:05:05.167 user 0m41.320s 00:05:05.167 sys 0m3.116s 00:05:05.167 00:57:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.167 00:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:05.167 ************************************ 00:05:05.167 END TEST app_repeat 00:05:05.167 ************************************ 00:05:05.167 00:57:55 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:05.167 00:57:55 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:05.167 00:57:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.167 00:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:05.167 ************************************ 00:05:05.167 START TEST cpu_locks 00:05:05.167 ************************************ 00:05:05.167 00:57:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:05.167 * Looking for test storage... 00:05:05.167 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:05.167 00:57:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:05.167 00:57:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:05.167 00:57:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:05.167 00:57:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:05.167 00:57:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:05.167 00:57:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:05.167 00:57:55 -- scripts/common.sh@335 -- # IFS=.-: 00:05:05.167 00:57:55 -- scripts/common.sh@335 -- # read -ra ver1 00:05:05.167 00:57:55 -- scripts/common.sh@336 -- # IFS=.-: 00:05:05.167 00:57:55 -- scripts/common.sh@336 -- # read -ra ver2 00:05:05.167 00:57:55 -- scripts/common.sh@337 -- # local 'op=<' 00:05:05.167 00:57:55 -- scripts/common.sh@339 -- # ver1_l=2 00:05:05.167 00:57:55 -- scripts/common.sh@340 -- # ver2_l=1 00:05:05.167 00:57:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:05.167 00:57:55 -- scripts/common.sh@343 -- # case "$op" in 00:05:05.167 00:57:55 -- scripts/common.sh@344 -- # : 1 00:05:05.167 00:57:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:05.167 00:57:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:05.167 00:57:55 -- scripts/common.sh@364 -- # decimal 1 00:05:05.167 00:57:55 -- scripts/common.sh@352 -- # local d=1 00:05:05.167 00:57:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:05.167 00:57:55 -- scripts/common.sh@354 -- # echo 1 00:05:05.167 00:57:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:05.167 00:57:55 -- scripts/common.sh@365 -- # decimal 2 00:05:05.167 00:57:55 -- scripts/common.sh@352 -- # local d=2 00:05:05.167 00:57:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:05.167 00:57:55 -- scripts/common.sh@354 -- # echo 2 00:05:05.167 00:57:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:05.167 00:57:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:05.167 00:57:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:05.167 00:57:55 -- scripts/common.sh@367 -- # return 0 00:05:05.167 00:57:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:05.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.167 --rc genhtml_branch_coverage=1 00:05:05.167 --rc genhtml_function_coverage=1 00:05:05.167 --rc genhtml_legend=1 00:05:05.167 --rc geninfo_all_blocks=1 00:05:05.167 --rc geninfo_unexecuted_blocks=1 00:05:05.167 00:05:05.167 ' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:05.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.167 --rc genhtml_branch_coverage=1 00:05:05.167 --rc genhtml_function_coverage=1 00:05:05.167 --rc genhtml_legend=1 00:05:05.167 --rc geninfo_all_blocks=1 00:05:05.167 --rc geninfo_unexecuted_blocks=1 00:05:05.167 00:05:05.167 ' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:05.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.167 --rc genhtml_branch_coverage=1 00:05:05.167 --rc genhtml_function_coverage=1 00:05:05.167 --rc genhtml_legend=1 00:05:05.167 --rc geninfo_all_blocks=1 00:05:05.167 --rc geninfo_unexecuted_blocks=1 00:05:05.167 00:05:05.167 ' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:05.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.167 --rc genhtml_branch_coverage=1 00:05:05.167 --rc genhtml_function_coverage=1 00:05:05.167 --rc genhtml_legend=1 00:05:05.167 --rc geninfo_all_blocks=1 00:05:05.167 --rc geninfo_unexecuted_blocks=1 00:05:05.167 00:05:05.167 ' 00:05:05.167 00:57:55 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:05.167 00:57:55 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:05.167 00:57:55 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:05.167 00:57:55 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:05.167 00:57:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.167 00:57:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.167 00:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:05.168 ************************************ 00:05:05.168 START TEST default_locks 00:05:05.168 ************************************ 00:05:05.168 00:57:55 -- common/autotest_common.sh@1114 -- # default_locks 00:05:05.168 00:57:55 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=932495 00:05:05.168 00:57:55 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:05.168 00:57:55 -- event/cpu_locks.sh@47 -- # waitforlisten 932495 00:05:05.168 00:57:55 -- common/autotest_common.sh@829 -- # '[' -z 932495 ']' 00:05:05.168 00:57:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:05.168 00:57:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:05.168 00:57:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:05.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:05.168 00:57:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:05.168 00:57:55 -- common/autotest_common.sh@10 -- # set +x 00:05:05.168 [2024-11-26 00:57:55.671475] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:05.168 [2024-11-26 00:57:55.671557] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid932495 ] 00:05:05.168 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.425 [2024-11-26 00:57:55.733762] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:05.425 [2024-11-26 00:57:55.846590] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:05.425 [2024-11-26 00:57:55.846790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:06.358 00:57:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:06.358 00:57:56 -- common/autotest_common.sh@862 -- # return 0 00:05:06.358 00:57:56 -- event/cpu_locks.sh@49 -- # locks_exist 932495 00:05:06.358 00:57:56 -- event/cpu_locks.sh@22 -- # lslocks -p 932495 00:05:06.358 00:57:56 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:06.615 lslocks: write error 00:05:06.615 00:57:56 -- event/cpu_locks.sh@50 -- # killprocess 932495 00:05:06.615 00:57:56 -- common/autotest_common.sh@936 -- # '[' -z 932495 ']' 00:05:06.615 00:57:56 -- common/autotest_common.sh@940 -- # kill -0 932495 00:05:06.615 00:57:56 -- common/autotest_common.sh@941 -- # uname 00:05:06.615 00:57:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:06.615 00:57:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 932495 00:05:06.615 00:57:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:06.615 00:57:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:06.615 00:57:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 932495' 00:05:06.615 killing process with pid 932495 00:05:06.615 00:57:56 -- common/autotest_common.sh@955 -- # kill 932495 00:05:06.615 00:57:56 -- common/autotest_common.sh@960 -- # wait 932495 00:05:07.182 00:57:57 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 932495 00:05:07.182 00:57:57 -- common/autotest_common.sh@650 -- # local es=0 00:05:07.182 00:57:57 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 932495 00:05:07.182 00:57:57 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:07.182 00:57:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:07.182 00:57:57 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:07.182 00:57:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:07.182 00:57:57 -- common/autotest_common.sh@653 -- # waitforlisten 932495 00:05:07.182 00:57:57 -- common/autotest_common.sh@829 -- # '[' -z 932495 ']' 00:05:07.182 00:57:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:07.182 00:57:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:07.182 00:57:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:07.182 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:07.182 00:57:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:07.182 00:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:07.182 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (932495) - No such process 00:05:07.182 ERROR: process (pid: 932495) is no longer running 00:05:07.182 00:57:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:07.182 00:57:57 -- common/autotest_common.sh@862 -- # return 1 00:05:07.182 00:57:57 -- common/autotest_common.sh@653 -- # es=1 00:05:07.182 00:57:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:07.182 00:57:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:07.182 00:57:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:07.182 00:57:57 -- event/cpu_locks.sh@54 -- # no_locks 00:05:07.182 00:57:57 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:07.182 00:57:57 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:07.182 00:57:57 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:07.182 00:05:07.182 real 0m1.801s 00:05:07.182 user 0m1.965s 00:05:07.182 sys 0m0.586s 00:05:07.182 00:57:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:07.182 00:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:07.182 ************************************ 00:05:07.182 END TEST default_locks 00:05:07.182 ************************************ 00:05:07.182 00:57:57 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:07.182 00:57:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:07.182 00:57:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:07.182 00:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:07.182 ************************************ 00:05:07.182 START TEST default_locks_via_rpc 00:05:07.182 ************************************ 00:05:07.182 00:57:57 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:07.182 00:57:57 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=932725 00:05:07.182 00:57:57 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:07.182 00:57:57 -- event/cpu_locks.sh@63 -- # waitforlisten 932725 00:05:07.182 00:57:57 -- common/autotest_common.sh@829 -- # '[' -z 932725 ']' 00:05:07.182 00:57:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:07.182 00:57:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:07.182 00:57:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:07.182 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:07.182 00:57:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:07.182 00:57:57 -- common/autotest_common.sh@10 -- # set +x 00:05:07.182 [2024-11-26 00:57:57.499077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:07.182 [2024-11-26 00:57:57.499187] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid932725 ] 00:05:07.182 EAL: No free 2048 kB hugepages reported on node 1 00:05:07.182 [2024-11-26 00:57:57.565888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:07.182 [2024-11-26 00:57:57.684133] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:07.182 [2024-11-26 00:57:57.684328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:08.116 00:57:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.116 00:57:58 -- common/autotest_common.sh@862 -- # return 0 00:05:08.116 00:57:58 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:08.116 00:57:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:08.116 00:57:58 -- common/autotest_common.sh@10 -- # set +x 00:05:08.116 00:57:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:08.116 00:57:58 -- event/cpu_locks.sh@67 -- # no_locks 00:05:08.116 00:57:58 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:08.116 00:57:58 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:08.116 00:57:58 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:08.116 00:57:58 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:08.116 00:57:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:08.116 00:57:58 -- common/autotest_common.sh@10 -- # set +x 00:05:08.116 00:57:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:08.116 00:57:58 -- event/cpu_locks.sh@71 -- # locks_exist 932725 00:05:08.116 00:57:58 -- event/cpu_locks.sh@22 -- # lslocks -p 932725 00:05:08.116 00:57:58 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:08.374 00:57:58 -- event/cpu_locks.sh@73 -- # killprocess 932725 00:05:08.374 00:57:58 -- common/autotest_common.sh@936 -- # '[' -z 932725 ']' 00:05:08.374 00:57:58 -- common/autotest_common.sh@940 -- # kill -0 932725 00:05:08.374 00:57:58 -- common/autotest_common.sh@941 -- # uname 00:05:08.374 00:57:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:08.374 00:57:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 932725 00:05:08.374 00:57:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:08.374 00:57:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:08.374 00:57:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 932725' 00:05:08.374 killing process with pid 932725 00:05:08.374 00:57:58 -- common/autotest_common.sh@955 -- # kill 932725 00:05:08.374 00:57:58 -- common/autotest_common.sh@960 -- # wait 932725 00:05:08.940 00:05:08.940 real 0m1.830s 00:05:08.940 user 0m2.056s 00:05:08.940 sys 0m0.564s 00:05:08.940 00:57:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:08.940 00:57:59 -- common/autotest_common.sh@10 -- # set +x 00:05:08.940 ************************************ 00:05:08.940 END TEST default_locks_via_rpc 00:05:08.940 ************************************ 00:05:08.940 00:57:59 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:08.940 00:57:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:08.940 00:57:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:08.940 00:57:59 -- common/autotest_common.sh@10 -- # set +x 00:05:08.940 ************************************ 00:05:08.940 START TEST non_locking_app_on_locked_coremask 00:05:08.940 ************************************ 00:05:08.940 00:57:59 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:08.940 00:57:59 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=933016 00:05:08.940 00:57:59 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:08.940 00:57:59 -- event/cpu_locks.sh@81 -- # waitforlisten 933016 /var/tmp/spdk.sock 00:05:08.940 00:57:59 -- common/autotest_common.sh@829 -- # '[' -z 933016 ']' 00:05:08.940 00:57:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:08.940 00:57:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.940 00:57:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:08.940 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:08.940 00:57:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.940 00:57:59 -- common/autotest_common.sh@10 -- # set +x 00:05:08.940 [2024-11-26 00:57:59.348530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:08.940 [2024-11-26 00:57:59.348628] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid933016 ] 00:05:08.940 EAL: No free 2048 kB hugepages reported on node 1 00:05:08.940 [2024-11-26 00:57:59.406237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:09.199 [2024-11-26 00:57:59.514607] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:09.199 [2024-11-26 00:57:59.514798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.133 00:58:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.134 00:58:00 -- common/autotest_common.sh@862 -- # return 0 00:05:10.134 00:58:00 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=933156 00:05:10.134 00:58:00 -- event/cpu_locks.sh@85 -- # waitforlisten 933156 /var/tmp/spdk2.sock 00:05:10.134 00:58:00 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:10.134 00:58:00 -- common/autotest_common.sh@829 -- # '[' -z 933156 ']' 00:05:10.134 00:58:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:10.134 00:58:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.134 00:58:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:10.134 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:10.134 00:58:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.134 00:58:00 -- common/autotest_common.sh@10 -- # set +x 00:05:10.134 [2024-11-26 00:58:00.396461] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.134 [2024-11-26 00:58:00.396537] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid933156 ] 00:05:10.134 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.134 [2024-11-26 00:58:00.487762] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:10.134 [2024-11-26 00:58:00.487797] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.392 [2024-11-26 00:58:00.719577] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:10.392 [2024-11-26 00:58:00.719775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.958 00:58:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.958 00:58:01 -- common/autotest_common.sh@862 -- # return 0 00:05:10.958 00:58:01 -- event/cpu_locks.sh@87 -- # locks_exist 933016 00:05:10.958 00:58:01 -- event/cpu_locks.sh@22 -- # lslocks -p 933016 00:05:10.958 00:58:01 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:11.219 lslocks: write error 00:05:11.219 00:58:01 -- event/cpu_locks.sh@89 -- # killprocess 933016 00:05:11.219 00:58:01 -- common/autotest_common.sh@936 -- # '[' -z 933016 ']' 00:05:11.219 00:58:01 -- common/autotest_common.sh@940 -- # kill -0 933016 00:05:11.219 00:58:01 -- common/autotest_common.sh@941 -- # uname 00:05:11.219 00:58:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.219 00:58:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 933016 00:05:11.219 00:58:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.219 00:58:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.219 00:58:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 933016' 00:05:11.219 killing process with pid 933016 00:05:11.219 00:58:01 -- common/autotest_common.sh@955 -- # kill 933016 00:05:11.219 00:58:01 -- common/autotest_common.sh@960 -- # wait 933016 00:05:12.155 00:58:02 -- event/cpu_locks.sh@90 -- # killprocess 933156 00:05:12.155 00:58:02 -- common/autotest_common.sh@936 -- # '[' -z 933156 ']' 00:05:12.155 00:58:02 -- common/autotest_common.sh@940 -- # kill -0 933156 00:05:12.155 00:58:02 -- common/autotest_common.sh@941 -- # uname 00:05:12.155 00:58:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:12.155 00:58:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 933156 00:05:12.155 00:58:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:12.155 00:58:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:12.155 00:58:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 933156' 00:05:12.155 killing process with pid 933156 00:05:12.155 00:58:02 -- common/autotest_common.sh@955 -- # kill 933156 00:05:12.155 00:58:02 -- common/autotest_common.sh@960 -- # wait 933156 00:05:12.722 00:05:12.722 real 0m3.852s 00:05:12.722 user 0m4.294s 00:05:12.722 sys 0m1.017s 00:05:12.722 00:58:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.722 00:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:12.722 ************************************ 00:05:12.722 END TEST non_locking_app_on_locked_coremask 00:05:12.722 ************************************ 00:05:12.722 00:58:03 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:12.722 00:58:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.722 00:58:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.722 00:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:12.722 ************************************ 00:05:12.722 START TEST locking_app_on_unlocked_coremask 00:05:12.722 ************************************ 00:05:12.722 00:58:03 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:12.722 00:58:03 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=933472 00:05:12.722 00:58:03 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:12.722 00:58:03 -- event/cpu_locks.sh@99 -- # waitforlisten 933472 /var/tmp/spdk.sock 00:05:12.722 00:58:03 -- common/autotest_common.sh@829 -- # '[' -z 933472 ']' 00:05:12.722 00:58:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.722 00:58:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.722 00:58:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.722 00:58:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.722 00:58:03 -- common/autotest_common.sh@10 -- # set +x 00:05:12.722 [2024-11-26 00:58:03.232245] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.722 [2024-11-26 00:58:03.232341] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid933472 ] 00:05:12.981 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.981 [2024-11-26 00:58:03.291351] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:12.981 [2024-11-26 00:58:03.291396] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.981 [2024-11-26 00:58:03.398400] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.981 [2024-11-26 00:58:03.398569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.916 00:58:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.916 00:58:04 -- common/autotest_common.sh@862 -- # return 0 00:05:13.916 00:58:04 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=933608 00:05:13.916 00:58:04 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:13.916 00:58:04 -- event/cpu_locks.sh@103 -- # waitforlisten 933608 /var/tmp/spdk2.sock 00:05:13.916 00:58:04 -- common/autotest_common.sh@829 -- # '[' -z 933608 ']' 00:05:13.916 00:58:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:13.916 00:58:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:13.916 00:58:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:13.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:13.916 00:58:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:13.916 00:58:04 -- common/autotest_common.sh@10 -- # set +x 00:05:13.916 [2024-11-26 00:58:04.252882] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:13.916 [2024-11-26 00:58:04.252971] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid933608 ] 00:05:13.916 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.916 [2024-11-26 00:58:04.351007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.174 [2024-11-26 00:58:04.582866] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.174 [2024-11-26 00:58:04.583056] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.741 00:58:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:14.741 00:58:05 -- common/autotest_common.sh@862 -- # return 0 00:05:14.741 00:58:05 -- event/cpu_locks.sh@105 -- # locks_exist 933608 00:05:14.741 00:58:05 -- event/cpu_locks.sh@22 -- # lslocks -p 933608 00:05:14.741 00:58:05 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:15.307 lslocks: write error 00:05:15.307 00:58:05 -- event/cpu_locks.sh@107 -- # killprocess 933472 00:05:15.307 00:58:05 -- common/autotest_common.sh@936 -- # '[' -z 933472 ']' 00:05:15.307 00:58:05 -- common/autotest_common.sh@940 -- # kill -0 933472 00:05:15.307 00:58:05 -- common/autotest_common.sh@941 -- # uname 00:05:15.307 00:58:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:15.307 00:58:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 933472 00:05:15.307 00:58:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:15.307 00:58:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:15.307 00:58:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 933472' 00:05:15.307 killing process with pid 933472 00:05:15.307 00:58:05 -- common/autotest_common.sh@955 -- # kill 933472 00:05:15.307 00:58:05 -- common/autotest_common.sh@960 -- # wait 933472 00:05:16.241 00:58:06 -- event/cpu_locks.sh@108 -- # killprocess 933608 00:05:16.241 00:58:06 -- common/autotest_common.sh@936 -- # '[' -z 933608 ']' 00:05:16.241 00:58:06 -- common/autotest_common.sh@940 -- # kill -0 933608 00:05:16.241 00:58:06 -- common/autotest_common.sh@941 -- # uname 00:05:16.241 00:58:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.241 00:58:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 933608 00:05:16.241 00:58:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.241 00:58:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.241 00:58:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 933608' 00:05:16.241 killing process with pid 933608 00:05:16.241 00:58:06 -- common/autotest_common.sh@955 -- # kill 933608 00:05:16.241 00:58:06 -- common/autotest_common.sh@960 -- # wait 933608 00:05:16.499 00:05:16.499 real 0m3.815s 00:05:16.499 user 0m4.187s 00:05:16.499 sys 0m1.079s 00:05:16.499 00:58:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.499 00:58:06 -- common/autotest_common.sh@10 -- # set +x 00:05:16.499 ************************************ 00:05:16.499 END TEST locking_app_on_unlocked_coremask 00:05:16.499 ************************************ 00:05:16.499 00:58:07 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:16.499 00:58:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:16.499 00:58:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:16.499 00:58:07 -- common/autotest_common.sh@10 -- # set +x 00:05:16.499 ************************************ 00:05:16.499 START TEST locking_app_on_locked_coremask 00:05:16.499 ************************************ 00:05:16.499 00:58:07 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:16.499 00:58:07 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=934056 00:05:16.499 00:58:07 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:16.499 00:58:07 -- event/cpu_locks.sh@116 -- # waitforlisten 934056 /var/tmp/spdk.sock 00:05:16.499 00:58:07 -- common/autotest_common.sh@829 -- # '[' -z 934056 ']' 00:05:16.499 00:58:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:16.499 00:58:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:16.499 00:58:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:16.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:16.499 00:58:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:16.499 00:58:07 -- common/autotest_common.sh@10 -- # set +x 00:05:16.758 [2024-11-26 00:58:07.073948] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:16.758 [2024-11-26 00:58:07.074062] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934056 ] 00:05:16.758 EAL: No free 2048 kB hugepages reported on node 1 00:05:16.758 [2024-11-26 00:58:07.135343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:16.758 [2024-11-26 00:58:07.247668] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:16.758 [2024-11-26 00:58:07.247871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.692 00:58:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:17.692 00:58:08 -- common/autotest_common.sh@862 -- # return 0 00:05:17.692 00:58:08 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=934202 00:05:17.693 00:58:08 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:17.693 00:58:08 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 934202 /var/tmp/spdk2.sock 00:05:17.693 00:58:08 -- common/autotest_common.sh@650 -- # local es=0 00:05:17.693 00:58:08 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 934202 /var/tmp/spdk2.sock 00:05:17.693 00:58:08 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:17.693 00:58:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:17.693 00:58:08 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:17.693 00:58:08 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:17.693 00:58:08 -- common/autotest_common.sh@653 -- # waitforlisten 934202 /var/tmp/spdk2.sock 00:05:17.693 00:58:08 -- common/autotest_common.sh@829 -- # '[' -z 934202 ']' 00:05:17.693 00:58:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:17.693 00:58:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:17.693 00:58:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:17.693 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:17.693 00:58:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:17.693 00:58:08 -- common/autotest_common.sh@10 -- # set +x 00:05:17.693 [2024-11-26 00:58:08.074374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:17.693 [2024-11-26 00:58:08.074459] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934202 ] 00:05:17.693 EAL: No free 2048 kB hugepages reported on node 1 00:05:17.693 [2024-11-26 00:58:08.161900] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 934056 has claimed it. 00:05:17.693 [2024-11-26 00:58:08.161965] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:18.258 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (934202) - No such process 00:05:18.258 ERROR: process (pid: 934202) is no longer running 00:05:18.258 00:58:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.258 00:58:08 -- common/autotest_common.sh@862 -- # return 1 00:05:18.258 00:58:08 -- common/autotest_common.sh@653 -- # es=1 00:05:18.258 00:58:08 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:18.258 00:58:08 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:18.258 00:58:08 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:18.258 00:58:08 -- event/cpu_locks.sh@122 -- # locks_exist 934056 00:05:18.258 00:58:08 -- event/cpu_locks.sh@22 -- # lslocks -p 934056 00:05:18.258 00:58:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:18.516 lslocks: write error 00:05:18.516 00:58:09 -- event/cpu_locks.sh@124 -- # killprocess 934056 00:05:18.516 00:58:09 -- common/autotest_common.sh@936 -- # '[' -z 934056 ']' 00:05:18.516 00:58:09 -- common/autotest_common.sh@940 -- # kill -0 934056 00:05:18.516 00:58:09 -- common/autotest_common.sh@941 -- # uname 00:05:18.516 00:58:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.516 00:58:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 934056 00:05:18.773 00:58:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.773 00:58:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.773 00:58:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 934056' 00:05:18.773 killing process with pid 934056 00:05:18.773 00:58:09 -- common/autotest_common.sh@955 -- # kill 934056 00:05:18.773 00:58:09 -- common/autotest_common.sh@960 -- # wait 934056 00:05:19.030 00:05:19.030 real 0m2.480s 00:05:19.030 user 0m2.866s 00:05:19.030 sys 0m0.631s 00:05:19.030 00:58:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.030 00:58:09 -- common/autotest_common.sh@10 -- # set +x 00:05:19.030 ************************************ 00:05:19.030 END TEST locking_app_on_locked_coremask 00:05:19.030 ************************************ 00:05:19.030 00:58:09 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:19.030 00:58:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.030 00:58:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.030 00:58:09 -- common/autotest_common.sh@10 -- # set +x 00:05:19.030 ************************************ 00:05:19.030 START TEST locking_overlapped_coremask 00:05:19.030 ************************************ 00:05:19.030 00:58:09 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:19.030 00:58:09 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=934369 00:05:19.030 00:58:09 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:19.030 00:58:09 -- event/cpu_locks.sh@133 -- # waitforlisten 934369 /var/tmp/spdk.sock 00:05:19.030 00:58:09 -- common/autotest_common.sh@829 -- # '[' -z 934369 ']' 00:05:19.030 00:58:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.030 00:58:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.030 00:58:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.030 00:58:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.030 00:58:09 -- common/autotest_common.sh@10 -- # set +x 00:05:19.288 [2024-11-26 00:58:09.580848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.288 [2024-11-26 00:58:09.580936] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934369 ] 00:05:19.288 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.288 [2024-11-26 00:58:09.639176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:19.288 [2024-11-26 00:58:09.748059] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.288 [2024-11-26 00:58:09.748264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:19.288 [2024-11-26 00:58:09.748325] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:19.288 [2024-11-26 00:58:09.748328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.220 00:58:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.220 00:58:10 -- common/autotest_common.sh@862 -- # return 0 00:05:20.220 00:58:10 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=934511 00:05:20.220 00:58:10 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 934511 /var/tmp/spdk2.sock 00:05:20.220 00:58:10 -- common/autotest_common.sh@650 -- # local es=0 00:05:20.220 00:58:10 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 934511 /var/tmp/spdk2.sock 00:05:20.220 00:58:10 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:20.220 00:58:10 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:20.220 00:58:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:20.220 00:58:10 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:20.220 00:58:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:20.220 00:58:10 -- common/autotest_common.sh@653 -- # waitforlisten 934511 /var/tmp/spdk2.sock 00:05:20.220 00:58:10 -- common/autotest_common.sh@829 -- # '[' -z 934511 ']' 00:05:20.220 00:58:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:20.220 00:58:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.220 00:58:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:20.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:20.220 00:58:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.220 00:58:10 -- common/autotest_common.sh@10 -- # set +x 00:05:20.220 [2024-11-26 00:58:10.598452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.220 [2024-11-26 00:58:10.598539] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934511 ] 00:05:20.220 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.220 [2024-11-26 00:58:10.686682] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 934369 has claimed it. 00:05:20.220 [2024-11-26 00:58:10.686747] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:20.785 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (934511) - No such process 00:05:20.785 ERROR: process (pid: 934511) is no longer running 00:05:20.785 00:58:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.785 00:58:11 -- common/autotest_common.sh@862 -- # return 1 00:05:20.785 00:58:11 -- common/autotest_common.sh@653 -- # es=1 00:05:20.785 00:58:11 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:20.785 00:58:11 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:20.785 00:58:11 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:20.785 00:58:11 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:20.785 00:58:11 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:20.785 00:58:11 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:20.785 00:58:11 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:20.785 00:58:11 -- event/cpu_locks.sh@141 -- # killprocess 934369 00:05:20.785 00:58:11 -- common/autotest_common.sh@936 -- # '[' -z 934369 ']' 00:05:20.785 00:58:11 -- common/autotest_common.sh@940 -- # kill -0 934369 00:05:20.785 00:58:11 -- common/autotest_common.sh@941 -- # uname 00:05:20.785 00:58:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.785 00:58:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 934369 00:05:21.043 00:58:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.043 00:58:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.043 00:58:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 934369' 00:05:21.043 killing process with pid 934369 00:05:21.043 00:58:11 -- common/autotest_common.sh@955 -- # kill 934369 00:05:21.043 00:58:11 -- common/autotest_common.sh@960 -- # wait 934369 00:05:21.303 00:05:21.303 real 0m2.240s 00:05:21.303 user 0m6.356s 00:05:21.303 sys 0m0.503s 00:05:21.303 00:58:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.303 00:58:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.303 ************************************ 00:05:21.303 END TEST locking_overlapped_coremask 00:05:21.303 ************************************ 00:05:21.303 00:58:11 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:21.303 00:58:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.303 00:58:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.303 00:58:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.303 ************************************ 00:05:21.303 START TEST locking_overlapped_coremask_via_rpc 00:05:21.303 ************************************ 00:05:21.303 00:58:11 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:21.303 00:58:11 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=934683 00:05:21.303 00:58:11 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:21.303 00:58:11 -- event/cpu_locks.sh@149 -- # waitforlisten 934683 /var/tmp/spdk.sock 00:05:21.303 00:58:11 -- common/autotest_common.sh@829 -- # '[' -z 934683 ']' 00:05:21.303 00:58:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.303 00:58:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.303 00:58:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.303 00:58:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.303 00:58:11 -- common/autotest_common.sh@10 -- # set +x 00:05:21.562 [2024-11-26 00:58:11.847019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.562 [2024-11-26 00:58:11.847098] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934683 ] 00:05:21.562 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.562 [2024-11-26 00:58:11.907667] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:21.562 [2024-11-26 00:58:11.907726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:21.562 [2024-11-26 00:58:12.020277] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.562 [2024-11-26 00:58:12.020524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:21.562 [2024-11-26 00:58:12.020579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:21.562 [2024-11-26 00:58:12.020596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.497 00:58:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.497 00:58:12 -- common/autotest_common.sh@862 -- # return 0 00:05:22.497 00:58:12 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=934825 00:05:22.497 00:58:12 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:22.497 00:58:12 -- event/cpu_locks.sh@153 -- # waitforlisten 934825 /var/tmp/spdk2.sock 00:05:22.497 00:58:12 -- common/autotest_common.sh@829 -- # '[' -z 934825 ']' 00:05:22.497 00:58:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.497 00:58:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.497 00:58:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.497 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.497 00:58:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.497 00:58:12 -- common/autotest_common.sh@10 -- # set +x 00:05:22.497 [2024-11-26 00:58:12.837737] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.497 [2024-11-26 00:58:12.837827] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid934825 ] 00:05:22.497 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.497 [2024-11-26 00:58:12.923902] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:22.497 [2024-11-26 00:58:12.923943] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:22.756 [2024-11-26 00:58:13.134640] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.756 [2024-11-26 00:58:13.138858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:22.756 [2024-11-26 00:58:13.138921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:22.756 [2024-11-26 00:58:13.138924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:23.321 00:58:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.321 00:58:13 -- common/autotest_common.sh@862 -- # return 0 00:05:23.321 00:58:13 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:23.321 00:58:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:23.321 00:58:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.321 00:58:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:23.321 00:58:13 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:23.321 00:58:13 -- common/autotest_common.sh@650 -- # local es=0 00:05:23.321 00:58:13 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:23.321 00:58:13 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:23.321 00:58:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.321 00:58:13 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:23.321 00:58:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:23.321 00:58:13 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:23.321 00:58:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:23.321 00:58:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.321 [2024-11-26 00:58:13.817791] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 934683 has claimed it. 00:05:23.321 request: 00:05:23.321 { 00:05:23.321 "method": "framework_enable_cpumask_locks", 00:05:23.321 "req_id": 1 00:05:23.321 } 00:05:23.321 Got JSON-RPC error response 00:05:23.321 response: 00:05:23.321 { 00:05:23.321 "code": -32603, 00:05:23.321 "message": "Failed to claim CPU core: 2" 00:05:23.321 } 00:05:23.321 00:58:13 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:23.321 00:58:13 -- common/autotest_common.sh@653 -- # es=1 00:05:23.321 00:58:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:23.321 00:58:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:23.321 00:58:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:23.321 00:58:13 -- event/cpu_locks.sh@158 -- # waitforlisten 934683 /var/tmp/spdk.sock 00:05:23.321 00:58:13 -- common/autotest_common.sh@829 -- # '[' -z 934683 ']' 00:05:23.321 00:58:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:23.321 00:58:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.321 00:58:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:23.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:23.321 00:58:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.321 00:58:13 -- common/autotest_common.sh@10 -- # set +x 00:05:23.579 00:58:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.579 00:58:14 -- common/autotest_common.sh@862 -- # return 0 00:05:23.579 00:58:14 -- event/cpu_locks.sh@159 -- # waitforlisten 934825 /var/tmp/spdk2.sock 00:05:23.579 00:58:14 -- common/autotest_common.sh@829 -- # '[' -z 934825 ']' 00:05:23.579 00:58:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:23.579 00:58:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.579 00:58:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:23.579 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:23.579 00:58:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.579 00:58:14 -- common/autotest_common.sh@10 -- # set +x 00:05:23.836 00:58:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.836 00:58:14 -- common/autotest_common.sh@862 -- # return 0 00:05:23.836 00:58:14 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:23.836 00:58:14 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:23.836 00:58:14 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:23.836 00:58:14 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:23.836 00:05:23.836 real 0m2.525s 00:05:23.836 user 0m1.251s 00:05:23.836 sys 0m0.203s 00:05:23.836 00:58:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:23.836 00:58:14 -- common/autotest_common.sh@10 -- # set +x 00:05:23.836 ************************************ 00:05:23.836 END TEST locking_overlapped_coremask_via_rpc 00:05:23.836 ************************************ 00:05:23.836 00:58:14 -- event/cpu_locks.sh@174 -- # cleanup 00:05:23.836 00:58:14 -- event/cpu_locks.sh@15 -- # [[ -z 934683 ]] 00:05:23.836 00:58:14 -- event/cpu_locks.sh@15 -- # killprocess 934683 00:05:23.836 00:58:14 -- common/autotest_common.sh@936 -- # '[' -z 934683 ']' 00:05:23.836 00:58:14 -- common/autotest_common.sh@940 -- # kill -0 934683 00:05:23.836 00:58:14 -- common/autotest_common.sh@941 -- # uname 00:05:23.836 00:58:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:23.836 00:58:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 934683 00:05:24.093 00:58:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.093 00:58:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.093 00:58:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 934683' 00:05:24.093 killing process with pid 934683 00:05:24.093 00:58:14 -- common/autotest_common.sh@955 -- # kill 934683 00:05:24.093 00:58:14 -- common/autotest_common.sh@960 -- # wait 934683 00:05:24.350 00:58:14 -- event/cpu_locks.sh@16 -- # [[ -z 934825 ]] 00:05:24.350 00:58:14 -- event/cpu_locks.sh@16 -- # killprocess 934825 00:05:24.350 00:58:14 -- common/autotest_common.sh@936 -- # '[' -z 934825 ']' 00:05:24.350 00:58:14 -- common/autotest_common.sh@940 -- # kill -0 934825 00:05:24.350 00:58:14 -- common/autotest_common.sh@941 -- # uname 00:05:24.350 00:58:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.350 00:58:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 934825 00:05:24.350 00:58:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:24.350 00:58:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:24.350 00:58:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 934825' 00:05:24.350 killing process with pid 934825 00:05:24.350 00:58:14 -- common/autotest_common.sh@955 -- # kill 934825 00:05:24.350 00:58:14 -- common/autotest_common.sh@960 -- # wait 934825 00:05:24.982 00:58:15 -- event/cpu_locks.sh@18 -- # rm -f 00:05:24.982 00:58:15 -- event/cpu_locks.sh@1 -- # cleanup 00:05:24.982 00:58:15 -- event/cpu_locks.sh@15 -- # [[ -z 934683 ]] 00:05:24.982 00:58:15 -- event/cpu_locks.sh@15 -- # killprocess 934683 00:05:24.982 00:58:15 -- common/autotest_common.sh@936 -- # '[' -z 934683 ']' 00:05:24.982 00:58:15 -- common/autotest_common.sh@940 -- # kill -0 934683 00:05:24.982 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (934683) - No such process 00:05:24.982 00:58:15 -- common/autotest_common.sh@963 -- # echo 'Process with pid 934683 is not found' 00:05:24.982 Process with pid 934683 is not found 00:05:24.982 00:58:15 -- event/cpu_locks.sh@16 -- # [[ -z 934825 ]] 00:05:24.982 00:58:15 -- event/cpu_locks.sh@16 -- # killprocess 934825 00:05:24.982 00:58:15 -- common/autotest_common.sh@936 -- # '[' -z 934825 ']' 00:05:24.982 00:58:15 -- common/autotest_common.sh@940 -- # kill -0 934825 00:05:24.982 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (934825) - No such process 00:05:24.982 00:58:15 -- common/autotest_common.sh@963 -- # echo 'Process with pid 934825 is not found' 00:05:24.982 Process with pid 934825 is not found 00:05:24.982 00:58:15 -- event/cpu_locks.sh@18 -- # rm -f 00:05:24.982 00:05:24.982 real 0m19.853s 00:05:24.982 user 0m35.710s 00:05:24.982 sys 0m5.446s 00:05:24.982 00:58:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.982 00:58:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.982 ************************************ 00:05:24.982 END TEST cpu_locks 00:05:24.982 ************************************ 00:05:24.982 00:05:24.982 real 0m47.330s 00:05:24.982 user 1m30.817s 00:05:24.982 sys 0m9.315s 00:05:24.983 00:58:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.983 00:58:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.983 ************************************ 00:05:24.983 END TEST event 00:05:24.983 ************************************ 00:05:24.983 00:58:15 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:24.983 00:58:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.983 00:58:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.983 00:58:15 -- common/autotest_common.sh@10 -- # set +x 00:05:24.983 ************************************ 00:05:24.983 START TEST thread 00:05:24.983 ************************************ 00:05:24.983 00:58:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:24.983 * Looking for test storage... 00:05:24.983 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:24.983 00:58:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:24.983 00:58:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:24.983 00:58:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:24.983 00:58:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:24.983 00:58:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:24.983 00:58:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:24.983 00:58:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:24.983 00:58:15 -- scripts/common.sh@335 -- # IFS=.-: 00:05:24.983 00:58:15 -- scripts/common.sh@335 -- # read -ra ver1 00:05:24.983 00:58:15 -- scripts/common.sh@336 -- # IFS=.-: 00:05:24.983 00:58:15 -- scripts/common.sh@336 -- # read -ra ver2 00:05:24.983 00:58:15 -- scripts/common.sh@337 -- # local 'op=<' 00:05:24.983 00:58:15 -- scripts/common.sh@339 -- # ver1_l=2 00:05:24.983 00:58:15 -- scripts/common.sh@340 -- # ver2_l=1 00:05:24.983 00:58:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:24.983 00:58:15 -- scripts/common.sh@343 -- # case "$op" in 00:05:24.983 00:58:15 -- scripts/common.sh@344 -- # : 1 00:05:24.983 00:58:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:24.983 00:58:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:24.983 00:58:15 -- scripts/common.sh@364 -- # decimal 1 00:05:24.983 00:58:15 -- scripts/common.sh@352 -- # local d=1 00:05:24.983 00:58:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:24.983 00:58:15 -- scripts/common.sh@354 -- # echo 1 00:05:25.241 00:58:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:25.241 00:58:15 -- scripts/common.sh@365 -- # decimal 2 00:05:25.241 00:58:15 -- scripts/common.sh@352 -- # local d=2 00:05:25.241 00:58:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:25.241 00:58:15 -- scripts/common.sh@354 -- # echo 2 00:05:25.241 00:58:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:25.241 00:58:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:25.241 00:58:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:25.241 00:58:15 -- scripts/common.sh@367 -- # return 0 00:05:25.241 00:58:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:25.241 00:58:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:25.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.241 --rc genhtml_branch_coverage=1 00:05:25.241 --rc genhtml_function_coverage=1 00:05:25.241 --rc genhtml_legend=1 00:05:25.241 --rc geninfo_all_blocks=1 00:05:25.241 --rc geninfo_unexecuted_blocks=1 00:05:25.241 00:05:25.241 ' 00:05:25.241 00:58:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:25.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.241 --rc genhtml_branch_coverage=1 00:05:25.241 --rc genhtml_function_coverage=1 00:05:25.241 --rc genhtml_legend=1 00:05:25.241 --rc geninfo_all_blocks=1 00:05:25.241 --rc geninfo_unexecuted_blocks=1 00:05:25.241 00:05:25.241 ' 00:05:25.241 00:58:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:25.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.241 --rc genhtml_branch_coverage=1 00:05:25.241 --rc genhtml_function_coverage=1 00:05:25.241 --rc genhtml_legend=1 00:05:25.241 --rc geninfo_all_blocks=1 00:05:25.241 --rc geninfo_unexecuted_blocks=1 00:05:25.241 00:05:25.241 ' 00:05:25.241 00:58:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:25.241 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:25.241 --rc genhtml_branch_coverage=1 00:05:25.241 --rc genhtml_function_coverage=1 00:05:25.241 --rc genhtml_legend=1 00:05:25.241 --rc geninfo_all_blocks=1 00:05:25.241 --rc geninfo_unexecuted_blocks=1 00:05:25.241 00:05:25.241 ' 00:05:25.241 00:58:15 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:25.241 00:58:15 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:25.241 00:58:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:25.241 00:58:15 -- common/autotest_common.sh@10 -- # set +x 00:05:25.241 ************************************ 00:05:25.241 START TEST thread_poller_perf 00:05:25.241 ************************************ 00:05:25.241 00:58:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:25.241 [2024-11-26 00:58:15.538181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.241 [2024-11-26 00:58:15.538260] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid935202 ] 00:05:25.241 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.241 [2024-11-26 00:58:15.597607] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.241 [2024-11-26 00:58:15.708674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.241 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:26.614 [2024-11-25T23:58:17.149Z] ====================================== 00:05:26.614 [2024-11-25T23:58:17.149Z] busy:2709695518 (cyc) 00:05:26.614 [2024-11-25T23:58:17.149Z] total_run_count: 279000 00:05:26.614 [2024-11-25T23:58:17.149Z] tsc_hz: 2700000000 (cyc) 00:05:26.614 [2024-11-25T23:58:17.149Z] ====================================== 00:05:26.614 [2024-11-25T23:58:17.149Z] poller_cost: 9712 (cyc), 3597 (nsec) 00:05:26.614 00:05:26.614 real 0m1.316s 00:05:26.614 user 0m1.223s 00:05:26.614 sys 0m0.086s 00:05:26.614 00:58:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.614 00:58:16 -- common/autotest_common.sh@10 -- # set +x 00:05:26.614 ************************************ 00:05:26.614 END TEST thread_poller_perf 00:05:26.614 ************************************ 00:05:26.614 00:58:16 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:26.614 00:58:16 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:26.614 00:58:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.614 00:58:16 -- common/autotest_common.sh@10 -- # set +x 00:05:26.614 ************************************ 00:05:26.614 START TEST thread_poller_perf 00:05:26.614 ************************************ 00:05:26.614 00:58:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:26.614 [2024-11-26 00:58:16.884483] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.615 [2024-11-26 00:58:16.884566] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid935362 ] 00:05:26.615 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.615 [2024-11-26 00:58:16.949786] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.615 [2024-11-26 00:58:17.066806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.615 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:27.988 [2024-11-25T23:58:18.523Z] ====================================== 00:05:27.988 [2024-11-25T23:58:18.523Z] busy:2703707220 (cyc) 00:05:27.988 [2024-11-25T23:58:18.523Z] total_run_count: 3819000 00:05:27.988 [2024-11-25T23:58:18.523Z] tsc_hz: 2700000000 (cyc) 00:05:27.988 [2024-11-25T23:58:18.523Z] ====================================== 00:05:27.988 [2024-11-25T23:58:18.523Z] poller_cost: 707 (cyc), 261 (nsec) 00:05:27.988 00:05:27.988 real 0m1.317s 00:05:27.988 user 0m1.224s 00:05:27.988 sys 0m0.085s 00:05:27.988 00:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.988 00:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.988 ************************************ 00:05:27.988 END TEST thread_poller_perf 00:05:27.988 ************************************ 00:05:27.988 00:58:18 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:27.988 00:05:27.988 real 0m2.827s 00:05:27.988 user 0m2.562s 00:05:27.988 sys 0m0.269s 00:05:27.988 00:58:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.988 00:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.988 ************************************ 00:05:27.988 END TEST thread 00:05:27.988 ************************************ 00:05:27.988 00:58:18 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:27.988 00:58:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.988 00:58:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.988 00:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.988 ************************************ 00:05:27.988 START TEST accel 00:05:27.988 ************************************ 00:05:27.988 00:58:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:27.988 * Looking for test storage... 00:05:27.988 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:27.988 00:58:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:27.988 00:58:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:27.988 00:58:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:27.988 00:58:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:27.988 00:58:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:27.988 00:58:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:27.988 00:58:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:27.988 00:58:18 -- scripts/common.sh@335 -- # IFS=.-: 00:05:27.988 00:58:18 -- scripts/common.sh@335 -- # read -ra ver1 00:05:27.988 00:58:18 -- scripts/common.sh@336 -- # IFS=.-: 00:05:27.988 00:58:18 -- scripts/common.sh@336 -- # read -ra ver2 00:05:27.988 00:58:18 -- scripts/common.sh@337 -- # local 'op=<' 00:05:27.988 00:58:18 -- scripts/common.sh@339 -- # ver1_l=2 00:05:27.988 00:58:18 -- scripts/common.sh@340 -- # ver2_l=1 00:05:27.988 00:58:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:27.988 00:58:18 -- scripts/common.sh@343 -- # case "$op" in 00:05:27.988 00:58:18 -- scripts/common.sh@344 -- # : 1 00:05:27.988 00:58:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:27.988 00:58:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:27.988 00:58:18 -- scripts/common.sh@364 -- # decimal 1 00:05:27.988 00:58:18 -- scripts/common.sh@352 -- # local d=1 00:05:27.988 00:58:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:27.988 00:58:18 -- scripts/common.sh@354 -- # echo 1 00:05:27.988 00:58:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:27.988 00:58:18 -- scripts/common.sh@365 -- # decimal 2 00:05:27.988 00:58:18 -- scripts/common.sh@352 -- # local d=2 00:05:27.988 00:58:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:27.988 00:58:18 -- scripts/common.sh@354 -- # echo 2 00:05:27.988 00:58:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:27.988 00:58:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:27.988 00:58:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:27.988 00:58:18 -- scripts/common.sh@367 -- # return 0 00:05:27.988 00:58:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:27.988 00:58:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:27.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.988 --rc genhtml_branch_coverage=1 00:05:27.988 --rc genhtml_function_coverage=1 00:05:27.988 --rc genhtml_legend=1 00:05:27.988 --rc geninfo_all_blocks=1 00:05:27.988 --rc geninfo_unexecuted_blocks=1 00:05:27.988 00:05:27.988 ' 00:05:27.988 00:58:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:27.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.988 --rc genhtml_branch_coverage=1 00:05:27.988 --rc genhtml_function_coverage=1 00:05:27.988 --rc genhtml_legend=1 00:05:27.988 --rc geninfo_all_blocks=1 00:05:27.988 --rc geninfo_unexecuted_blocks=1 00:05:27.988 00:05:27.988 ' 00:05:27.988 00:58:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:27.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.988 --rc genhtml_branch_coverage=1 00:05:27.988 --rc genhtml_function_coverage=1 00:05:27.988 --rc genhtml_legend=1 00:05:27.988 --rc geninfo_all_blocks=1 00:05:27.988 --rc geninfo_unexecuted_blocks=1 00:05:27.988 00:05:27.988 ' 00:05:27.988 00:58:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:27.988 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.988 --rc genhtml_branch_coverage=1 00:05:27.988 --rc genhtml_function_coverage=1 00:05:27.988 --rc genhtml_legend=1 00:05:27.988 --rc geninfo_all_blocks=1 00:05:27.988 --rc geninfo_unexecuted_blocks=1 00:05:27.988 00:05:27.988 ' 00:05:27.988 00:58:18 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:27.988 00:58:18 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:27.988 00:58:18 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:27.988 00:58:18 -- accel/accel.sh@59 -- # spdk_tgt_pid=935694 00:05:27.988 00:58:18 -- accel/accel.sh@60 -- # waitforlisten 935694 00:05:27.988 00:58:18 -- common/autotest_common.sh@829 -- # '[' -z 935694 ']' 00:05:27.988 00:58:18 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:27.988 00:58:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:27.988 00:58:18 -- accel/accel.sh@58 -- # build_accel_config 00:05:27.988 00:58:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:27.988 00:58:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:27.988 00:58:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:27.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:27.988 00:58:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:27.988 00:58:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:27.988 00:58:18 -- common/autotest_common.sh@10 -- # set +x 00:05:27.988 00:58:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:27.988 00:58:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:27.988 00:58:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:27.988 00:58:18 -- accel/accel.sh@41 -- # local IFS=, 00:05:27.988 00:58:18 -- accel/accel.sh@42 -- # jq -r . 00:05:27.988 [2024-11-26 00:58:18.406148] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.988 [2024-11-26 00:58:18.406232] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid935694 ] 00:05:27.988 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.988 [2024-11-26 00:58:18.466487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.247 [2024-11-26 00:58:18.576204] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.247 [2024-11-26 00:58:18.576380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.183 00:58:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.183 00:58:19 -- common/autotest_common.sh@862 -- # return 0 00:05:29.183 00:58:19 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:29.183 00:58:19 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:29.183 00:58:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:29.183 00:58:19 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:29.183 00:58:19 -- common/autotest_common.sh@10 -- # set +x 00:05:29.183 00:58:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # IFS== 00:05:29.183 00:58:19 -- accel/accel.sh@64 -- # read -r opc module 00:05:29.183 00:58:19 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:29.183 00:58:19 -- accel/accel.sh@67 -- # killprocess 935694 00:05:29.183 00:58:19 -- common/autotest_common.sh@936 -- # '[' -z 935694 ']' 00:05:29.183 00:58:19 -- common/autotest_common.sh@940 -- # kill -0 935694 00:05:29.183 00:58:19 -- common/autotest_common.sh@941 -- # uname 00:05:29.183 00:58:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.183 00:58:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 935694 00:05:29.183 00:58:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:29.183 00:58:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:29.183 00:58:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 935694' 00:05:29.183 killing process with pid 935694 00:05:29.183 00:58:19 -- common/autotest_common.sh@955 -- # kill 935694 00:05:29.183 00:58:19 -- common/autotest_common.sh@960 -- # wait 935694 00:05:29.442 00:58:19 -- accel/accel.sh@68 -- # trap - ERR 00:05:29.442 00:58:19 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:29.442 00:58:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:29.442 00:58:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.442 00:58:19 -- common/autotest_common.sh@10 -- # set +x 00:05:29.442 00:58:19 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:29.442 00:58:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:29.442 00:58:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.442 00:58:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.442 00:58:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.442 00:58:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.442 00:58:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.442 00:58:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.442 00:58:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.442 00:58:19 -- accel/accel.sh@42 -- # jq -r . 00:05:29.442 00:58:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.442 00:58:19 -- common/autotest_common.sh@10 -- # set +x 00:05:29.701 00:58:19 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:29.701 00:58:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:29.701 00:58:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.701 00:58:19 -- common/autotest_common.sh@10 -- # set +x 00:05:29.701 ************************************ 00:05:29.701 START TEST accel_missing_filename 00:05:29.701 ************************************ 00:05:29.701 00:58:19 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:29.701 00:58:19 -- common/autotest_common.sh@650 -- # local es=0 00:05:29.701 00:58:19 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:29.701 00:58:19 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:29.701 00:58:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.701 00:58:19 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:29.701 00:58:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.701 00:58:19 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:29.701 00:58:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:29.701 00:58:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.701 00:58:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.701 00:58:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.701 00:58:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.701 00:58:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.701 00:58:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.701 00:58:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.701 00:58:19 -- accel/accel.sh@42 -- # jq -r . 00:05:29.701 [2024-11-26 00:58:20.000791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.701 [2024-11-26 00:58:20.000863] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid935870 ] 00:05:29.701 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.701 [2024-11-26 00:58:20.066806] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.701 [2024-11-26 00:58:20.183007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.959 [2024-11-26 00:58:20.245279] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:29.959 [2024-11-26 00:58:20.326556] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:29.960 A filename is required. 00:05:29.960 00:58:20 -- common/autotest_common.sh@653 -- # es=234 00:05:29.960 00:58:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:29.960 00:58:20 -- common/autotest_common.sh@662 -- # es=106 00:05:29.960 00:58:20 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:29.960 00:58:20 -- common/autotest_common.sh@670 -- # es=1 00:05:29.960 00:58:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:29.960 00:05:29.960 real 0m0.465s 00:05:29.960 user 0m0.362s 00:05:29.960 sys 0m0.143s 00:05:29.960 00:58:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.960 00:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:29.960 ************************************ 00:05:29.960 END TEST accel_missing_filename 00:05:29.960 ************************************ 00:05:29.960 00:58:20 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.960 00:58:20 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:29.960 00:58:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.960 00:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:29.960 ************************************ 00:05:29.960 START TEST accel_compress_verify 00:05:29.960 ************************************ 00:05:29.960 00:58:20 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.960 00:58:20 -- common/autotest_common.sh@650 -- # local es=0 00:05:29.960 00:58:20 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.960 00:58:20 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:29.960 00:58:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.960 00:58:20 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:29.960 00:58:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.960 00:58:20 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.960 00:58:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:29.960 00:58:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:29.960 00:58:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:29.960 00:58:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:29.960 00:58:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:29.960 00:58:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:29.960 00:58:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:29.960 00:58:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:29.960 00:58:20 -- accel/accel.sh@42 -- # jq -r . 00:05:29.960 [2024-11-26 00:58:20.489657] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.960 [2024-11-26 00:58:20.489763] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936018 ] 00:05:30.218 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.218 [2024-11-26 00:58:20.547237] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.218 [2024-11-26 00:58:20.660815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.218 [2024-11-26 00:58:20.722282] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:30.476 [2024-11-26 00:58:20.807154] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:30.476 00:05:30.476 Compression does not support the verify option, aborting. 00:05:30.476 00:58:20 -- common/autotest_common.sh@653 -- # es=161 00:05:30.476 00:58:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:30.476 00:58:20 -- common/autotest_common.sh@662 -- # es=33 00:05:30.476 00:58:20 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:30.476 00:58:20 -- common/autotest_common.sh@670 -- # es=1 00:05:30.476 00:58:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:30.476 00:05:30.476 real 0m0.462s 00:05:30.476 user 0m0.362s 00:05:30.476 sys 0m0.133s 00:05:30.476 00:58:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.476 00:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:30.476 ************************************ 00:05:30.476 END TEST accel_compress_verify 00:05:30.476 ************************************ 00:05:30.476 00:58:20 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:30.476 00:58:20 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:30.476 00:58:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.476 00:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:30.476 ************************************ 00:05:30.476 START TEST accel_wrong_workload 00:05:30.476 ************************************ 00:05:30.476 00:58:20 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:30.476 00:58:20 -- common/autotest_common.sh@650 -- # local es=0 00:05:30.476 00:58:20 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:30.476 00:58:20 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:30.476 00:58:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:30.476 00:58:20 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:30.476 00:58:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:30.476 00:58:20 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:30.476 00:58:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:30.476 00:58:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.476 00:58:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.476 00:58:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.476 00:58:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.476 00:58:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.476 00:58:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.476 00:58:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.476 00:58:20 -- accel/accel.sh@42 -- # jq -r . 00:05:30.476 Unsupported workload type: foobar 00:05:30.476 [2024-11-26 00:58:20.979661] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:30.476 accel_perf options: 00:05:30.476 [-h help message] 00:05:30.476 [-q queue depth per core] 00:05:30.476 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:30.476 [-T number of threads per core 00:05:30.476 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:30.476 [-t time in seconds] 00:05:30.476 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:30.476 [ dif_verify, , dif_generate, dif_generate_copy 00:05:30.476 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:30.476 [-l for compress/decompress workloads, name of uncompressed input file 00:05:30.476 [-S for crc32c workload, use this seed value (default 0) 00:05:30.476 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:30.476 [-f for fill workload, use this BYTE value (default 255) 00:05:30.476 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:30.476 [-y verify result if this switch is on] 00:05:30.476 [-a tasks to allocate per core (default: same value as -q)] 00:05:30.476 Can be used to spread operations across a wider range of memory. 00:05:30.477 00:58:20 -- common/autotest_common.sh@653 -- # es=1 00:05:30.477 00:58:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:30.477 00:58:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:30.477 00:58:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:30.477 00:05:30.477 real 0m0.025s 00:05:30.477 user 0m0.012s 00:05:30.477 sys 0m0.013s 00:05:30.477 00:58:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.477 00:58:20 -- common/autotest_common.sh@10 -- # set +x 00:05:30.477 ************************************ 00:05:30.477 END TEST accel_wrong_workload 00:05:30.477 ************************************ 00:05:30.477 Error: writing output failed: Broken pipe 00:05:30.477 00:58:21 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:30.477 00:58:21 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:30.477 00:58:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.477 00:58:21 -- common/autotest_common.sh@10 -- # set +x 00:05:30.735 ************************************ 00:05:30.735 START TEST accel_negative_buffers 00:05:30.735 ************************************ 00:05:30.735 00:58:21 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:30.735 00:58:21 -- common/autotest_common.sh@650 -- # local es=0 00:05:30.735 00:58:21 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:30.735 00:58:21 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:30.735 00:58:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:30.735 00:58:21 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:30.735 00:58:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:30.735 00:58:21 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:30.735 00:58:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:30.735 00:58:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.735 00:58:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.735 00:58:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.735 00:58:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.735 00:58:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.735 00:58:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.735 00:58:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.735 00:58:21 -- accel/accel.sh@42 -- # jq -r . 00:05:30.735 -x option must be non-negative. 00:05:30.736 [2024-11-26 00:58:21.026011] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:30.736 accel_perf options: 00:05:30.736 [-h help message] 00:05:30.736 [-q queue depth per core] 00:05:30.736 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:30.736 [-T number of threads per core 00:05:30.736 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:30.736 [-t time in seconds] 00:05:30.736 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:30.736 [ dif_verify, , dif_generate, dif_generate_copy 00:05:30.736 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:30.736 [-l for compress/decompress workloads, name of uncompressed input file 00:05:30.736 [-S for crc32c workload, use this seed value (default 0) 00:05:30.736 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:30.736 [-f for fill workload, use this BYTE value (default 255) 00:05:30.736 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:30.736 [-y verify result if this switch is on] 00:05:30.736 [-a tasks to allocate per core (default: same value as -q)] 00:05:30.736 Can be used to spread operations across a wider range of memory. 00:05:30.736 00:58:21 -- common/autotest_common.sh@653 -- # es=1 00:05:30.736 00:58:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:30.736 00:58:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:30.736 00:58:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:30.736 00:05:30.736 real 0m0.022s 00:05:30.736 user 0m0.010s 00:05:30.736 sys 0m0.012s 00:05:30.736 00:58:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.736 00:58:21 -- common/autotest_common.sh@10 -- # set +x 00:05:30.736 ************************************ 00:05:30.736 END TEST accel_negative_buffers 00:05:30.736 ************************************ 00:05:30.736 Error: writing output failed: Broken pipe 00:05:30.736 00:58:21 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:30.736 00:58:21 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:30.736 00:58:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.736 00:58:21 -- common/autotest_common.sh@10 -- # set +x 00:05:30.736 ************************************ 00:05:30.736 START TEST accel_crc32c 00:05:30.736 ************************************ 00:05:30.736 00:58:21 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:30.736 00:58:21 -- accel/accel.sh@16 -- # local accel_opc 00:05:30.736 00:58:21 -- accel/accel.sh@17 -- # local accel_module 00:05:30.736 00:58:21 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:30.736 00:58:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:30.736 00:58:21 -- accel/accel.sh@12 -- # build_accel_config 00:05:30.736 00:58:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:30.736 00:58:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:30.736 00:58:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:30.736 00:58:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:30.736 00:58:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:30.736 00:58:21 -- accel/accel.sh@41 -- # local IFS=, 00:05:30.736 00:58:21 -- accel/accel.sh@42 -- # jq -r . 00:05:30.736 [2024-11-26 00:58:21.071067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.736 [2024-11-26 00:58:21.071134] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936079 ] 00:05:30.736 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.736 [2024-11-26 00:58:21.133269] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.736 [2024-11-26 00:58:21.247834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.201 00:58:22 -- accel/accel.sh@18 -- # out=' 00:05:32.201 SPDK Configuration: 00:05:32.201 Core mask: 0x1 00:05:32.201 00:05:32.201 Accel Perf Configuration: 00:05:32.201 Workload Type: crc32c 00:05:32.201 CRC-32C seed: 32 00:05:32.201 Transfer size: 4096 bytes 00:05:32.201 Vector count 1 00:05:32.201 Module: software 00:05:32.201 Queue depth: 32 00:05:32.201 Allocate depth: 32 00:05:32.201 # threads/core: 1 00:05:32.201 Run time: 1 seconds 00:05:32.201 Verify: Yes 00:05:32.201 00:05:32.201 Running for 1 seconds... 00:05:32.201 00:05:32.201 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:32.201 ------------------------------------------------------------------------------------ 00:05:32.201 0,0 406848/s 1589 MiB/s 0 0 00:05:32.201 ==================================================================================== 00:05:32.201 Total 406848/s 1589 MiB/s 0 0' 00:05:32.201 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.201 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.201 00:58:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:32.201 00:58:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:32.201 00:58:22 -- accel/accel.sh@12 -- # build_accel_config 00:05:32.201 00:58:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:32.201 00:58:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:32.201 00:58:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:32.201 00:58:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:32.201 00:58:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:32.201 00:58:22 -- accel/accel.sh@41 -- # local IFS=, 00:05:32.201 00:58:22 -- accel/accel.sh@42 -- # jq -r . 00:05:32.201 [2024-11-26 00:58:22.545602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.201 [2024-11-26 00:58:22.545695] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936228 ] 00:05:32.201 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.201 [2024-11-26 00:58:22.609213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.201 [2024-11-26 00:58:22.723550] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=0x1 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=crc32c 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=32 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=software 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@23 -- # accel_module=software 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=32 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=32 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=1 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val=Yes 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:32.459 00:58:22 -- accel/accel.sh@21 -- # val= 00:05:32.459 00:58:22 -- accel/accel.sh@22 -- # case "$var" in 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # IFS=: 00:05:32.459 00:58:22 -- accel/accel.sh@20 -- # read -r var val 00:05:33.833 00:58:23 -- accel/accel.sh@21 -- # val= 00:05:33.833 00:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.833 00:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:33.833 00:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:33.833 00:58:23 -- accel/accel.sh@21 -- # val= 00:05:33.833 00:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.833 00:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:33.833 00:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:33.833 00:58:23 -- accel/accel.sh@21 -- # val= 00:05:33.833 00:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.833 00:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:33.833 00:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:33.833 00:58:23 -- accel/accel.sh@21 -- # val= 00:05:33.834 00:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.834 00:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:33.834 00:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:33.834 00:58:23 -- accel/accel.sh@21 -- # val= 00:05:33.834 00:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.834 00:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:33.834 00:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:33.834 00:58:23 -- accel/accel.sh@21 -- # val= 00:05:33.834 00:58:23 -- accel/accel.sh@22 -- # case "$var" in 00:05:33.834 00:58:23 -- accel/accel.sh@20 -- # IFS=: 00:05:33.834 00:58:23 -- accel/accel.sh@20 -- # read -r var val 00:05:33.834 00:58:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:33.834 00:58:23 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:33.834 00:58:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:33.834 00:05:33.834 real 0m2.934s 00:05:33.834 user 0m2.637s 00:05:33.834 sys 0m0.287s 00:05:33.834 00:58:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.834 00:58:23 -- common/autotest_common.sh@10 -- # set +x 00:05:33.834 ************************************ 00:05:33.834 END TEST accel_crc32c 00:05:33.834 ************************************ 00:05:33.834 00:58:24 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:33.834 00:58:24 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:33.834 00:58:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.834 00:58:24 -- common/autotest_common.sh@10 -- # set +x 00:05:33.834 ************************************ 00:05:33.834 START TEST accel_crc32c_C2 00:05:33.834 ************************************ 00:05:33.834 00:58:24 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:33.834 00:58:24 -- accel/accel.sh@16 -- # local accel_opc 00:05:33.834 00:58:24 -- accel/accel.sh@17 -- # local accel_module 00:05:33.834 00:58:24 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:33.834 00:58:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:33.834 00:58:24 -- accel/accel.sh@12 -- # build_accel_config 00:05:33.834 00:58:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.834 00:58:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.834 00:58:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.834 00:58:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.834 00:58:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.834 00:58:24 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.834 00:58:24 -- accel/accel.sh@42 -- # jq -r . 00:05:33.834 [2024-11-26 00:58:24.034875] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.834 [2024-11-26 00:58:24.034952] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936506 ] 00:05:33.834 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.834 [2024-11-26 00:58:24.098238] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.834 [2024-11-26 00:58:24.212854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.207 00:58:25 -- accel/accel.sh@18 -- # out=' 00:05:35.207 SPDK Configuration: 00:05:35.207 Core mask: 0x1 00:05:35.207 00:05:35.207 Accel Perf Configuration: 00:05:35.207 Workload Type: crc32c 00:05:35.207 CRC-32C seed: 0 00:05:35.207 Transfer size: 4096 bytes 00:05:35.207 Vector count 2 00:05:35.207 Module: software 00:05:35.207 Queue depth: 32 00:05:35.207 Allocate depth: 32 00:05:35.207 # threads/core: 1 00:05:35.207 Run time: 1 seconds 00:05:35.207 Verify: Yes 00:05:35.207 00:05:35.207 Running for 1 seconds... 00:05:35.207 00:05:35.207 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:35.207 ------------------------------------------------------------------------------------ 00:05:35.207 0,0 315104/s 2461 MiB/s 0 0 00:05:35.207 ==================================================================================== 00:05:35.207 Total 315104/s 1230 MiB/s 0 0' 00:05:35.207 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.207 00:58:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:35.207 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.207 00:58:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:35.207 00:58:25 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.207 00:58:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.207 00:58:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.207 00:58:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.207 00:58:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.207 00:58:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.207 00:58:25 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.207 00:58:25 -- accel/accel.sh@42 -- # jq -r . 00:05:35.207 [2024-11-26 00:58:25.508918] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.207 [2024-11-26 00:58:25.509014] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936645 ] 00:05:35.207 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.207 [2024-11-26 00:58:25.571542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.207 [2024-11-26 00:58:25.687352] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=0x1 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=crc32c 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=0 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=software 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@23 -- # accel_module=software 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=32 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=32 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=1 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val=Yes 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:35.466 00:58:25 -- accel/accel.sh@21 -- # val= 00:05:35.466 00:58:25 -- accel/accel.sh@22 -- # case "$var" in 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # IFS=: 00:05:35.466 00:58:25 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@21 -- # val= 00:05:36.839 00:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # IFS=: 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@21 -- # val= 00:05:36.839 00:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # IFS=: 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@21 -- # val= 00:05:36.839 00:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # IFS=: 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@21 -- # val= 00:05:36.839 00:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # IFS=: 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@21 -- # val= 00:05:36.839 00:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # IFS=: 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@21 -- # val= 00:05:36.839 00:58:26 -- accel/accel.sh@22 -- # case "$var" in 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # IFS=: 00:05:36.839 00:58:26 -- accel/accel.sh@20 -- # read -r var val 00:05:36.839 00:58:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:36.839 00:58:26 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:36.839 00:58:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:36.839 00:05:36.839 real 0m2.951s 00:05:36.839 user 0m2.662s 00:05:36.839 sys 0m0.280s 00:05:36.839 00:58:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.839 00:58:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.839 ************************************ 00:05:36.839 END TEST accel_crc32c_C2 00:05:36.839 ************************************ 00:05:36.839 00:58:26 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:36.839 00:58:26 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:36.839 00:58:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.839 00:58:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.839 ************************************ 00:05:36.839 START TEST accel_copy 00:05:36.839 ************************************ 00:05:36.839 00:58:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:36.839 00:58:26 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.839 00:58:26 -- accel/accel.sh@17 -- # local accel_module 00:05:36.839 00:58:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:36.839 00:58:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:36.839 00:58:26 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.839 00:58:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.839 00:58:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.839 00:58:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.839 00:58:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.839 00:58:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.839 00:58:26 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.839 00:58:26 -- accel/accel.sh@42 -- # jq -r . 00:05:36.839 [2024-11-26 00:58:27.007535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.839 [2024-11-26 00:58:27.007627] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid936806 ] 00:05:36.839 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.839 [2024-11-26 00:58:27.071713] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.839 [2024-11-26 00:58:27.187674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.208 00:58:28 -- accel/accel.sh@18 -- # out=' 00:05:38.208 SPDK Configuration: 00:05:38.208 Core mask: 0x1 00:05:38.208 00:05:38.208 Accel Perf Configuration: 00:05:38.208 Workload Type: copy 00:05:38.208 Transfer size: 4096 bytes 00:05:38.208 Vector count 1 00:05:38.208 Module: software 00:05:38.208 Queue depth: 32 00:05:38.208 Allocate depth: 32 00:05:38.208 # threads/core: 1 00:05:38.208 Run time: 1 seconds 00:05:38.208 Verify: Yes 00:05:38.208 00:05:38.208 Running for 1 seconds... 00:05:38.208 00:05:38.208 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:38.208 ------------------------------------------------------------------------------------ 00:05:38.208 0,0 280000/s 1093 MiB/s 0 0 00:05:38.208 ==================================================================================== 00:05:38.208 Total 280000/s 1093 MiB/s 0 0' 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:38.208 00:58:28 -- accel/accel.sh@12 -- # build_accel_config 00:05:38.208 00:58:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.208 00:58:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.208 00:58:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.208 00:58:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.208 00:58:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.208 00:58:28 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.208 00:58:28 -- accel/accel.sh@42 -- # jq -r . 00:05:38.208 [2024-11-26 00:58:28.466050] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.208 [2024-11-26 00:58:28.466131] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid937067 ] 00:05:38.208 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.208 [2024-11-26 00:58:28.526822] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.208 [2024-11-26 00:58:28.639615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=0x1 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=copy 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=software 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@23 -- # accel_module=software 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=32 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=32 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=1 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val=Yes 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:38.208 00:58:28 -- accel/accel.sh@21 -- # val= 00:05:38.208 00:58:28 -- accel/accel.sh@22 -- # case "$var" in 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # IFS=: 00:05:38.208 00:58:28 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@21 -- # val= 00:05:39.585 00:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # IFS=: 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@21 -- # val= 00:05:39.585 00:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # IFS=: 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@21 -- # val= 00:05:39.585 00:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # IFS=: 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@21 -- # val= 00:05:39.585 00:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # IFS=: 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@21 -- # val= 00:05:39.585 00:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # IFS=: 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@21 -- # val= 00:05:39.585 00:58:29 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # IFS=: 00:05:39.585 00:58:29 -- accel/accel.sh@20 -- # read -r var val 00:05:39.585 00:58:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.585 00:58:29 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:39.585 00:58:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.585 00:05:39.585 real 0m2.923s 00:05:39.585 user 0m2.623s 00:05:39.585 sys 0m0.290s 00:05:39.585 00:58:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.585 00:58:29 -- common/autotest_common.sh@10 -- # set +x 00:05:39.585 ************************************ 00:05:39.585 END TEST accel_copy 00:05:39.585 ************************************ 00:05:39.585 00:58:29 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:39.585 00:58:29 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:39.585 00:58:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.585 00:58:29 -- common/autotest_common.sh@10 -- # set +x 00:05:39.585 ************************************ 00:05:39.585 START TEST accel_fill 00:05:39.585 ************************************ 00:05:39.585 00:58:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:39.585 00:58:29 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.585 00:58:29 -- accel/accel.sh@17 -- # local accel_module 00:05:39.585 00:58:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:39.585 00:58:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:39.585 00:58:29 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.585 00:58:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.585 00:58:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.585 00:58:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.585 00:58:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.585 00:58:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.585 00:58:29 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.585 00:58:29 -- accel/accel.sh@42 -- # jq -r . 00:05:39.585 [2024-11-26 00:58:29.952217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.585 [2024-11-26 00:58:29.952306] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid937234 ] 00:05:39.585 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.585 [2024-11-26 00:58:30.015035] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.843 [2024-11-26 00:58:30.132587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.216 00:58:31 -- accel/accel.sh@18 -- # out=' 00:05:41.216 SPDK Configuration: 00:05:41.216 Core mask: 0x1 00:05:41.216 00:05:41.216 Accel Perf Configuration: 00:05:41.216 Workload Type: fill 00:05:41.216 Fill pattern: 0x80 00:05:41.216 Transfer size: 4096 bytes 00:05:41.216 Vector count 1 00:05:41.216 Module: software 00:05:41.216 Queue depth: 64 00:05:41.216 Allocate depth: 64 00:05:41.216 # threads/core: 1 00:05:41.216 Run time: 1 seconds 00:05:41.216 Verify: Yes 00:05:41.216 00:05:41.216 Running for 1 seconds... 00:05:41.216 00:05:41.216 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:41.216 ------------------------------------------------------------------------------------ 00:05:41.216 0,0 409408/s 1599 MiB/s 0 0 00:05:41.216 ==================================================================================== 00:05:41.216 Total 409408/s 1599 MiB/s 0 0' 00:05:41.216 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.216 00:58:31 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:41.216 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.216 00:58:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:41.216 00:58:31 -- accel/accel.sh@12 -- # build_accel_config 00:05:41.216 00:58:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:41.216 00:58:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:41.216 00:58:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:41.216 00:58:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:41.216 00:58:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:41.216 00:58:31 -- accel/accel.sh@41 -- # local IFS=, 00:05:41.216 00:58:31 -- accel/accel.sh@42 -- # jq -r . 00:05:41.216 [2024-11-26 00:58:31.428363] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:41.216 [2024-11-26 00:58:31.428458] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid937372 ] 00:05:41.216 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.216 [2024-11-26 00:58:31.489662] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.216 [2024-11-26 00:58:31.605323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.216 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.216 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.216 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.216 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.216 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.216 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=0x1 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=fill 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=0x80 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=software 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@23 -- # accel_module=software 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=64 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=64 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=1 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val=Yes 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:41.217 00:58:31 -- accel/accel.sh@21 -- # val= 00:05:41.217 00:58:31 -- accel/accel.sh@22 -- # case "$var" in 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # IFS=: 00:05:41.217 00:58:31 -- accel/accel.sh@20 -- # read -r var val 00:05:42.590 00:58:32 -- accel/accel.sh@21 -- # val= 00:05:42.590 00:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.590 00:58:32 -- accel/accel.sh@20 -- # IFS=: 00:05:42.590 00:58:32 -- accel/accel.sh@20 -- # read -r var val 00:05:42.590 00:58:32 -- accel/accel.sh@21 -- # val= 00:05:42.590 00:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.590 00:58:32 -- accel/accel.sh@20 -- # IFS=: 00:05:42.590 00:58:32 -- accel/accel.sh@20 -- # read -r var val 00:05:42.590 00:58:32 -- accel/accel.sh@21 -- # val= 00:05:42.591 00:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # IFS=: 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # read -r var val 00:05:42.591 00:58:32 -- accel/accel.sh@21 -- # val= 00:05:42.591 00:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # IFS=: 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # read -r var val 00:05:42.591 00:58:32 -- accel/accel.sh@21 -- # val= 00:05:42.591 00:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # IFS=: 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # read -r var val 00:05:42.591 00:58:32 -- accel/accel.sh@21 -- # val= 00:05:42.591 00:58:32 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # IFS=: 00:05:42.591 00:58:32 -- accel/accel.sh@20 -- # read -r var val 00:05:42.591 00:58:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.591 00:58:32 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:42.591 00:58:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.591 00:05:42.591 real 0m2.945s 00:05:42.591 user 0m2.652s 00:05:42.591 sys 0m0.284s 00:05:42.591 00:58:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.591 00:58:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.591 ************************************ 00:05:42.591 END TEST accel_fill 00:05:42.591 ************************************ 00:05:42.591 00:58:32 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:42.591 00:58:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:42.591 00:58:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.591 00:58:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.591 ************************************ 00:05:42.591 START TEST accel_copy_crc32c 00:05:42.591 ************************************ 00:05:42.591 00:58:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:42.591 00:58:32 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.591 00:58:32 -- accel/accel.sh@17 -- # local accel_module 00:05:42.591 00:58:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:42.591 00:58:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:42.591 00:58:32 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.591 00:58:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.591 00:58:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.591 00:58:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.591 00:58:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.591 00:58:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.591 00:58:32 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.591 00:58:32 -- accel/accel.sh@42 -- # jq -r . 00:05:42.591 [2024-11-26 00:58:32.921989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.591 [2024-11-26 00:58:32.922090] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid937652 ] 00:05:42.591 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.591 [2024-11-26 00:58:32.985627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.591 [2024-11-26 00:58:33.102835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.966 00:58:34 -- accel/accel.sh@18 -- # out=' 00:05:43.966 SPDK Configuration: 00:05:43.966 Core mask: 0x1 00:05:43.966 00:05:43.966 Accel Perf Configuration: 00:05:43.966 Workload Type: copy_crc32c 00:05:43.966 CRC-32C seed: 0 00:05:43.966 Vector size: 4096 bytes 00:05:43.966 Transfer size: 4096 bytes 00:05:43.966 Vector count 1 00:05:43.966 Module: software 00:05:43.966 Queue depth: 32 00:05:43.966 Allocate depth: 32 00:05:43.966 # threads/core: 1 00:05:43.966 Run time: 1 seconds 00:05:43.966 Verify: Yes 00:05:43.966 00:05:43.966 Running for 1 seconds... 00:05:43.966 00:05:43.966 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.966 ------------------------------------------------------------------------------------ 00:05:43.966 0,0 220000/s 859 MiB/s 0 0 00:05:43.966 ==================================================================================== 00:05:43.966 Total 220000/s 859 MiB/s 0 0' 00:05:43.966 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:43.966 00:58:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:43.966 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:43.967 00:58:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:43.967 00:58:34 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.967 00:58:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.967 00:58:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.967 00:58:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.967 00:58:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.967 00:58:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.967 00:58:34 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.967 00:58:34 -- accel/accel.sh@42 -- # jq -r . 00:05:43.967 [2024-11-26 00:58:34.382452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.967 [2024-11-26 00:58:34.382548] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid937800 ] 00:05:43.967 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.967 [2024-11-26 00:58:34.442919] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.226 [2024-11-26 00:58:34.558824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=0x1 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=0 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=software 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@23 -- # accel_module=software 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=32 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=32 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=1 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val=Yes 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:44.226 00:58:34 -- accel/accel.sh@21 -- # val= 00:05:44.226 00:58:34 -- accel/accel.sh@22 -- # case "$var" in 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # IFS=: 00:05:44.226 00:58:34 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@21 -- # val= 00:05:45.600 00:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # IFS=: 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@21 -- # val= 00:05:45.600 00:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # IFS=: 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@21 -- # val= 00:05:45.600 00:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # IFS=: 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@21 -- # val= 00:05:45.600 00:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # IFS=: 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@21 -- # val= 00:05:45.600 00:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # IFS=: 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@21 -- # val= 00:05:45.600 00:58:35 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # IFS=: 00:05:45.600 00:58:35 -- accel/accel.sh@20 -- # read -r var val 00:05:45.600 00:58:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.600 00:58:35 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:45.600 00:58:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.600 00:05:45.600 real 0m2.934s 00:05:45.600 user 0m2.645s 00:05:45.600 sys 0m0.280s 00:05:45.600 00:58:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.600 00:58:35 -- common/autotest_common.sh@10 -- # set +x 00:05:45.600 ************************************ 00:05:45.600 END TEST accel_copy_crc32c 00:05:45.600 ************************************ 00:05:45.600 00:58:35 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:45.600 00:58:35 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:45.600 00:58:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.600 00:58:35 -- common/autotest_common.sh@10 -- # set +x 00:05:45.600 ************************************ 00:05:45.600 START TEST accel_copy_crc32c_C2 00:05:45.600 ************************************ 00:05:45.600 00:58:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:45.600 00:58:35 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.600 00:58:35 -- accel/accel.sh@17 -- # local accel_module 00:05:45.600 00:58:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:45.600 00:58:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:45.600 00:58:35 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.600 00:58:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.600 00:58:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.600 00:58:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.600 00:58:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.600 00:58:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.600 00:58:35 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.600 00:58:35 -- accel/accel.sh@42 -- # jq -r . 00:05:45.601 [2024-11-26 00:58:35.880897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.601 [2024-11-26 00:58:35.880989] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid937955 ] 00:05:45.601 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.601 [2024-11-26 00:58:35.943172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.601 [2024-11-26 00:58:36.058881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.974 00:58:37 -- accel/accel.sh@18 -- # out=' 00:05:46.974 SPDK Configuration: 00:05:46.974 Core mask: 0x1 00:05:46.974 00:05:46.974 Accel Perf Configuration: 00:05:46.974 Workload Type: copy_crc32c 00:05:46.974 CRC-32C seed: 0 00:05:46.974 Vector size: 4096 bytes 00:05:46.974 Transfer size: 8192 bytes 00:05:46.974 Vector count 2 00:05:46.974 Module: software 00:05:46.974 Queue depth: 32 00:05:46.974 Allocate depth: 32 00:05:46.974 # threads/core: 1 00:05:46.974 Run time: 1 seconds 00:05:46.974 Verify: Yes 00:05:46.974 00:05:46.974 Running for 1 seconds... 00:05:46.974 00:05:46.974 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:46.974 ------------------------------------------------------------------------------------ 00:05:46.974 0,0 153888/s 1202 MiB/s 0 0 00:05:46.974 ==================================================================================== 00:05:46.974 Total 153888/s 601 MiB/s 0 0' 00:05:46.974 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:46.974 00:58:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:46.974 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:46.974 00:58:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:46.974 00:58:37 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.974 00:58:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.974 00:58:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.974 00:58:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.974 00:58:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.974 00:58:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.974 00:58:37 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.974 00:58:37 -- accel/accel.sh@42 -- # jq -r . 00:05:46.974 [2024-11-26 00:58:37.359015] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.974 [2024-11-26 00:58:37.359105] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid938127 ] 00:05:46.974 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.974 [2024-11-26 00:58:37.421262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.232 [2024-11-26 00:58:37.541119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=0x1 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=0 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=software 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=32 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=32 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=1 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val=Yes 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:47.232 00:58:37 -- accel/accel.sh@21 -- # val= 00:05:47.232 00:58:37 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # IFS=: 00:05:47.232 00:58:37 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@21 -- # val= 00:05:48.606 00:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # IFS=: 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@21 -- # val= 00:05:48.606 00:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # IFS=: 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@21 -- # val= 00:05:48.606 00:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # IFS=: 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@21 -- # val= 00:05:48.606 00:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # IFS=: 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@21 -- # val= 00:05:48.606 00:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # IFS=: 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@21 -- # val= 00:05:48.606 00:58:38 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # IFS=: 00:05:48.606 00:58:38 -- accel/accel.sh@20 -- # read -r var val 00:05:48.606 00:58:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.606 00:58:38 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:48.606 00:58:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.606 00:05:48.606 real 0m2.957s 00:05:48.606 user 0m2.658s 00:05:48.606 sys 0m0.289s 00:05:48.606 00:58:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.606 00:58:38 -- common/autotest_common.sh@10 -- # set +x 00:05:48.606 ************************************ 00:05:48.606 END TEST accel_copy_crc32c_C2 00:05:48.606 ************************************ 00:05:48.606 00:58:38 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:48.606 00:58:38 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.606 00:58:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.606 00:58:38 -- common/autotest_common.sh@10 -- # set +x 00:05:48.606 ************************************ 00:05:48.606 START TEST accel_dualcast 00:05:48.606 ************************************ 00:05:48.606 00:58:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:48.606 00:58:38 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.606 00:58:38 -- accel/accel.sh@17 -- # local accel_module 00:05:48.606 00:58:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:48.606 00:58:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:48.606 00:58:38 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.606 00:58:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.606 00:58:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.606 00:58:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.606 00:58:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.606 00:58:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.606 00:58:38 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.606 00:58:38 -- accel/accel.sh@42 -- # jq -r . 00:05:48.606 [2024-11-26 00:58:38.863323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.606 [2024-11-26 00:58:38.863399] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid938381 ] 00:05:48.606 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.606 [2024-11-26 00:58:38.921449] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.606 [2024-11-26 00:58:39.038124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.979 00:58:40 -- accel/accel.sh@18 -- # out=' 00:05:49.979 SPDK Configuration: 00:05:49.979 Core mask: 0x1 00:05:49.979 00:05:49.979 Accel Perf Configuration: 00:05:49.979 Workload Type: dualcast 00:05:49.979 Transfer size: 4096 bytes 00:05:49.979 Vector count 1 00:05:49.979 Module: software 00:05:49.979 Queue depth: 32 00:05:49.979 Allocate depth: 32 00:05:49.979 # threads/core: 1 00:05:49.979 Run time: 1 seconds 00:05:49.979 Verify: Yes 00:05:49.979 00:05:49.979 Running for 1 seconds... 00:05:49.979 00:05:49.979 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:49.979 ------------------------------------------------------------------------------------ 00:05:49.979 0,0 297120/s 1160 MiB/s 0 0 00:05:49.979 ==================================================================================== 00:05:49.979 Total 297120/s 1160 MiB/s 0 0' 00:05:49.979 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:49.979 00:58:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:49.979 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:49.979 00:58:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:49.979 00:58:40 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.979 00:58:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.979 00:58:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.979 00:58:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.979 00:58:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.979 00:58:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.979 00:58:40 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.979 00:58:40 -- accel/accel.sh@42 -- # jq -r . 00:05:49.979 [2024-11-26 00:58:40.339523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.979 [2024-11-26 00:58:40.339618] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid938527 ] 00:05:49.979 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.979 [2024-11-26 00:58:40.401192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.238 [2024-11-26 00:58:40.521263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=0x1 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=dualcast 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=software 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=32 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=32 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=1 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val=Yes 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:50.238 00:58:40 -- accel/accel.sh@21 -- # val= 00:05:50.238 00:58:40 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # IFS=: 00:05:50.238 00:58:40 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@21 -- # val= 00:05:51.611 00:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # IFS=: 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@21 -- # val= 00:05:51.611 00:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # IFS=: 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@21 -- # val= 00:05:51.611 00:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # IFS=: 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@21 -- # val= 00:05:51.611 00:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # IFS=: 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@21 -- # val= 00:05:51.611 00:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # IFS=: 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@21 -- # val= 00:05:51.611 00:58:41 -- accel/accel.sh@22 -- # case "$var" in 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # IFS=: 00:05:51.611 00:58:41 -- accel/accel.sh@20 -- # read -r var val 00:05:51.611 00:58:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:51.611 00:58:41 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:51.611 00:58:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:51.611 00:05:51.611 real 0m2.964s 00:05:51.611 user 0m2.668s 00:05:51.611 sys 0m0.285s 00:05:51.611 00:58:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:51.611 00:58:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.611 ************************************ 00:05:51.611 END TEST accel_dualcast 00:05:51.611 ************************************ 00:05:51.611 00:58:41 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:51.611 00:58:41 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:51.611 00:58:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:51.611 00:58:41 -- common/autotest_common.sh@10 -- # set +x 00:05:51.611 ************************************ 00:05:51.611 START TEST accel_compare 00:05:51.611 ************************************ 00:05:51.611 00:58:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:51.611 00:58:41 -- accel/accel.sh@16 -- # local accel_opc 00:05:51.611 00:58:41 -- accel/accel.sh@17 -- # local accel_module 00:05:51.611 00:58:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:51.611 00:58:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:51.611 00:58:41 -- accel/accel.sh@12 -- # build_accel_config 00:05:51.611 00:58:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:51.611 00:58:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:51.611 00:58:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:51.611 00:58:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:51.611 00:58:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:51.611 00:58:41 -- accel/accel.sh@41 -- # local IFS=, 00:05:51.611 00:58:41 -- accel/accel.sh@42 -- # jq -r . 00:05:51.611 [2024-11-26 00:58:41.848033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:51.611 [2024-11-26 00:58:41.848125] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid938682 ] 00:05:51.611 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.611 [2024-11-26 00:58:41.910287] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.611 [2024-11-26 00:58:42.029790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.985 00:58:43 -- accel/accel.sh@18 -- # out=' 00:05:52.985 SPDK Configuration: 00:05:52.985 Core mask: 0x1 00:05:52.985 00:05:52.985 Accel Perf Configuration: 00:05:52.985 Workload Type: compare 00:05:52.985 Transfer size: 4096 bytes 00:05:52.985 Vector count 1 00:05:52.985 Module: software 00:05:52.985 Queue depth: 32 00:05:52.985 Allocate depth: 32 00:05:52.985 # threads/core: 1 00:05:52.985 Run time: 1 seconds 00:05:52.985 Verify: Yes 00:05:52.985 00:05:52.985 Running for 1 seconds... 00:05:52.985 00:05:52.985 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:52.985 ------------------------------------------------------------------------------------ 00:05:52.985 0,0 399008/s 1558 MiB/s 0 0 00:05:52.985 ==================================================================================== 00:05:52.985 Total 399008/s 1558 MiB/s 0 0' 00:05:52.985 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:52.985 00:58:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:52.985 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:52.985 00:58:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:52.985 00:58:43 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.985 00:58:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.985 00:58:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.985 00:58:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.985 00:58:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.985 00:58:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.985 00:58:43 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.985 00:58:43 -- accel/accel.sh@42 -- # jq -r . 00:05:52.985 [2024-11-26 00:58:43.328540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.985 [2024-11-26 00:58:43.328630] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid938945 ] 00:05:52.985 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.985 [2024-11-26 00:58:43.393755] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.985 [2024-11-26 00:58:43.513515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=0x1 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=compare 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=software 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=32 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=32 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=1 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val=Yes 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:53.243 00:58:43 -- accel/accel.sh@21 -- # val= 00:05:53.243 00:58:43 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # IFS=: 00:05:53.243 00:58:43 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@21 -- # val= 00:05:54.617 00:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # IFS=: 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@21 -- # val= 00:05:54.617 00:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # IFS=: 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@21 -- # val= 00:05:54.617 00:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # IFS=: 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@21 -- # val= 00:05:54.617 00:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # IFS=: 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@21 -- # val= 00:05:54.617 00:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # IFS=: 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@21 -- # val= 00:05:54.617 00:58:44 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # IFS=: 00:05:54.617 00:58:44 -- accel/accel.sh@20 -- # read -r var val 00:05:54.617 00:58:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.617 00:58:44 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:54.617 00:58:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.617 00:05:54.617 real 0m2.951s 00:05:54.617 user 0m2.661s 00:05:54.617 sys 0m0.280s 00:05:54.617 00:58:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.617 00:58:44 -- common/autotest_common.sh@10 -- # set +x 00:05:54.617 ************************************ 00:05:54.617 END TEST accel_compare 00:05:54.617 ************************************ 00:05:54.617 00:58:44 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:54.617 00:58:44 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:54.617 00:58:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.617 00:58:44 -- common/autotest_common.sh@10 -- # set +x 00:05:54.617 ************************************ 00:05:54.617 START TEST accel_xor 00:05:54.617 ************************************ 00:05:54.617 00:58:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:54.617 00:58:44 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.617 00:58:44 -- accel/accel.sh@17 -- # local accel_module 00:05:54.617 00:58:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:54.617 00:58:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:54.618 00:58:44 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.618 00:58:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.618 00:58:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.618 00:58:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.618 00:58:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.618 00:58:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.618 00:58:44 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.618 00:58:44 -- accel/accel.sh@42 -- # jq -r . 00:05:54.618 [2024-11-26 00:58:44.824521] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.618 [2024-11-26 00:58:44.824614] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid939110 ] 00:05:54.618 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.618 [2024-11-26 00:58:44.888838] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.618 [2024-11-26 00:58:45.008874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.990 00:58:46 -- accel/accel.sh@18 -- # out=' 00:05:55.990 SPDK Configuration: 00:05:55.990 Core mask: 0x1 00:05:55.990 00:05:55.990 Accel Perf Configuration: 00:05:55.990 Workload Type: xor 00:05:55.990 Source buffers: 2 00:05:55.990 Transfer size: 4096 bytes 00:05:55.990 Vector count 1 00:05:55.990 Module: software 00:05:55.990 Queue depth: 32 00:05:55.990 Allocate depth: 32 00:05:55.990 # threads/core: 1 00:05:55.990 Run time: 1 seconds 00:05:55.990 Verify: Yes 00:05:55.990 00:05:55.990 Running for 1 seconds... 00:05:55.990 00:05:55.990 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:55.990 ------------------------------------------------------------------------------------ 00:05:55.990 0,0 187232/s 731 MiB/s 0 0 00:05:55.990 ==================================================================================== 00:05:55.990 Total 187232/s 731 MiB/s 0 0' 00:05:55.991 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:55.991 00:58:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:05:55.991 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:55.991 00:58:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:55.991 00:58:46 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.991 00:58:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.991 00:58:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.991 00:58:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.991 00:58:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.991 00:58:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.991 00:58:46 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.991 00:58:46 -- accel/accel.sh@42 -- # jq -r . 00:05:55.991 [2024-11-26 00:58:46.311828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.991 [2024-11-26 00:58:46.311926] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid939254 ] 00:05:55.991 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.991 [2024-11-26 00:58:46.373455] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.991 [2024-11-26 00:58:46.496069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=0x1 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=xor 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=2 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=software 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=32 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=32 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=1 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val=Yes 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:56.249 00:58:46 -- accel/accel.sh@21 -- # val= 00:05:56.249 00:58:46 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # IFS=: 00:05:56.249 00:58:46 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@21 -- # val= 00:05:57.622 00:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # IFS=: 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@21 -- # val= 00:05:57.622 00:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # IFS=: 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@21 -- # val= 00:05:57.622 00:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # IFS=: 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@21 -- # val= 00:05:57.622 00:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # IFS=: 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@21 -- # val= 00:05:57.622 00:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # IFS=: 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@21 -- # val= 00:05:57.622 00:58:47 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # IFS=: 00:05:57.622 00:58:47 -- accel/accel.sh@20 -- # read -r var val 00:05:57.622 00:58:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.622 00:58:47 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:05:57.622 00:58:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.622 00:05:57.622 real 0m2.968s 00:05:57.622 user 0m2.671s 00:05:57.622 sys 0m0.287s 00:05:57.622 00:58:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.622 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:05:57.622 ************************************ 00:05:57.622 END TEST accel_xor 00:05:57.622 ************************************ 00:05:57.622 00:58:47 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:05:57.622 00:58:47 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:57.622 00:58:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.622 00:58:47 -- common/autotest_common.sh@10 -- # set +x 00:05:57.622 ************************************ 00:05:57.622 START TEST accel_xor 00:05:57.623 ************************************ 00:05:57.623 00:58:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:05:57.623 00:58:47 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.623 00:58:47 -- accel/accel.sh@17 -- # local accel_module 00:05:57.623 00:58:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:05:57.623 00:58:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:57.623 00:58:47 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.623 00:58:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.623 00:58:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.623 00:58:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.623 00:58:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.623 00:58:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.623 00:58:47 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.623 00:58:47 -- accel/accel.sh@42 -- # jq -r . 00:05:57.623 [2024-11-26 00:58:47.816054] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.623 [2024-11-26 00:58:47.816146] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid939528 ] 00:05:57.623 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.623 [2024-11-26 00:58:47.877549] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.623 [2024-11-26 00:58:47.996706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.022 00:58:49 -- accel/accel.sh@18 -- # out=' 00:05:59.022 SPDK Configuration: 00:05:59.022 Core mask: 0x1 00:05:59.022 00:05:59.022 Accel Perf Configuration: 00:05:59.022 Workload Type: xor 00:05:59.022 Source buffers: 3 00:05:59.022 Transfer size: 4096 bytes 00:05:59.022 Vector count 1 00:05:59.022 Module: software 00:05:59.022 Queue depth: 32 00:05:59.022 Allocate depth: 32 00:05:59.022 # threads/core: 1 00:05:59.022 Run time: 1 seconds 00:05:59.022 Verify: Yes 00:05:59.022 00:05:59.022 Running for 1 seconds... 00:05:59.022 00:05:59.022 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:59.022 ------------------------------------------------------------------------------------ 00:05:59.022 0,0 182720/s 713 MiB/s 0 0 00:05:59.022 ==================================================================================== 00:05:59.022 Total 182720/s 713 MiB/s 0 0' 00:05:59.022 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.022 00:58:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:05:59.022 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.022 00:58:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:05:59.022 00:58:49 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.022 00:58:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.022 00:58:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.022 00:58:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.022 00:58:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.023 00:58:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.023 00:58:49 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.023 00:58:49 -- accel/accel.sh@42 -- # jq -r . 00:05:59.023 [2024-11-26 00:58:49.287827] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.023 [2024-11-26 00:58:49.287924] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid939677 ] 00:05:59.023 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.023 [2024-11-26 00:58:49.349572] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.023 [2024-11-26 00:58:49.466293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=0x1 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=xor 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@24 -- # accel_opc=xor 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=3 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=software 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@23 -- # accel_module=software 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=32 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=32 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=1 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val=Yes 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:05:59.023 00:58:49 -- accel/accel.sh@21 -- # val= 00:05:59.023 00:58:49 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # IFS=: 00:05:59.023 00:58:49 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@21 -- # val= 00:06:00.395 00:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@21 -- # val= 00:06:00.395 00:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@21 -- # val= 00:06:00.395 00:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@21 -- # val= 00:06:00.395 00:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@21 -- # val= 00:06:00.395 00:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@21 -- # val= 00:06:00.395 00:58:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # IFS=: 00:06:00.395 00:58:50 -- accel/accel.sh@20 -- # read -r var val 00:06:00.395 00:58:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.395 00:58:50 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:00.395 00:58:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.395 00:06:00.395 real 0m2.945s 00:06:00.395 user 0m2.657s 00:06:00.395 sys 0m0.277s 00:06:00.395 00:58:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.395 00:58:50 -- common/autotest_common.sh@10 -- # set +x 00:06:00.395 ************************************ 00:06:00.395 END TEST accel_xor 00:06:00.395 ************************************ 00:06:00.395 00:58:50 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:00.395 00:58:50 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:00.395 00:58:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.395 00:58:50 -- common/autotest_common.sh@10 -- # set +x 00:06:00.395 ************************************ 00:06:00.395 START TEST accel_dif_verify 00:06:00.395 ************************************ 00:06:00.395 00:58:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:00.395 00:58:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.395 00:58:50 -- accel/accel.sh@17 -- # local accel_module 00:06:00.395 00:58:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:00.395 00:58:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:00.395 00:58:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.395 00:58:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.395 00:58:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.395 00:58:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.395 00:58:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.395 00:58:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.395 00:58:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.395 00:58:50 -- accel/accel.sh@42 -- # jq -r . 00:06:00.395 [2024-11-26 00:58:50.785661] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.395 [2024-11-26 00:58:50.785765] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid939837 ] 00:06:00.395 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.395 [2024-11-26 00:58:50.847646] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.689 [2024-11-26 00:58:50.968081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.063 00:58:52 -- accel/accel.sh@18 -- # out=' 00:06:02.063 SPDK Configuration: 00:06:02.063 Core mask: 0x1 00:06:02.063 00:06:02.063 Accel Perf Configuration: 00:06:02.063 Workload Type: dif_verify 00:06:02.063 Vector size: 4096 bytes 00:06:02.063 Transfer size: 4096 bytes 00:06:02.063 Block size: 512 bytes 00:06:02.063 Metadata size: 8 bytes 00:06:02.063 Vector count 1 00:06:02.063 Module: software 00:06:02.063 Queue depth: 32 00:06:02.063 Allocate depth: 32 00:06:02.063 # threads/core: 1 00:06:02.063 Run time: 1 seconds 00:06:02.063 Verify: No 00:06:02.063 00:06:02.063 Running for 1 seconds... 00:06:02.063 00:06:02.063 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:02.063 ------------------------------------------------------------------------------------ 00:06:02.063 0,0 81344/s 322 MiB/s 0 0 00:06:02.063 ==================================================================================== 00:06:02.063 Total 81344/s 317 MiB/s 0 0' 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.063 00:58:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.063 00:58:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:02.063 00:58:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.063 00:58:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.063 00:58:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.063 00:58:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.063 00:58:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.063 00:58:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.063 00:58:52 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.063 00:58:52 -- accel/accel.sh@42 -- # jq -r . 00:06:02.063 [2024-11-26 00:58:52.263297] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.063 [2024-11-26 00:58:52.263390] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940100 ] 00:06:02.063 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.063 [2024-11-26 00:58:52.328295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.063 [2024-11-26 00:58:52.447925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.063 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.063 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.063 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.063 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.063 00:58:52 -- accel/accel.sh@21 -- # val=0x1 00:06:02.063 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.063 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.063 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.063 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.063 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.063 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.063 00:58:52 -- accel/accel.sh@21 -- # val=dif_verify 00:06:02.063 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.063 00:58:52 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val=software 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val=32 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val=32 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val=1 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val=No 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:02.064 00:58:52 -- accel/accel.sh@21 -- # val= 00:06:02.064 00:58:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # IFS=: 00:06:02.064 00:58:52 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@21 -- # val= 00:06:03.437 00:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@21 -- # val= 00:06:03.437 00:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@21 -- # val= 00:06:03.437 00:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@21 -- # val= 00:06:03.437 00:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@21 -- # val= 00:06:03.437 00:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@21 -- # val= 00:06:03.437 00:58:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # IFS=: 00:06:03.437 00:58:53 -- accel/accel.sh@20 -- # read -r var val 00:06:03.437 00:58:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:03.437 00:58:53 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:03.437 00:58:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:03.437 00:06:03.437 real 0m2.965s 00:06:03.437 user 0m2.668s 00:06:03.437 sys 0m0.290s 00:06:03.437 00:58:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.437 00:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:03.437 ************************************ 00:06:03.437 END TEST accel_dif_verify 00:06:03.438 ************************************ 00:06:03.438 00:58:53 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:03.438 00:58:53 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:03.438 00:58:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.438 00:58:53 -- common/autotest_common.sh@10 -- # set +x 00:06:03.438 ************************************ 00:06:03.438 START TEST accel_dif_generate 00:06:03.438 ************************************ 00:06:03.438 00:58:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:03.438 00:58:53 -- accel/accel.sh@16 -- # local accel_opc 00:06:03.438 00:58:53 -- accel/accel.sh@17 -- # local accel_module 00:06:03.438 00:58:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:03.438 00:58:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:03.438 00:58:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:03.438 00:58:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:03.438 00:58:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:03.438 00:58:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:03.438 00:58:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:03.438 00:58:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:03.438 00:58:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:03.438 00:58:53 -- accel/accel.sh@42 -- # jq -r . 00:06:03.438 [2024-11-26 00:58:53.775178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.438 [2024-11-26 00:58:53.775270] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940257 ] 00:06:03.438 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.438 [2024-11-26 00:58:53.837716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:03.438 [2024-11-26 00:58:53.958095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.811 00:58:55 -- accel/accel.sh@18 -- # out=' 00:06:04.811 SPDK Configuration: 00:06:04.811 Core mask: 0x1 00:06:04.811 00:06:04.811 Accel Perf Configuration: 00:06:04.811 Workload Type: dif_generate 00:06:04.811 Vector size: 4096 bytes 00:06:04.811 Transfer size: 4096 bytes 00:06:04.811 Block size: 512 bytes 00:06:04.811 Metadata size: 8 bytes 00:06:04.811 Vector count 1 00:06:04.811 Module: software 00:06:04.811 Queue depth: 32 00:06:04.811 Allocate depth: 32 00:06:04.811 # threads/core: 1 00:06:04.811 Run time: 1 seconds 00:06:04.811 Verify: No 00:06:04.811 00:06:04.811 Running for 1 seconds... 00:06:04.811 00:06:04.811 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.811 ------------------------------------------------------------------------------------ 00:06:04.811 0,0 96352/s 382 MiB/s 0 0 00:06:04.811 ==================================================================================== 00:06:04.811 Total 96352/s 376 MiB/s 0 0' 00:06:04.811 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:04.811 00:58:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:04.811 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:04.811 00:58:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:04.811 00:58:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.811 00:58:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.811 00:58:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.811 00:58:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.811 00:58:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.811 00:58:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.811 00:58:55 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.811 00:58:55 -- accel/accel.sh@42 -- # jq -r . 00:06:04.811 [2024-11-26 00:58:55.257917] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.811 [2024-11-26 00:58:55.258007] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940408 ] 00:06:04.811 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.811 [2024-11-26 00:58:55.319758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.070 [2024-11-26 00:58:55.438258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=0x1 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=dif_generate 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=software 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@23 -- # accel_module=software 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=32 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=32 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=1 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val=No 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:05.070 00:58:55 -- accel/accel.sh@21 -- # val= 00:06:05.070 00:58:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # IFS=: 00:06:05.070 00:58:55 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@21 -- # val= 00:06:06.445 00:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@21 -- # val= 00:06:06.445 00:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@21 -- # val= 00:06:06.445 00:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@21 -- # val= 00:06:06.445 00:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@21 -- # val= 00:06:06.445 00:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@21 -- # val= 00:06:06.445 00:58:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # IFS=: 00:06:06.445 00:58:56 -- accel/accel.sh@20 -- # read -r var val 00:06:06.445 00:58:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:06.445 00:58:56 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:06.445 00:58:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:06.445 00:06:06.445 real 0m2.966s 00:06:06.445 user 0m2.664s 00:06:06.445 sys 0m0.294s 00:06:06.445 00:58:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.445 00:58:56 -- common/autotest_common.sh@10 -- # set +x 00:06:06.445 ************************************ 00:06:06.445 END TEST accel_dif_generate 00:06:06.445 ************************************ 00:06:06.445 00:58:56 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:06.445 00:58:56 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:06.445 00:58:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.445 00:58:56 -- common/autotest_common.sh@10 -- # set +x 00:06:06.445 ************************************ 00:06:06.445 START TEST accel_dif_generate_copy 00:06:06.445 ************************************ 00:06:06.445 00:58:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:06.445 00:58:56 -- accel/accel.sh@16 -- # local accel_opc 00:06:06.445 00:58:56 -- accel/accel.sh@17 -- # local accel_module 00:06:06.445 00:58:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:06.445 00:58:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:06.445 00:58:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:06.445 00:58:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:06.445 00:58:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:06.445 00:58:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:06.445 00:58:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:06.445 00:58:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:06.445 00:58:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:06.445 00:58:56 -- accel/accel.sh@42 -- # jq -r . 00:06:06.445 [2024-11-26 00:58:56.765834] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.445 [2024-11-26 00:58:56.765924] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940633 ] 00:06:06.445 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.445 [2024-11-26 00:58:56.831659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.445 [2024-11-26 00:58:56.952427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.819 00:58:58 -- accel/accel.sh@18 -- # out=' 00:06:07.819 SPDK Configuration: 00:06:07.819 Core mask: 0x1 00:06:07.819 00:06:07.819 Accel Perf Configuration: 00:06:07.819 Workload Type: dif_generate_copy 00:06:07.819 Vector size: 4096 bytes 00:06:07.819 Transfer size: 4096 bytes 00:06:07.819 Vector count 1 00:06:07.819 Module: software 00:06:07.819 Queue depth: 32 00:06:07.819 Allocate depth: 32 00:06:07.819 # threads/core: 1 00:06:07.819 Run time: 1 seconds 00:06:07.819 Verify: No 00:06:07.819 00:06:07.819 Running for 1 seconds... 00:06:07.819 00:06:07.819 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:07.819 ------------------------------------------------------------------------------------ 00:06:07.819 0,0 75072/s 297 MiB/s 0 0 00:06:07.819 ==================================================================================== 00:06:07.819 Total 75072/s 293 MiB/s 0 0' 00:06:07.819 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:07.819 00:58:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:07.819 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:07.819 00:58:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:07.819 00:58:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.819 00:58:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.819 00:58:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.819 00:58:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.819 00:58:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.819 00:58:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.819 00:58:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.819 00:58:58 -- accel/accel.sh@42 -- # jq -r . 00:06:07.819 [2024-11-26 00:58:58.255343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.819 [2024-11-26 00:58:58.255437] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940827 ] 00:06:07.819 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.819 [2024-11-26 00:58:58.320729] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.077 [2024-11-26 00:58:58.439036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.077 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.077 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.077 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.077 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.077 00:58:58 -- accel/accel.sh@21 -- # val=0x1 00:06:08.077 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.077 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.077 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.077 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.077 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.077 00:58:58 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:08.077 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.077 00:58:58 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:08.077 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val=software 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@23 -- # accel_module=software 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val=32 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val=32 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val=1 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val=No 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:08.078 00:58:58 -- accel/accel.sh@21 -- # val= 00:06:08.078 00:58:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # IFS=: 00:06:08.078 00:58:58 -- accel/accel.sh@20 -- # read -r var val 00:06:09.449 00:58:59 -- accel/accel.sh@21 -- # val= 00:06:09.449 00:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:09.449 00:58:59 -- accel/accel.sh@21 -- # val= 00:06:09.449 00:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:09.449 00:58:59 -- accel/accel.sh@21 -- # val= 00:06:09.449 00:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:09.449 00:58:59 -- accel/accel.sh@21 -- # val= 00:06:09.449 00:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:09.449 00:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:09.450 00:58:59 -- accel/accel.sh@21 -- # val= 00:06:09.450 00:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.450 00:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:09.450 00:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:09.450 00:58:59 -- accel/accel.sh@21 -- # val= 00:06:09.450 00:58:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.450 00:58:59 -- accel/accel.sh@20 -- # IFS=: 00:06:09.450 00:58:59 -- accel/accel.sh@20 -- # read -r var val 00:06:09.450 00:58:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:09.450 00:58:59 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:09.450 00:58:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:09.450 00:06:09.450 real 0m2.972s 00:06:09.450 user 0m2.657s 00:06:09.450 sys 0m0.305s 00:06:09.450 00:58:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:09.450 00:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:09.450 ************************************ 00:06:09.450 END TEST accel_dif_generate_copy 00:06:09.450 ************************************ 00:06:09.450 00:58:59 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:09.450 00:58:59 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.450 00:58:59 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:09.450 00:58:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:09.450 00:58:59 -- common/autotest_common.sh@10 -- # set +x 00:06:09.450 ************************************ 00:06:09.450 START TEST accel_comp 00:06:09.450 ************************************ 00:06:09.450 00:58:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.450 00:58:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:09.450 00:58:59 -- accel/accel.sh@17 -- # local accel_module 00:06:09.450 00:58:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.450 00:58:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:09.450 00:58:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.450 00:58:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.450 00:58:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.450 00:58:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.450 00:58:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.450 00:58:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.450 00:58:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.450 00:58:59 -- accel/accel.sh@42 -- # jq -r . 00:06:09.450 [2024-11-26 00:58:59.763732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.450 [2024-11-26 00:58:59.763823] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940987 ] 00:06:09.450 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.450 [2024-11-26 00:58:59.824968] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.450 [2024-11-26 00:58:59.943809] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.824 00:59:01 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:10.824 00:06:10.824 SPDK Configuration: 00:06:10.824 Core mask: 0x1 00:06:10.824 00:06:10.824 Accel Perf Configuration: 00:06:10.824 Workload Type: compress 00:06:10.824 Transfer size: 4096 bytes 00:06:10.824 Vector count 1 00:06:10.824 Module: software 00:06:10.824 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.824 Queue depth: 32 00:06:10.824 Allocate depth: 32 00:06:10.824 # threads/core: 1 00:06:10.824 Run time: 1 seconds 00:06:10.824 Verify: No 00:06:10.824 00:06:10.824 Running for 1 seconds... 00:06:10.824 00:06:10.824 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:10.824 ------------------------------------------------------------------------------------ 00:06:10.824 0,0 31488/s 131 MiB/s 0 0 00:06:10.824 ==================================================================================== 00:06:10.825 Total 31488/s 123 MiB/s 0 0' 00:06:10.825 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:10.825 00:59:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.825 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:10.825 00:59:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:10.825 00:59:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.825 00:59:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.825 00:59:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.825 00:59:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.825 00:59:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.825 00:59:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.825 00:59:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.825 00:59:01 -- accel/accel.sh@42 -- # jq -r . 00:06:10.825 [2024-11-26 00:59:01.235369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.825 [2024-11-26 00:59:01.235461] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941130 ] 00:06:10.825 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.825 [2024-11-26 00:59:01.298323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.084 [2024-11-26 00:59:01.417322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=0x1 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=compress 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=software 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@23 -- # accel_module=software 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=32 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=32 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=1 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val=No 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:11.084 00:59:01 -- accel/accel.sh@21 -- # val= 00:06:11.084 00:59:01 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # IFS=: 00:06:11.084 00:59:01 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@21 -- # val= 00:06:12.463 00:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@21 -- # val= 00:06:12.463 00:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@21 -- # val= 00:06:12.463 00:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@21 -- # val= 00:06:12.463 00:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@21 -- # val= 00:06:12.463 00:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@21 -- # val= 00:06:12.463 00:59:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # IFS=: 00:06:12.463 00:59:02 -- accel/accel.sh@20 -- # read -r var val 00:06:12.463 00:59:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:12.463 00:59:02 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:12.463 00:59:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:12.463 00:06:12.463 real 0m2.962s 00:06:12.463 user 0m2.672s 00:06:12.463 sys 0m0.281s 00:06:12.463 00:59:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.463 00:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:12.463 ************************************ 00:06:12.463 END TEST accel_comp 00:06:12.463 ************************************ 00:06:12.463 00:59:02 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.463 00:59:02 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:12.463 00:59:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.463 00:59:02 -- common/autotest_common.sh@10 -- # set +x 00:06:12.463 ************************************ 00:06:12.463 START TEST accel_decomp 00:06:12.463 ************************************ 00:06:12.463 00:59:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.463 00:59:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:12.463 00:59:02 -- accel/accel.sh@17 -- # local accel_module 00:06:12.463 00:59:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.463 00:59:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:12.463 00:59:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.463 00:59:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.463 00:59:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.463 00:59:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.463 00:59:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.463 00:59:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.463 00:59:02 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.463 00:59:02 -- accel/accel.sh@42 -- # jq -r . 00:06:12.463 [2024-11-26 00:59:02.752311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.463 [2024-11-26 00:59:02.752405] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941410 ] 00:06:12.463 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.463 [2024-11-26 00:59:02.813459] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.463 [2024-11-26 00:59:02.932718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.839 00:59:04 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:13.839 00:06:13.839 SPDK Configuration: 00:06:13.839 Core mask: 0x1 00:06:13.839 00:06:13.839 Accel Perf Configuration: 00:06:13.839 Workload Type: decompress 00:06:13.839 Transfer size: 4096 bytes 00:06:13.839 Vector count 1 00:06:13.839 Module: software 00:06:13.839 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:13.839 Queue depth: 32 00:06:13.839 Allocate depth: 32 00:06:13.839 # threads/core: 1 00:06:13.839 Run time: 1 seconds 00:06:13.839 Verify: Yes 00:06:13.839 00:06:13.839 Running for 1 seconds... 00:06:13.839 00:06:13.839 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:13.839 ------------------------------------------------------------------------------------ 00:06:13.839 0,0 55424/s 102 MiB/s 0 0 00:06:13.839 ==================================================================================== 00:06:13.839 Total 55424/s 216 MiB/s 0 0' 00:06:13.839 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:13.839 00:59:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:13.839 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:13.839 00:59:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:13.839 00:59:04 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.839 00:59:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.839 00:59:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.839 00:59:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.840 00:59:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.840 00:59:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.840 00:59:04 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.840 00:59:04 -- accel/accel.sh@42 -- # jq -r . 00:06:13.840 [2024-11-26 00:59:04.227380] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.840 [2024-11-26 00:59:04.227478] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941553 ] 00:06:13.840 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.840 [2024-11-26 00:59:04.288841] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.099 [2024-11-26 00:59:04.409289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=0x1 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=decompress 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=software 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@23 -- # accel_module=software 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=32 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=32 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=1 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val=Yes 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:14.099 00:59:04 -- accel/accel.sh@21 -- # val= 00:06:14.099 00:59:04 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # IFS=: 00:06:14.099 00:59:04 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@21 -- # val= 00:06:15.474 00:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@21 -- # val= 00:06:15.474 00:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@21 -- # val= 00:06:15.474 00:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@21 -- # val= 00:06:15.474 00:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@21 -- # val= 00:06:15.474 00:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@21 -- # val= 00:06:15.474 00:59:05 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # IFS=: 00:06:15.474 00:59:05 -- accel/accel.sh@20 -- # read -r var val 00:06:15.474 00:59:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:15.474 00:59:05 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:15.474 00:59:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:15.474 00:06:15.474 real 0m2.966s 00:06:15.474 user 0m2.672s 00:06:15.474 sys 0m0.285s 00:06:15.474 00:59:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.474 00:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:15.474 ************************************ 00:06:15.474 END TEST accel_decomp 00:06:15.474 ************************************ 00:06:15.474 00:59:05 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.474 00:59:05 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:15.474 00:59:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.474 00:59:05 -- common/autotest_common.sh@10 -- # set +x 00:06:15.474 ************************************ 00:06:15.474 START TEST accel_decmop_full 00:06:15.474 ************************************ 00:06:15.474 00:59:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.474 00:59:05 -- accel/accel.sh@16 -- # local accel_opc 00:06:15.474 00:59:05 -- accel/accel.sh@17 -- # local accel_module 00:06:15.474 00:59:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.474 00:59:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:15.474 00:59:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.474 00:59:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.474 00:59:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.474 00:59:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.474 00:59:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.474 00:59:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.474 00:59:05 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.474 00:59:05 -- accel/accel.sh@42 -- # jq -r . 00:06:15.474 [2024-11-26 00:59:05.741240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.474 [2024-11-26 00:59:05.741333] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941714 ] 00:06:15.474 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.474 [2024-11-26 00:59:05.806773] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.474 [2024-11-26 00:59:05.932194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.848 00:59:07 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:16.848 00:06:16.848 SPDK Configuration: 00:06:16.848 Core mask: 0x1 00:06:16.848 00:06:16.848 Accel Perf Configuration: 00:06:16.848 Workload Type: decompress 00:06:16.848 Transfer size: 111250 bytes 00:06:16.848 Vector count 1 00:06:16.848 Module: software 00:06:16.848 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.848 Queue depth: 32 00:06:16.848 Allocate depth: 32 00:06:16.848 # threads/core: 1 00:06:16.848 Run time: 1 seconds 00:06:16.848 Verify: Yes 00:06:16.848 00:06:16.848 Running for 1 seconds... 00:06:16.848 00:06:16.848 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:16.848 ------------------------------------------------------------------------------------ 00:06:16.848 0,0 3808/s 157 MiB/s 0 0 00:06:16.848 ==================================================================================== 00:06:16.848 Total 3808/s 404 MiB/s 0 0' 00:06:16.848 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:16.848 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:16.848 00:59:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:16.848 00:59:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:16.848 00:59:07 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.848 00:59:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.848 00:59:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.848 00:59:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.848 00:59:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.849 00:59:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.849 00:59:07 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.849 00:59:07 -- accel/accel.sh@42 -- # jq -r . 00:06:16.849 [2024-11-26 00:59:07.242067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.849 [2024-11-26 00:59:07.242165] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid941976 ] 00:06:16.849 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.849 [2024-11-26 00:59:07.307778] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.107 [2024-11-26 00:59:07.429391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=0x1 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=decompress 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=software 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=32 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=32 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=1 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val=Yes 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:17.107 00:59:07 -- accel/accel.sh@21 -- # val= 00:06:17.107 00:59:07 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # IFS=: 00:06:17.107 00:59:07 -- accel/accel.sh@20 -- # read -r var val 00:06:18.481 00:59:08 -- accel/accel.sh@21 -- # val= 00:06:18.481 00:59:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # IFS=: 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # read -r var val 00:06:18.481 00:59:08 -- accel/accel.sh@21 -- # val= 00:06:18.481 00:59:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # IFS=: 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # read -r var val 00:06:18.481 00:59:08 -- accel/accel.sh@21 -- # val= 00:06:18.481 00:59:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # IFS=: 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # read -r var val 00:06:18.481 00:59:08 -- accel/accel.sh@21 -- # val= 00:06:18.481 00:59:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # IFS=: 00:06:18.481 00:59:08 -- accel/accel.sh@20 -- # read -r var val 00:06:18.482 00:59:08 -- accel/accel.sh@21 -- # val= 00:06:18.482 00:59:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.482 00:59:08 -- accel/accel.sh@20 -- # IFS=: 00:06:18.482 00:59:08 -- accel/accel.sh@20 -- # read -r var val 00:06:18.482 00:59:08 -- accel/accel.sh@21 -- # val= 00:06:18.482 00:59:08 -- accel/accel.sh@22 -- # case "$var" in 00:06:18.482 00:59:08 -- accel/accel.sh@20 -- # IFS=: 00:06:18.482 00:59:08 -- accel/accel.sh@20 -- # read -r var val 00:06:18.482 00:59:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:18.482 00:59:08 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:18.482 00:59:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:18.482 00:06:18.482 real 0m2.995s 00:06:18.482 user 0m2.699s 00:06:18.482 sys 0m0.286s 00:06:18.482 00:59:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.482 00:59:08 -- common/autotest_common.sh@10 -- # set +x 00:06:18.482 ************************************ 00:06:18.482 END TEST accel_decmop_full 00:06:18.482 ************************************ 00:06:18.482 00:59:08 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.482 00:59:08 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:18.482 00:59:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.482 00:59:08 -- common/autotest_common.sh@10 -- # set +x 00:06:18.482 ************************************ 00:06:18.482 START TEST accel_decomp_mcore 00:06:18.482 ************************************ 00:06:18.482 00:59:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.482 00:59:08 -- accel/accel.sh@16 -- # local accel_opc 00:06:18.482 00:59:08 -- accel/accel.sh@17 -- # local accel_module 00:06:18.482 00:59:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.482 00:59:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:18.482 00:59:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:18.482 00:59:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:18.482 00:59:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:18.482 00:59:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:18.482 00:59:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:18.482 00:59:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:18.482 00:59:08 -- accel/accel.sh@41 -- # local IFS=, 00:06:18.482 00:59:08 -- accel/accel.sh@42 -- # jq -r . 00:06:18.482 [2024-11-26 00:59:08.765462] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.482 [2024-11-26 00:59:08.765556] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid942142 ] 00:06:18.482 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.482 [2024-11-26 00:59:08.827662] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:18.482 [2024-11-26 00:59:08.951190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.482 [2024-11-26 00:59:08.951247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.482 [2024-11-26 00:59:08.951302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:18.482 [2024-11-26 00:59:08.951305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.856 00:59:10 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:19.856 00:06:19.856 SPDK Configuration: 00:06:19.856 Core mask: 0xf 00:06:19.856 00:06:19.856 Accel Perf Configuration: 00:06:19.856 Workload Type: decompress 00:06:19.856 Transfer size: 4096 bytes 00:06:19.856 Vector count 1 00:06:19.856 Module: software 00:06:19.856 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.856 Queue depth: 32 00:06:19.856 Allocate depth: 32 00:06:19.856 # threads/core: 1 00:06:19.856 Run time: 1 seconds 00:06:19.856 Verify: Yes 00:06:19.856 00:06:19.856 Running for 1 seconds... 00:06:19.856 00:06:19.856 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:19.856 ------------------------------------------------------------------------------------ 00:06:19.856 0,0 50048/s 92 MiB/s 0 0 00:06:19.856 3,0 50496/s 93 MiB/s 0 0 00:06:19.856 2,0 50400/s 92 MiB/s 0 0 00:06:19.856 1,0 50400/s 92 MiB/s 0 0 00:06:19.856 ==================================================================================== 00:06:19.856 Total 201344/s 786 MiB/s 0 0' 00:06:19.856 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:19.856 00:59:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:19.856 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:19.857 00:59:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:19.857 00:59:10 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.857 00:59:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.857 00:59:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.857 00:59:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.857 00:59:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.857 00:59:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.857 00:59:10 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.857 00:59:10 -- accel/accel.sh@42 -- # jq -r . 00:06:19.857 [2024-11-26 00:59:10.269304] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.857 [2024-11-26 00:59:10.269401] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid942285 ] 00:06:19.857 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.857 [2024-11-26 00:59:10.338175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:20.115 [2024-11-26 00:59:10.461905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:20.115 [2024-11-26 00:59:10.461962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:20.115 [2024-11-26 00:59:10.462014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:20.115 [2024-11-26 00:59:10.462018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=0xf 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=decompress 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=software 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=32 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=32 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=1 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val=Yes 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:20.115 00:59:10 -- accel/accel.sh@21 -- # val= 00:06:20.115 00:59:10 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # IFS=: 00:06:20.115 00:59:10 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.492 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.492 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.492 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.493 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.493 00:59:11 -- accel/accel.sh@21 -- # val= 00:06:21.493 00:59:11 -- accel/accel.sh@22 -- # case "$var" in 00:06:21.493 00:59:11 -- accel/accel.sh@20 -- # IFS=: 00:06:21.493 00:59:11 -- accel/accel.sh@20 -- # read -r var val 00:06:21.493 00:59:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:21.493 00:59:11 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:21.493 00:59:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:21.493 00:06:21.493 real 0m3.003s 00:06:21.493 user 0m9.622s 00:06:21.493 sys 0m0.325s 00:06:21.493 00:59:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:21.493 00:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:21.493 ************************************ 00:06:21.493 END TEST accel_decomp_mcore 00:06:21.493 ************************************ 00:06:21.493 00:59:11 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.493 00:59:11 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:21.493 00:59:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:21.493 00:59:11 -- common/autotest_common.sh@10 -- # set +x 00:06:21.493 ************************************ 00:06:21.493 START TEST accel_decomp_full_mcore 00:06:21.493 ************************************ 00:06:21.493 00:59:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.493 00:59:11 -- accel/accel.sh@16 -- # local accel_opc 00:06:21.493 00:59:11 -- accel/accel.sh@17 -- # local accel_module 00:06:21.493 00:59:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.493 00:59:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:21.493 00:59:11 -- accel/accel.sh@12 -- # build_accel_config 00:06:21.493 00:59:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:21.493 00:59:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:21.493 00:59:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:21.493 00:59:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:21.493 00:59:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:21.493 00:59:11 -- accel/accel.sh@41 -- # local IFS=, 00:06:21.493 00:59:11 -- accel/accel.sh@42 -- # jq -r . 00:06:21.493 [2024-11-26 00:59:11.793779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:21.493 [2024-11-26 00:59:11.793866] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid942572 ] 00:06:21.493 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.493 [2024-11-26 00:59:11.854857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:21.493 [2024-11-26 00:59:11.978509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.493 [2024-11-26 00:59:11.978564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.493 [2024-11-26 00:59:11.978620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:21.493 [2024-11-26 00:59:11.978623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.868 00:59:13 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:22.868 00:06:22.868 SPDK Configuration: 00:06:22.868 Core mask: 0xf 00:06:22.868 00:06:22.868 Accel Perf Configuration: 00:06:22.868 Workload Type: decompress 00:06:22.868 Transfer size: 111250 bytes 00:06:22.868 Vector count 1 00:06:22.868 Module: software 00:06:22.868 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.868 Queue depth: 32 00:06:22.868 Allocate depth: 32 00:06:22.868 # threads/core: 1 00:06:22.868 Run time: 1 seconds 00:06:22.868 Verify: Yes 00:06:22.868 00:06:22.868 Running for 1 seconds... 00:06:22.868 00:06:22.868 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:22.868 ------------------------------------------------------------------------------------ 00:06:22.868 0,0 3776/s 155 MiB/s 0 0 00:06:22.868 3,0 3808/s 157 MiB/s 0 0 00:06:22.868 2,0 3808/s 157 MiB/s 0 0 00:06:22.868 1,0 3776/s 155 MiB/s 0 0 00:06:22.868 ==================================================================================== 00:06:22.868 Total 15168/s 1609 MiB/s 0 0' 00:06:22.868 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:22.868 00:59:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:22.868 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:22.868 00:59:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:22.868 00:59:13 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.868 00:59:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.868 00:59:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.868 00:59:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.868 00:59:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.868 00:59:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.868 00:59:13 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.868 00:59:13 -- accel/accel.sh@42 -- # jq -r . 00:06:22.868 [2024-11-26 00:59:13.303211] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.868 [2024-11-26 00:59:13.303303] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid942718 ] 00:06:22.868 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.868 [2024-11-26 00:59:13.369117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:23.127 [2024-11-26 00:59:13.493673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.127 [2024-11-26 00:59:13.493728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.127 [2024-11-26 00:59:13.493757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:23.127 [2024-11-26 00:59:13.493760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=0xf 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=decompress 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=software 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=32 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=32 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=1 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val=Yes 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.127 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:23.127 00:59:13 -- accel/accel.sh@21 -- # val= 00:06:23.127 00:59:13 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.128 00:59:13 -- accel/accel.sh@20 -- # IFS=: 00:06:23.128 00:59:13 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@21 -- # val= 00:06:24.504 00:59:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # IFS=: 00:06:24.504 00:59:14 -- accel/accel.sh@20 -- # read -r var val 00:06:24.504 00:59:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.504 00:59:14 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.504 00:59:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.504 00:06:24.504 real 0m3.028s 00:06:24.504 user 0m9.727s 00:06:24.504 sys 0m0.335s 00:06:24.504 00:59:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.504 00:59:14 -- common/autotest_common.sh@10 -- # set +x 00:06:24.504 ************************************ 00:06:24.504 END TEST accel_decomp_full_mcore 00:06:24.504 ************************************ 00:06:24.504 00:59:14 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:24.504 00:59:14 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:24.504 00:59:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.504 00:59:14 -- common/autotest_common.sh@10 -- # set +x 00:06:24.504 ************************************ 00:06:24.504 START TEST accel_decomp_mthread 00:06:24.504 ************************************ 00:06:24.504 00:59:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:24.505 00:59:14 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.505 00:59:14 -- accel/accel.sh@17 -- # local accel_module 00:06:24.505 00:59:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:24.505 00:59:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:24.505 00:59:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.505 00:59:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.505 00:59:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.505 00:59:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.505 00:59:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.505 00:59:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.505 00:59:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.505 00:59:14 -- accel/accel.sh@42 -- # jq -r . 00:06:24.505 [2024-11-26 00:59:14.848043] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.505 [2024-11-26 00:59:14.848130] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid942883 ] 00:06:24.505 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.505 [2024-11-26 00:59:14.913756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.505 [2024-11-26 00:59:15.036188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.880 00:59:16 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:25.880 00:06:25.880 SPDK Configuration: 00:06:25.880 Core mask: 0x1 00:06:25.880 00:06:25.880 Accel Perf Configuration: 00:06:25.880 Workload Type: decompress 00:06:25.880 Transfer size: 4096 bytes 00:06:25.880 Vector count 1 00:06:25.880 Module: software 00:06:25.880 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.880 Queue depth: 32 00:06:25.880 Allocate depth: 32 00:06:25.880 # threads/core: 2 00:06:25.880 Run time: 1 seconds 00:06:25.880 Verify: Yes 00:06:25.880 00:06:25.880 Running for 1 seconds... 00:06:25.880 00:06:25.880 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:25.880 ------------------------------------------------------------------------------------ 00:06:25.880 0,1 27968/s 51 MiB/s 0 0 00:06:25.880 0,0 27872/s 51 MiB/s 0 0 00:06:25.880 ==================================================================================== 00:06:25.880 Total 55840/s 218 MiB/s 0 0' 00:06:25.880 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:25.880 00:59:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:25.880 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:25.880 00:59:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:25.880 00:59:16 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.880 00:59:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.880 00:59:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.880 00:59:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.880 00:59:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.880 00:59:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.880 00:59:16 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.880 00:59:16 -- accel/accel.sh@42 -- # jq -r . 00:06:25.880 [2024-11-26 00:59:16.347271] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.880 [2024-11-26 00:59:16.347368] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid943140 ] 00:06:25.880 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.139 [2024-11-26 00:59:16.413560] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.139 [2024-11-26 00:59:16.532627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=0x1 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=decompress 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=software 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=32 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=32 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=2 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val=Yes 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:26.139 00:59:16 -- accel/accel.sh@21 -- # val= 00:06:26.139 00:59:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # IFS=: 00:06:26.139 00:59:16 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@21 -- # val= 00:06:27.632 00:59:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # IFS=: 00:06:27.632 00:59:17 -- accel/accel.sh@20 -- # read -r var val 00:06:27.632 00:59:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.632 00:59:17 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.632 00:59:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.632 00:06:27.632 real 0m2.979s 00:06:27.632 user 0m2.657s 00:06:27.632 sys 0m0.313s 00:06:27.632 00:59:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.632 00:59:17 -- common/autotest_common.sh@10 -- # set +x 00:06:27.632 ************************************ 00:06:27.632 END TEST accel_decomp_mthread 00:06:27.632 ************************************ 00:06:27.632 00:59:17 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.632 00:59:17 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:27.632 00:59:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.632 00:59:17 -- common/autotest_common.sh@10 -- # set +x 00:06:27.632 ************************************ 00:06:27.632 START TEST accel_deomp_full_mthread 00:06:27.632 ************************************ 00:06:27.632 00:59:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.632 00:59:17 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.632 00:59:17 -- accel/accel.sh@17 -- # local accel_module 00:06:27.632 00:59:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.632 00:59:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:27.632 00:59:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.632 00:59:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.632 00:59:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.632 00:59:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.632 00:59:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.632 00:59:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.632 00:59:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.632 00:59:17 -- accel/accel.sh@42 -- # jq -r . 00:06:27.632 [2024-11-26 00:59:17.851568] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.632 [2024-11-26 00:59:17.851651] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid943311 ] 00:06:27.632 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.632 [2024-11-26 00:59:17.914977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.632 [2024-11-26 00:59:18.034424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.034 00:59:19 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:29.034 00:06:29.034 SPDK Configuration: 00:06:29.034 Core mask: 0x1 00:06:29.034 00:06:29.034 Accel Perf Configuration: 00:06:29.034 Workload Type: decompress 00:06:29.034 Transfer size: 111250 bytes 00:06:29.034 Vector count 1 00:06:29.034 Module: software 00:06:29.034 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.034 Queue depth: 32 00:06:29.034 Allocate depth: 32 00:06:29.034 # threads/core: 2 00:06:29.034 Run time: 1 seconds 00:06:29.034 Verify: Yes 00:06:29.034 00:06:29.034 Running for 1 seconds... 00:06:29.034 00:06:29.034 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:29.034 ------------------------------------------------------------------------------------ 00:06:29.034 0,1 1952/s 80 MiB/s 0 0 00:06:29.034 0,0 1920/s 79 MiB/s 0 0 00:06:29.034 ==================================================================================== 00:06:29.034 Total 3872/s 410 MiB/s 0 0' 00:06:29.034 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.034 00:59:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:29.034 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.035 00:59:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:29.035 00:59:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.035 00:59:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.035 00:59:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.035 00:59:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.035 00:59:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.035 00:59:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.035 00:59:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.035 00:59:19 -- accel/accel.sh@42 -- # jq -r . 00:06:29.035 [2024-11-26 00:59:19.375378] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.035 [2024-11-26 00:59:19.375474] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid943457 ] 00:06:29.035 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.035 [2024-11-26 00:59:19.437609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.035 [2024-11-26 00:59:19.558967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=0x1 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=decompress 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=software 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=32 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=32 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=2 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val=Yes 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:29.293 00:59:19 -- accel/accel.sh@21 -- # val= 00:06:29.293 00:59:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # IFS=: 00:06:29.293 00:59:19 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@21 -- # val= 00:06:30.668 00:59:20 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # IFS=: 00:06:30.668 00:59:20 -- accel/accel.sh@20 -- # read -r var val 00:06:30.668 00:59:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.668 00:59:20 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.668 00:59:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.668 00:06:30.668 real 0m3.043s 00:06:30.668 user 0m2.738s 00:06:30.668 sys 0m0.296s 00:06:30.668 00:59:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.668 00:59:20 -- common/autotest_common.sh@10 -- # set +x 00:06:30.668 ************************************ 00:06:30.668 END TEST accel_deomp_full_mthread 00:06:30.668 ************************************ 00:06:30.668 00:59:20 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:30.668 00:59:20 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:30.668 00:59:20 -- accel/accel.sh@129 -- # build_accel_config 00:06:30.668 00:59:20 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:30.668 00:59:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.668 00:59:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.668 00:59:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.668 00:59:20 -- common/autotest_common.sh@10 -- # set +x 00:06:30.668 00:59:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.668 00:59:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.668 00:59:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.668 00:59:20 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.668 00:59:20 -- accel/accel.sh@42 -- # jq -r . 00:06:30.668 ************************************ 00:06:30.668 START TEST accel_dif_functional_tests 00:06:30.668 ************************************ 00:06:30.668 00:59:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:30.668 [2024-11-26 00:59:20.941751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.668 [2024-11-26 00:59:20.941847] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid943738 ] 00:06:30.668 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.668 [2024-11-26 00:59:21.008844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:30.668 [2024-11-26 00:59:21.131766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:30.668 [2024-11-26 00:59:21.131823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:30.668 [2024-11-26 00:59:21.131827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.926 00:06:30.926 00:06:30.926 CUnit - A unit testing framework for C - Version 2.1-3 00:06:30.926 http://cunit.sourceforge.net/ 00:06:30.926 00:06:30.926 00:06:30.926 Suite: accel_dif 00:06:30.926 Test: verify: DIF generated, GUARD check ...passed 00:06:30.926 Test: verify: DIF generated, APPTAG check ...passed 00:06:30.926 Test: verify: DIF generated, REFTAG check ...passed 00:06:30.926 Test: verify: DIF not generated, GUARD check ...[2024-11-26 00:59:21.227043] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:30.926 [2024-11-26 00:59:21.227114] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:30.926 passed 00:06:30.926 Test: verify: DIF not generated, APPTAG check ...[2024-11-26 00:59:21.227157] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:30.926 [2024-11-26 00:59:21.227187] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:30.926 passed 00:06:30.926 Test: verify: DIF not generated, REFTAG check ...[2024-11-26 00:59:21.227223] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:30.926 [2024-11-26 00:59:21.227251] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:30.926 passed 00:06:30.926 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:30.926 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-26 00:59:21.227320] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:30.926 passed 00:06:30.926 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:30.926 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:30.926 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:30.927 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-26 00:59:21.227477] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:30.927 passed 00:06:30.927 Test: generate copy: DIF generated, GUARD check ...passed 00:06:30.927 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:30.927 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:30.927 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:30.927 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:30.927 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:30.927 Test: generate copy: iovecs-len validate ...[2024-11-26 00:59:21.227756] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:30.927 passed 00:06:30.927 Test: generate copy: buffer alignment validate ...passed 00:06:30.927 00:06:30.927 Run Summary: Type Total Ran Passed Failed Inactive 00:06:30.927 suites 1 1 n/a 0 0 00:06:30.927 tests 20 20 20 0 0 00:06:30.927 asserts 204 204 204 0 n/a 00:06:30.927 00:06:30.927 Elapsed time = 0.003 seconds 00:06:31.185 00:06:31.185 real 0m0.585s 00:06:31.185 user 0m0.865s 00:06:31.185 sys 0m0.184s 00:06:31.185 00:59:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.185 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.185 ************************************ 00:06:31.185 END TEST accel_dif_functional_tests 00:06:31.185 ************************************ 00:06:31.185 00:06:31.185 real 1m3.278s 00:06:31.185 user 1m11.131s 00:06:31.185 sys 0m7.296s 00:06:31.185 00:59:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.185 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.185 ************************************ 00:06:31.185 END TEST accel 00:06:31.185 ************************************ 00:06:31.185 00:59:21 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:31.185 00:59:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.185 00:59:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.185 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.185 ************************************ 00:06:31.185 START TEST accel_rpc 00:06:31.185 ************************************ 00:06:31.185 00:59:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:31.185 * Looking for test storage... 00:06:31.185 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:31.185 00:59:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:31.185 00:59:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:31.185 00:59:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:31.185 00:59:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:31.185 00:59:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:31.185 00:59:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:31.185 00:59:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:31.185 00:59:21 -- scripts/common.sh@335 -- # IFS=.-: 00:06:31.185 00:59:21 -- scripts/common.sh@335 -- # read -ra ver1 00:06:31.185 00:59:21 -- scripts/common.sh@336 -- # IFS=.-: 00:06:31.185 00:59:21 -- scripts/common.sh@336 -- # read -ra ver2 00:06:31.185 00:59:21 -- scripts/common.sh@337 -- # local 'op=<' 00:06:31.185 00:59:21 -- scripts/common.sh@339 -- # ver1_l=2 00:06:31.185 00:59:21 -- scripts/common.sh@340 -- # ver2_l=1 00:06:31.185 00:59:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:31.185 00:59:21 -- scripts/common.sh@343 -- # case "$op" in 00:06:31.185 00:59:21 -- scripts/common.sh@344 -- # : 1 00:06:31.185 00:59:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:31.185 00:59:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:31.185 00:59:21 -- scripts/common.sh@364 -- # decimal 1 00:06:31.185 00:59:21 -- scripts/common.sh@352 -- # local d=1 00:06:31.185 00:59:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:31.185 00:59:21 -- scripts/common.sh@354 -- # echo 1 00:06:31.185 00:59:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:31.185 00:59:21 -- scripts/common.sh@365 -- # decimal 2 00:06:31.185 00:59:21 -- scripts/common.sh@352 -- # local d=2 00:06:31.185 00:59:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:31.185 00:59:21 -- scripts/common.sh@354 -- # echo 2 00:06:31.185 00:59:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:31.185 00:59:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:31.185 00:59:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:31.185 00:59:21 -- scripts/common.sh@367 -- # return 0 00:06:31.185 00:59:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:31.185 00:59:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:31.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.185 --rc genhtml_branch_coverage=1 00:06:31.185 --rc genhtml_function_coverage=1 00:06:31.185 --rc genhtml_legend=1 00:06:31.185 --rc geninfo_all_blocks=1 00:06:31.185 --rc geninfo_unexecuted_blocks=1 00:06:31.185 00:06:31.185 ' 00:06:31.185 00:59:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:31.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.185 --rc genhtml_branch_coverage=1 00:06:31.185 --rc genhtml_function_coverage=1 00:06:31.185 --rc genhtml_legend=1 00:06:31.185 --rc geninfo_all_blocks=1 00:06:31.185 --rc geninfo_unexecuted_blocks=1 00:06:31.185 00:06:31.185 ' 00:06:31.185 00:59:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:31.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.185 --rc genhtml_branch_coverage=1 00:06:31.185 --rc genhtml_function_coverage=1 00:06:31.185 --rc genhtml_legend=1 00:06:31.185 --rc geninfo_all_blocks=1 00:06:31.185 --rc geninfo_unexecuted_blocks=1 00:06:31.185 00:06:31.185 ' 00:06:31.185 00:59:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:31.185 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:31.185 --rc genhtml_branch_coverage=1 00:06:31.185 --rc genhtml_function_coverage=1 00:06:31.185 --rc genhtml_legend=1 00:06:31.185 --rc geninfo_all_blocks=1 00:06:31.185 --rc geninfo_unexecuted_blocks=1 00:06:31.185 00:06:31.185 ' 00:06:31.185 00:59:21 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:31.185 00:59:21 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=943867 00:06:31.185 00:59:21 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:31.185 00:59:21 -- accel/accel_rpc.sh@15 -- # waitforlisten 943867 00:06:31.185 00:59:21 -- common/autotest_common.sh@829 -- # '[' -z 943867 ']' 00:06:31.185 00:59:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:31.185 00:59:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.185 00:59:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:31.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:31.185 00:59:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.185 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.444 [2024-11-26 00:59:21.732885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.445 [2024-11-26 00:59:21.732989] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid943867 ] 00:06:31.445 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.445 [2024-11-26 00:59:21.790924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.445 [2024-11-26 00:59:21.895117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:31.445 [2024-11-26 00:59:21.895322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.445 00:59:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.445 00:59:21 -- common/autotest_common.sh@862 -- # return 0 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:31.445 00:59:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:31.445 00:59:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:31.445 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.445 ************************************ 00:06:31.445 START TEST accel_assign_opcode 00:06:31.445 ************************************ 00:06:31.445 00:59:21 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:31.445 00:59:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:31.445 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.445 [2024-11-26 00:59:21.947892] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:31.445 00:59:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:31.445 00:59:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:31.445 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.445 [2024-11-26 00:59:21.955906] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:31.445 00:59:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:31.445 00:59:21 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:31.445 00:59:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:31.445 00:59:21 -- common/autotest_common.sh@10 -- # set +x 00:06:31.704 00:59:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:31.704 00:59:22 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:31.704 00:59:22 -- accel/accel_rpc.sh@42 -- # grep software 00:06:31.704 00:59:22 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:31.704 00:59:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:31.704 00:59:22 -- common/autotest_common.sh@10 -- # set +x 00:06:31.704 00:59:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:31.962 software 00:06:31.962 00:06:31.962 real 0m0.307s 00:06:31.962 user 0m0.043s 00:06:31.962 sys 0m0.006s 00:06:31.962 00:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:31.962 00:59:22 -- common/autotest_common.sh@10 -- # set +x 00:06:31.962 ************************************ 00:06:31.962 END TEST accel_assign_opcode 00:06:31.962 ************************************ 00:06:31.962 00:59:22 -- accel/accel_rpc.sh@55 -- # killprocess 943867 00:06:31.962 00:59:22 -- common/autotest_common.sh@936 -- # '[' -z 943867 ']' 00:06:31.963 00:59:22 -- common/autotest_common.sh@940 -- # kill -0 943867 00:06:31.963 00:59:22 -- common/autotest_common.sh@941 -- # uname 00:06:31.963 00:59:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.963 00:59:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 943867 00:06:31.963 00:59:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.963 00:59:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.963 00:59:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 943867' 00:06:31.963 killing process with pid 943867 00:06:31.963 00:59:22 -- common/autotest_common.sh@955 -- # kill 943867 00:06:31.963 00:59:22 -- common/autotest_common.sh@960 -- # wait 943867 00:06:32.530 00:06:32.530 real 0m1.251s 00:06:32.530 user 0m1.185s 00:06:32.530 sys 0m0.428s 00:06:32.530 00:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.530 00:59:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.530 ************************************ 00:06:32.530 END TEST accel_rpc 00:06:32.530 ************************************ 00:06:32.530 00:59:22 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:32.530 00:59:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:32.530 00:59:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.530 00:59:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.530 ************************************ 00:06:32.530 START TEST app_cmdline 00:06:32.530 ************************************ 00:06:32.530 00:59:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:32.530 * Looking for test storage... 00:06:32.530 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:32.530 00:59:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:32.530 00:59:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:32.530 00:59:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:32.530 00:59:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:32.530 00:59:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:32.530 00:59:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:32.530 00:59:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:32.530 00:59:22 -- scripts/common.sh@335 -- # IFS=.-: 00:06:32.530 00:59:22 -- scripts/common.sh@335 -- # read -ra ver1 00:06:32.530 00:59:22 -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.530 00:59:22 -- scripts/common.sh@336 -- # read -ra ver2 00:06:32.530 00:59:22 -- scripts/common.sh@337 -- # local 'op=<' 00:06:32.530 00:59:22 -- scripts/common.sh@339 -- # ver1_l=2 00:06:32.530 00:59:22 -- scripts/common.sh@340 -- # ver2_l=1 00:06:32.530 00:59:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:32.530 00:59:22 -- scripts/common.sh@343 -- # case "$op" in 00:06:32.530 00:59:22 -- scripts/common.sh@344 -- # : 1 00:06:32.530 00:59:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:32.530 00:59:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.530 00:59:22 -- scripts/common.sh@364 -- # decimal 1 00:06:32.530 00:59:22 -- scripts/common.sh@352 -- # local d=1 00:06:32.530 00:59:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.530 00:59:22 -- scripts/common.sh@354 -- # echo 1 00:06:32.530 00:59:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:32.530 00:59:22 -- scripts/common.sh@365 -- # decimal 2 00:06:32.530 00:59:22 -- scripts/common.sh@352 -- # local d=2 00:06:32.530 00:59:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.530 00:59:22 -- scripts/common.sh@354 -- # echo 2 00:06:32.530 00:59:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:32.530 00:59:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:32.530 00:59:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:32.530 00:59:22 -- scripts/common.sh@367 -- # return 0 00:06:32.530 00:59:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.530 00:59:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:32.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.530 --rc genhtml_branch_coverage=1 00:06:32.530 --rc genhtml_function_coverage=1 00:06:32.530 --rc genhtml_legend=1 00:06:32.530 --rc geninfo_all_blocks=1 00:06:32.530 --rc geninfo_unexecuted_blocks=1 00:06:32.530 00:06:32.530 ' 00:06:32.530 00:59:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:32.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.530 --rc genhtml_branch_coverage=1 00:06:32.530 --rc genhtml_function_coverage=1 00:06:32.530 --rc genhtml_legend=1 00:06:32.530 --rc geninfo_all_blocks=1 00:06:32.530 --rc geninfo_unexecuted_blocks=1 00:06:32.530 00:06:32.530 ' 00:06:32.530 00:59:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:32.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.530 --rc genhtml_branch_coverage=1 00:06:32.530 --rc genhtml_function_coverage=1 00:06:32.530 --rc genhtml_legend=1 00:06:32.530 --rc geninfo_all_blocks=1 00:06:32.530 --rc geninfo_unexecuted_blocks=1 00:06:32.530 00:06:32.530 ' 00:06:32.530 00:59:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:32.530 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.530 --rc genhtml_branch_coverage=1 00:06:32.530 --rc genhtml_function_coverage=1 00:06:32.530 --rc genhtml_legend=1 00:06:32.530 --rc geninfo_all_blocks=1 00:06:32.530 --rc geninfo_unexecuted_blocks=1 00:06:32.530 00:06:32.530 ' 00:06:32.530 00:59:22 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:32.530 00:59:22 -- app/cmdline.sh@17 -- # spdk_tgt_pid=944151 00:06:32.530 00:59:22 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:32.530 00:59:22 -- app/cmdline.sh@18 -- # waitforlisten 944151 00:06:32.530 00:59:22 -- common/autotest_common.sh@829 -- # '[' -z 944151 ']' 00:06:32.530 00:59:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.530 00:59:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:32.530 00:59:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.530 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.530 00:59:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:32.530 00:59:22 -- common/autotest_common.sh@10 -- # set +x 00:06:32.530 [2024-11-26 00:59:23.019039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.530 [2024-11-26 00:59:23.019118] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid944151 ] 00:06:32.530 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.789 [2024-11-26 00:59:23.080582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.789 [2024-11-26 00:59:23.198053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:32.789 [2024-11-26 00:59:23.198248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.721 00:59:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:33.721 00:59:24 -- common/autotest_common.sh@862 -- # return 0 00:06:33.721 00:59:24 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:33.979 { 00:06:33.979 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:33.979 "fields": { 00:06:33.979 "major": 24, 00:06:33.979 "minor": 1, 00:06:33.979 "patch": 1, 00:06:33.979 "suffix": "-pre", 00:06:33.979 "commit": "c13c99a5e" 00:06:33.979 } 00:06:33.979 } 00:06:33.979 00:59:24 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:33.979 00:59:24 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:33.979 00:59:24 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:33.979 00:59:24 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:33.979 00:59:24 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:33.979 00:59:24 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:33.979 00:59:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:33.979 00:59:24 -- common/autotest_common.sh@10 -- # set +x 00:06:33.979 00:59:24 -- app/cmdline.sh@26 -- # sort 00:06:33.979 00:59:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:33.979 00:59:24 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:33.979 00:59:24 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:33.979 00:59:24 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:33.979 00:59:24 -- common/autotest_common.sh@650 -- # local es=0 00:06:33.979 00:59:24 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:33.979 00:59:24 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:33.979 00:59:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.979 00:59:24 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:33.979 00:59:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.979 00:59:24 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:33.979 00:59:24 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:33.979 00:59:24 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:33.979 00:59:24 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:33.979 00:59:24 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:34.238 request: 00:06:34.238 { 00:06:34.238 "method": "env_dpdk_get_mem_stats", 00:06:34.238 "req_id": 1 00:06:34.238 } 00:06:34.238 Got JSON-RPC error response 00:06:34.238 response: 00:06:34.238 { 00:06:34.238 "code": -32601, 00:06:34.238 "message": "Method not found" 00:06:34.238 } 00:06:34.238 00:59:24 -- common/autotest_common.sh@653 -- # es=1 00:06:34.238 00:59:24 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:34.238 00:59:24 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:34.238 00:59:24 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:34.238 00:59:24 -- app/cmdline.sh@1 -- # killprocess 944151 00:06:34.238 00:59:24 -- common/autotest_common.sh@936 -- # '[' -z 944151 ']' 00:06:34.238 00:59:24 -- common/autotest_common.sh@940 -- # kill -0 944151 00:06:34.238 00:59:24 -- common/autotest_common.sh@941 -- # uname 00:06:34.238 00:59:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:34.238 00:59:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 944151 00:06:34.238 00:59:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:34.238 00:59:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:34.238 00:59:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 944151' 00:06:34.238 killing process with pid 944151 00:06:34.238 00:59:24 -- common/autotest_common.sh@955 -- # kill 944151 00:06:34.238 00:59:24 -- common/autotest_common.sh@960 -- # wait 944151 00:06:34.805 00:06:34.805 real 0m2.342s 00:06:34.805 user 0m2.981s 00:06:34.805 sys 0m0.553s 00:06:34.805 00:59:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.805 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:34.805 ************************************ 00:06:34.805 END TEST app_cmdline 00:06:34.805 ************************************ 00:06:34.805 00:59:25 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:34.805 00:59:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.805 00:59:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.805 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:34.805 ************************************ 00:06:34.805 START TEST version 00:06:34.805 ************************************ 00:06:34.805 00:59:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:34.805 * Looking for test storage... 00:06:34.805 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:34.805 00:59:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:34.805 00:59:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:34.805 00:59:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:34.805 00:59:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:34.805 00:59:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:34.805 00:59:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:34.805 00:59:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:34.805 00:59:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:34.805 00:59:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:34.805 00:59:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:34.805 00:59:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:34.805 00:59:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:34.805 00:59:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:34.805 00:59:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:34.805 00:59:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:34.805 00:59:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:34.805 00:59:25 -- scripts/common.sh@344 -- # : 1 00:06:34.805 00:59:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:34.805 00:59:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:34.805 00:59:25 -- scripts/common.sh@364 -- # decimal 1 00:06:34.805 00:59:25 -- scripts/common.sh@352 -- # local d=1 00:06:34.805 00:59:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:34.805 00:59:25 -- scripts/common.sh@354 -- # echo 1 00:06:34.805 00:59:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:34.805 00:59:25 -- scripts/common.sh@365 -- # decimal 2 00:06:34.805 00:59:25 -- scripts/common.sh@352 -- # local d=2 00:06:34.805 00:59:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:34.805 00:59:25 -- scripts/common.sh@354 -- # echo 2 00:06:34.805 00:59:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:34.805 00:59:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:34.805 00:59:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:34.805 00:59:25 -- scripts/common.sh@367 -- # return 0 00:06:34.805 00:59:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:34.805 00:59:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:34.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.805 --rc genhtml_branch_coverage=1 00:06:34.805 --rc genhtml_function_coverage=1 00:06:34.805 --rc genhtml_legend=1 00:06:34.805 --rc geninfo_all_blocks=1 00:06:34.805 --rc geninfo_unexecuted_blocks=1 00:06:34.805 00:06:34.805 ' 00:06:34.805 00:59:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:34.805 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.805 --rc genhtml_branch_coverage=1 00:06:34.805 --rc genhtml_function_coverage=1 00:06:34.805 --rc genhtml_legend=1 00:06:34.805 --rc geninfo_all_blocks=1 00:06:34.805 --rc geninfo_unexecuted_blocks=1 00:06:34.805 00:06:34.806 ' 00:06:34.806 00:59:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:34.806 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.806 --rc genhtml_branch_coverage=1 00:06:34.806 --rc genhtml_function_coverage=1 00:06:34.806 --rc genhtml_legend=1 00:06:34.806 --rc geninfo_all_blocks=1 00:06:34.806 --rc geninfo_unexecuted_blocks=1 00:06:34.806 00:06:34.806 ' 00:06:34.806 00:59:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:34.806 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:34.806 --rc genhtml_branch_coverage=1 00:06:34.806 --rc genhtml_function_coverage=1 00:06:34.806 --rc genhtml_legend=1 00:06:34.806 --rc geninfo_all_blocks=1 00:06:34.806 --rc geninfo_unexecuted_blocks=1 00:06:34.806 00:06:34.806 ' 00:06:34.806 00:59:25 -- app/version.sh@17 -- # get_header_version major 00:06:34.806 00:59:25 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:34.806 00:59:25 -- app/version.sh@14 -- # cut -f2 00:06:34.806 00:59:25 -- app/version.sh@14 -- # tr -d '"' 00:06:34.806 00:59:25 -- app/version.sh@17 -- # major=24 00:06:34.806 00:59:25 -- app/version.sh@18 -- # get_header_version minor 00:06:34.806 00:59:25 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:34.806 00:59:25 -- app/version.sh@14 -- # cut -f2 00:06:34.806 00:59:25 -- app/version.sh@14 -- # tr -d '"' 00:06:34.806 00:59:25 -- app/version.sh@18 -- # minor=1 00:06:34.806 00:59:25 -- app/version.sh@19 -- # get_header_version patch 00:06:34.806 00:59:25 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:34.806 00:59:25 -- app/version.sh@14 -- # cut -f2 00:06:34.806 00:59:25 -- app/version.sh@14 -- # tr -d '"' 00:06:34.806 00:59:25 -- app/version.sh@19 -- # patch=1 00:06:34.806 00:59:25 -- app/version.sh@20 -- # get_header_version suffix 00:06:34.806 00:59:25 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:35.065 00:59:25 -- app/version.sh@14 -- # cut -f2 00:06:35.065 00:59:25 -- app/version.sh@14 -- # tr -d '"' 00:06:35.065 00:59:25 -- app/version.sh@20 -- # suffix=-pre 00:06:35.065 00:59:25 -- app/version.sh@22 -- # version=24.1 00:06:35.065 00:59:25 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:35.065 00:59:25 -- app/version.sh@25 -- # version=24.1.1 00:06:35.065 00:59:25 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:35.065 00:59:25 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:35.065 00:59:25 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:35.065 00:59:25 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:35.065 00:59:25 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:35.065 00:06:35.065 real 0m0.195s 00:06:35.065 user 0m0.135s 00:06:35.065 sys 0m0.085s 00:06:35.065 00:59:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.065 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:35.065 ************************************ 00:06:35.065 END TEST version 00:06:35.065 ************************************ 00:06:35.065 00:59:25 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@191 -- # uname -s 00:06:35.065 00:59:25 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:35.065 00:59:25 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:35.065 00:59:25 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:35.065 00:59:25 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:35.065 00:59:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:35.065 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:35.065 00:59:25 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:35.065 00:59:25 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:35.065 00:59:25 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:35.065 00:59:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:35.065 00:59:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.065 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:35.065 ************************************ 00:06:35.065 START TEST nvmf_tcp 00:06:35.065 ************************************ 00:06:35.065 00:59:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:35.065 * Looking for test storage... 00:06:35.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:35.065 00:59:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:35.065 00:59:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:35.065 00:59:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:35.065 00:59:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:35.065 00:59:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:35.065 00:59:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:35.066 00:59:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:35.066 00:59:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:35.066 00:59:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:35.066 00:59:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:35.066 00:59:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:35.066 00:59:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:35.066 00:59:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:35.066 00:59:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:35.066 00:59:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:35.066 00:59:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:35.066 00:59:25 -- scripts/common.sh@344 -- # : 1 00:06:35.066 00:59:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:35.066 00:59:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:35.066 00:59:25 -- scripts/common.sh@364 -- # decimal 1 00:06:35.066 00:59:25 -- scripts/common.sh@352 -- # local d=1 00:06:35.066 00:59:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:35.066 00:59:25 -- scripts/common.sh@354 -- # echo 1 00:06:35.066 00:59:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:35.066 00:59:25 -- scripts/common.sh@365 -- # decimal 2 00:06:35.066 00:59:25 -- scripts/common.sh@352 -- # local d=2 00:06:35.066 00:59:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:35.066 00:59:25 -- scripts/common.sh@354 -- # echo 2 00:06:35.066 00:59:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:35.066 00:59:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:35.066 00:59:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:35.066 00:59:25 -- scripts/common.sh@367 -- # return 0 00:06:35.066 00:59:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:35.066 00:59:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:35.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.066 --rc genhtml_branch_coverage=1 00:06:35.066 --rc genhtml_function_coverage=1 00:06:35.066 --rc genhtml_legend=1 00:06:35.066 --rc geninfo_all_blocks=1 00:06:35.066 --rc geninfo_unexecuted_blocks=1 00:06:35.066 00:06:35.066 ' 00:06:35.066 00:59:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:35.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.066 --rc genhtml_branch_coverage=1 00:06:35.066 --rc genhtml_function_coverage=1 00:06:35.066 --rc genhtml_legend=1 00:06:35.066 --rc geninfo_all_blocks=1 00:06:35.066 --rc geninfo_unexecuted_blocks=1 00:06:35.066 00:06:35.066 ' 00:06:35.066 00:59:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:35.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.066 --rc genhtml_branch_coverage=1 00:06:35.066 --rc genhtml_function_coverage=1 00:06:35.066 --rc genhtml_legend=1 00:06:35.066 --rc geninfo_all_blocks=1 00:06:35.066 --rc geninfo_unexecuted_blocks=1 00:06:35.066 00:06:35.066 ' 00:06:35.066 00:59:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:35.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.066 --rc genhtml_branch_coverage=1 00:06:35.066 --rc genhtml_function_coverage=1 00:06:35.066 --rc genhtml_legend=1 00:06:35.066 --rc geninfo_all_blocks=1 00:06:35.066 --rc geninfo_unexecuted_blocks=1 00:06:35.066 00:06:35.066 ' 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:35.066 00:59:25 -- nvmf/common.sh@7 -- # uname -s 00:06:35.066 00:59:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:35.066 00:59:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:35.066 00:59:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:35.066 00:59:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:35.066 00:59:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:35.066 00:59:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:35.066 00:59:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:35.066 00:59:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:35.066 00:59:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:35.066 00:59:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:35.066 00:59:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:35.066 00:59:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:35.066 00:59:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:35.066 00:59:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:35.066 00:59:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:35.066 00:59:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:35.066 00:59:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:35.066 00:59:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:35.066 00:59:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:35.066 00:59:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.066 00:59:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.066 00:59:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.066 00:59:25 -- paths/export.sh@5 -- # export PATH 00:06:35.066 00:59:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.066 00:59:25 -- nvmf/common.sh@46 -- # : 0 00:06:35.066 00:59:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:35.066 00:59:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:35.066 00:59:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:35.066 00:59:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:35.066 00:59:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:35.066 00:59:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:35.066 00:59:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:35.066 00:59:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:35.066 00:59:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:35.066 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:35.066 00:59:25 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:35.066 00:59:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:35.066 00:59:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.066 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:35.066 ************************************ 00:06:35.066 START TEST nvmf_example 00:06:35.066 ************************************ 00:06:35.066 00:59:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:35.326 * Looking for test storage... 00:06:35.326 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:35.326 00:59:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:35.326 00:59:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:35.326 00:59:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:35.326 00:59:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:35.326 00:59:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:35.326 00:59:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:35.326 00:59:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:35.326 00:59:25 -- scripts/common.sh@335 -- # IFS=.-: 00:06:35.326 00:59:25 -- scripts/common.sh@335 -- # read -ra ver1 00:06:35.326 00:59:25 -- scripts/common.sh@336 -- # IFS=.-: 00:06:35.326 00:59:25 -- scripts/common.sh@336 -- # read -ra ver2 00:06:35.326 00:59:25 -- scripts/common.sh@337 -- # local 'op=<' 00:06:35.326 00:59:25 -- scripts/common.sh@339 -- # ver1_l=2 00:06:35.326 00:59:25 -- scripts/common.sh@340 -- # ver2_l=1 00:06:35.326 00:59:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:35.326 00:59:25 -- scripts/common.sh@343 -- # case "$op" in 00:06:35.326 00:59:25 -- scripts/common.sh@344 -- # : 1 00:06:35.326 00:59:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:35.326 00:59:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:35.326 00:59:25 -- scripts/common.sh@364 -- # decimal 1 00:06:35.326 00:59:25 -- scripts/common.sh@352 -- # local d=1 00:06:35.326 00:59:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:35.326 00:59:25 -- scripts/common.sh@354 -- # echo 1 00:06:35.326 00:59:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:35.326 00:59:25 -- scripts/common.sh@365 -- # decimal 2 00:06:35.326 00:59:25 -- scripts/common.sh@352 -- # local d=2 00:06:35.326 00:59:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:35.326 00:59:25 -- scripts/common.sh@354 -- # echo 2 00:06:35.326 00:59:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:35.326 00:59:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:35.326 00:59:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:35.326 00:59:25 -- scripts/common.sh@367 -- # return 0 00:06:35.326 00:59:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:35.326 00:59:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:35.326 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.326 --rc genhtml_branch_coverage=1 00:06:35.326 --rc genhtml_function_coverage=1 00:06:35.326 --rc genhtml_legend=1 00:06:35.326 --rc geninfo_all_blocks=1 00:06:35.326 --rc geninfo_unexecuted_blocks=1 00:06:35.326 00:06:35.326 ' 00:06:35.326 00:59:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:35.326 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.326 --rc genhtml_branch_coverage=1 00:06:35.326 --rc genhtml_function_coverage=1 00:06:35.326 --rc genhtml_legend=1 00:06:35.326 --rc geninfo_all_blocks=1 00:06:35.326 --rc geninfo_unexecuted_blocks=1 00:06:35.326 00:06:35.326 ' 00:06:35.326 00:59:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:35.326 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.326 --rc genhtml_branch_coverage=1 00:06:35.326 --rc genhtml_function_coverage=1 00:06:35.326 --rc genhtml_legend=1 00:06:35.326 --rc geninfo_all_blocks=1 00:06:35.326 --rc geninfo_unexecuted_blocks=1 00:06:35.326 00:06:35.326 ' 00:06:35.326 00:59:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:35.326 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:35.326 --rc genhtml_branch_coverage=1 00:06:35.326 --rc genhtml_function_coverage=1 00:06:35.326 --rc genhtml_legend=1 00:06:35.326 --rc geninfo_all_blocks=1 00:06:35.326 --rc geninfo_unexecuted_blocks=1 00:06:35.326 00:06:35.326 ' 00:06:35.326 00:59:25 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:35.326 00:59:25 -- nvmf/common.sh@7 -- # uname -s 00:06:35.326 00:59:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:35.326 00:59:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:35.326 00:59:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:35.326 00:59:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:35.326 00:59:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:35.326 00:59:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:35.326 00:59:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:35.326 00:59:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:35.326 00:59:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:35.326 00:59:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:35.326 00:59:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:35.326 00:59:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:35.326 00:59:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:35.326 00:59:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:35.326 00:59:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:35.326 00:59:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:35.326 00:59:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:35.326 00:59:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:35.326 00:59:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:35.326 00:59:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.326 00:59:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.326 00:59:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.326 00:59:25 -- paths/export.sh@5 -- # export PATH 00:06:35.326 00:59:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:35.326 00:59:25 -- nvmf/common.sh@46 -- # : 0 00:06:35.326 00:59:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:35.326 00:59:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:35.326 00:59:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:35.326 00:59:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:35.326 00:59:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:35.326 00:59:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:35.326 00:59:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:35.326 00:59:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:35.326 00:59:25 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:35.326 00:59:25 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:35.327 00:59:25 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:35.327 00:59:25 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:35.327 00:59:25 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:35.327 00:59:25 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:35.327 00:59:25 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:35.327 00:59:25 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:35.327 00:59:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:35.327 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:35.327 00:59:25 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:35.327 00:59:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:35.327 00:59:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:35.327 00:59:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:35.327 00:59:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:35.327 00:59:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:35.327 00:59:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:35.327 00:59:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:35.327 00:59:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:35.327 00:59:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:35.327 00:59:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:35.327 00:59:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:35.327 00:59:25 -- common/autotest_common.sh@10 -- # set +x 00:06:37.864 00:59:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:37.864 00:59:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:37.864 00:59:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:37.864 00:59:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:37.864 00:59:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:37.864 00:59:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:37.864 00:59:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:37.864 00:59:27 -- nvmf/common.sh@294 -- # net_devs=() 00:06:37.864 00:59:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:37.864 00:59:27 -- nvmf/common.sh@295 -- # e810=() 00:06:37.864 00:59:27 -- nvmf/common.sh@295 -- # local -ga e810 00:06:37.864 00:59:27 -- nvmf/common.sh@296 -- # x722=() 00:06:37.864 00:59:27 -- nvmf/common.sh@296 -- # local -ga x722 00:06:37.864 00:59:27 -- nvmf/common.sh@297 -- # mlx=() 00:06:37.864 00:59:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:37.864 00:59:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:37.864 00:59:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:37.865 00:59:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:37.865 00:59:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:37.865 00:59:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:37.865 00:59:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:37.865 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:37.865 00:59:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:37.865 00:59:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:37.865 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:37.865 00:59:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:37.865 00:59:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:37.865 00:59:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:37.865 00:59:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:37.865 00:59:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:37.865 00:59:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:37.865 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:37.865 00:59:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:37.865 00:59:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:37.865 00:59:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:37.865 00:59:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:37.865 00:59:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:37.865 00:59:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:37.865 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:37.865 00:59:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:37.865 00:59:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:37.865 00:59:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:37.865 00:59:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:37.865 00:59:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:37.865 00:59:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:37.865 00:59:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:37.865 00:59:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:37.865 00:59:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:37.865 00:59:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:37.865 00:59:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:37.865 00:59:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:37.865 00:59:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:37.865 00:59:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:37.865 00:59:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:37.865 00:59:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:37.865 00:59:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:37.865 00:59:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:37.865 00:59:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:37.865 00:59:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:37.865 00:59:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:37.865 00:59:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:37.865 00:59:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:37.865 00:59:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:37.865 00:59:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:37.865 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:37.865 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:06:37.865 00:06:37.865 --- 10.0.0.2 ping statistics --- 00:06:37.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:37.865 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:06:37.865 00:59:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:37.865 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:37.865 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.171 ms 00:06:37.865 00:06:37.865 --- 10.0.0.1 ping statistics --- 00:06:37.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:37.865 rtt min/avg/max/mdev = 0.171/0.171/0.171/0.000 ms 00:06:37.865 00:59:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:37.865 00:59:28 -- nvmf/common.sh@410 -- # return 0 00:06:37.865 00:59:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:37.865 00:59:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:37.865 00:59:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:37.865 00:59:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:37.865 00:59:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:37.865 00:59:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:37.865 00:59:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:37.865 00:59:28 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:37.865 00:59:28 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:37.865 00:59:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:37.865 00:59:28 -- common/autotest_common.sh@10 -- # set +x 00:06:37.865 00:59:28 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:37.865 00:59:28 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:37.865 00:59:28 -- target/nvmf_example.sh@34 -- # nvmfpid=946216 00:06:37.865 00:59:28 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:37.865 00:59:28 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:37.865 00:59:28 -- target/nvmf_example.sh@36 -- # waitforlisten 946216 00:06:37.865 00:59:28 -- common/autotest_common.sh@829 -- # '[' -z 946216 ']' 00:06:37.865 00:59:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.865 00:59:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.865 00:59:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.865 00:59:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.865 00:59:28 -- common/autotest_common.sh@10 -- # set +x 00:06:37.865 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.799 00:59:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.799 00:59:29 -- common/autotest_common.sh@862 -- # return 0 00:06:38.799 00:59:29 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:38.799 00:59:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:38.799 00:59:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.799 00:59:29 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:38.799 00:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.799 00:59:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.799 00:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.799 00:59:29 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:38.799 00:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.799 00:59:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.799 00:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.799 00:59:29 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:38.799 00:59:29 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:38.799 00:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.799 00:59:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.799 00:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.799 00:59:29 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:38.799 00:59:29 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:38.799 00:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.799 00:59:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.799 00:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.799 00:59:29 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:38.799 00:59:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.799 00:59:29 -- common/autotest_common.sh@10 -- # set +x 00:06:38.799 00:59:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.799 00:59:29 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:38.799 00:59:29 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:38.799 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.998 Initializing NVMe Controllers 00:06:50.998 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:50.998 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:50.998 Initialization complete. Launching workers. 00:06:50.998 ======================================================== 00:06:50.998 Latency(us) 00:06:50.998 Device Information : IOPS MiB/s Average min max 00:06:50.998 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15366.90 60.03 4165.16 861.05 20210.47 00:06:50.998 ======================================================== 00:06:50.998 Total : 15366.90 60.03 4165.16 861.05 20210.47 00:06:50.998 00:06:50.998 00:59:39 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:50.998 00:59:39 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:50.998 00:59:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:50.998 00:59:39 -- nvmf/common.sh@116 -- # sync 00:06:50.998 00:59:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:50.998 00:59:39 -- nvmf/common.sh@119 -- # set +e 00:06:50.998 00:59:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:50.998 00:59:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:50.998 rmmod nvme_tcp 00:06:50.998 rmmod nvme_fabrics 00:06:50.998 rmmod nvme_keyring 00:06:50.998 00:59:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:50.998 00:59:39 -- nvmf/common.sh@123 -- # set -e 00:06:50.998 00:59:39 -- nvmf/common.sh@124 -- # return 0 00:06:50.998 00:59:39 -- nvmf/common.sh@477 -- # '[' -n 946216 ']' 00:06:50.998 00:59:39 -- nvmf/common.sh@478 -- # killprocess 946216 00:06:50.998 00:59:39 -- common/autotest_common.sh@936 -- # '[' -z 946216 ']' 00:06:50.998 00:59:39 -- common/autotest_common.sh@940 -- # kill -0 946216 00:06:50.998 00:59:39 -- common/autotest_common.sh@941 -- # uname 00:06:50.998 00:59:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:50.998 00:59:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 946216 00:06:50.998 00:59:39 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:50.998 00:59:39 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:50.998 00:59:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 946216' 00:06:50.998 killing process with pid 946216 00:06:50.998 00:59:39 -- common/autotest_common.sh@955 -- # kill 946216 00:06:50.998 00:59:39 -- common/autotest_common.sh@960 -- # wait 946216 00:06:50.998 nvmf threads initialize successfully 00:06:50.998 bdev subsystem init successfully 00:06:50.998 created a nvmf target service 00:06:50.998 create targets's poll groups done 00:06:50.998 all subsystems of target started 00:06:50.998 nvmf target is running 00:06:50.998 all subsystems of target stopped 00:06:50.998 destroy targets's poll groups done 00:06:50.998 destroyed the nvmf target service 00:06:50.998 bdev subsystem finish successfully 00:06:50.998 nvmf threads destroy successfully 00:06:50.998 00:59:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:50.998 00:59:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:50.998 00:59:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:50.998 00:59:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:50.998 00:59:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:50.998 00:59:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:50.998 00:59:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:50.998 00:59:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:51.566 00:59:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:51.566 00:59:41 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:51.566 00:59:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:51.566 00:59:41 -- common/autotest_common.sh@10 -- # set +x 00:06:51.566 00:06:51.566 real 0m16.321s 00:06:51.566 user 0m45.722s 00:06:51.566 sys 0m3.262s 00:06:51.566 00:59:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.566 00:59:41 -- common/autotest_common.sh@10 -- # set +x 00:06:51.566 ************************************ 00:06:51.566 END TEST nvmf_example 00:06:51.566 ************************************ 00:06:51.566 00:59:41 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:51.566 00:59:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:51.566 00:59:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.566 00:59:41 -- common/autotest_common.sh@10 -- # set +x 00:06:51.566 ************************************ 00:06:51.566 START TEST nvmf_filesystem 00:06:51.566 ************************************ 00:06:51.566 00:59:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:51.566 * Looking for test storage... 00:06:51.566 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:51.566 00:59:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:51.566 00:59:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:51.566 00:59:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:51.566 00:59:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:51.566 00:59:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:51.566 00:59:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:51.566 00:59:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:51.566 00:59:42 -- scripts/common.sh@335 -- # IFS=.-: 00:06:51.566 00:59:42 -- scripts/common.sh@335 -- # read -ra ver1 00:06:51.566 00:59:42 -- scripts/common.sh@336 -- # IFS=.-: 00:06:51.566 00:59:42 -- scripts/common.sh@336 -- # read -ra ver2 00:06:51.566 00:59:42 -- scripts/common.sh@337 -- # local 'op=<' 00:06:51.566 00:59:42 -- scripts/common.sh@339 -- # ver1_l=2 00:06:51.566 00:59:42 -- scripts/common.sh@340 -- # ver2_l=1 00:06:51.566 00:59:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:51.566 00:59:42 -- scripts/common.sh@343 -- # case "$op" in 00:06:51.566 00:59:42 -- scripts/common.sh@344 -- # : 1 00:06:51.566 00:59:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:51.566 00:59:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:51.566 00:59:42 -- scripts/common.sh@364 -- # decimal 1 00:06:51.566 00:59:42 -- scripts/common.sh@352 -- # local d=1 00:06:51.566 00:59:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:51.566 00:59:42 -- scripts/common.sh@354 -- # echo 1 00:06:51.566 00:59:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:51.566 00:59:42 -- scripts/common.sh@365 -- # decimal 2 00:06:51.566 00:59:42 -- scripts/common.sh@352 -- # local d=2 00:06:51.566 00:59:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:51.566 00:59:42 -- scripts/common.sh@354 -- # echo 2 00:06:51.566 00:59:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:51.566 00:59:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:51.566 00:59:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:51.566 00:59:42 -- scripts/common.sh@367 -- # return 0 00:06:51.566 00:59:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:51.566 00:59:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:51.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.566 --rc genhtml_branch_coverage=1 00:06:51.566 --rc genhtml_function_coverage=1 00:06:51.566 --rc genhtml_legend=1 00:06:51.566 --rc geninfo_all_blocks=1 00:06:51.566 --rc geninfo_unexecuted_blocks=1 00:06:51.566 00:06:51.566 ' 00:06:51.566 00:59:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:51.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.566 --rc genhtml_branch_coverage=1 00:06:51.566 --rc genhtml_function_coverage=1 00:06:51.566 --rc genhtml_legend=1 00:06:51.566 --rc geninfo_all_blocks=1 00:06:51.566 --rc geninfo_unexecuted_blocks=1 00:06:51.566 00:06:51.566 ' 00:06:51.566 00:59:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:51.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.566 --rc genhtml_branch_coverage=1 00:06:51.566 --rc genhtml_function_coverage=1 00:06:51.566 --rc genhtml_legend=1 00:06:51.566 --rc geninfo_all_blocks=1 00:06:51.566 --rc geninfo_unexecuted_blocks=1 00:06:51.566 00:06:51.566 ' 00:06:51.566 00:59:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:51.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.566 --rc genhtml_branch_coverage=1 00:06:51.566 --rc genhtml_function_coverage=1 00:06:51.566 --rc genhtml_legend=1 00:06:51.566 --rc geninfo_all_blocks=1 00:06:51.566 --rc geninfo_unexecuted_blocks=1 00:06:51.566 00:06:51.566 ' 00:06:51.566 00:59:42 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:51.566 00:59:42 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:51.566 00:59:42 -- common/autotest_common.sh@34 -- # set -e 00:06:51.566 00:59:42 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:51.566 00:59:42 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:51.567 00:59:42 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:51.567 00:59:42 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:51.567 00:59:42 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:51.567 00:59:42 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:51.567 00:59:42 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:51.567 00:59:42 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:51.567 00:59:42 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:51.567 00:59:42 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:51.567 00:59:42 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:51.567 00:59:42 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:51.567 00:59:42 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:51.567 00:59:42 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:51.567 00:59:42 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:51.567 00:59:42 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:51.567 00:59:42 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:51.567 00:59:42 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:51.567 00:59:42 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:51.567 00:59:42 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:51.567 00:59:42 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:51.567 00:59:42 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:51.567 00:59:42 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:51.567 00:59:42 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:51.567 00:59:42 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:51.567 00:59:42 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:51.567 00:59:42 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:51.567 00:59:42 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:51.567 00:59:42 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:51.567 00:59:42 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:51.567 00:59:42 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:51.567 00:59:42 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:51.567 00:59:42 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:51.567 00:59:42 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:51.567 00:59:42 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:51.567 00:59:42 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:51.567 00:59:42 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:51.567 00:59:42 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:51.567 00:59:42 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:51.567 00:59:42 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:51.567 00:59:42 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:51.567 00:59:42 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:51.567 00:59:42 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:51.567 00:59:42 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:51.567 00:59:42 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:51.567 00:59:42 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:51.567 00:59:42 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:51.567 00:59:42 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:51.567 00:59:42 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:51.567 00:59:42 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:51.567 00:59:42 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:51.567 00:59:42 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:51.567 00:59:42 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:51.567 00:59:42 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:51.567 00:59:42 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:51.567 00:59:42 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:51.567 00:59:42 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:51.567 00:59:42 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:51.567 00:59:42 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:51.567 00:59:42 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:51.567 00:59:42 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:51.567 00:59:42 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:51.567 00:59:42 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:51.567 00:59:42 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:51.567 00:59:42 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:51.567 00:59:42 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:51.567 00:59:42 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:51.567 00:59:42 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:51.567 00:59:42 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:51.567 00:59:42 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:51.567 00:59:42 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:51.567 00:59:42 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:51.567 00:59:42 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:51.567 00:59:42 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:51.567 00:59:42 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:51.567 00:59:42 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:51.567 00:59:42 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:51.567 00:59:42 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:51.567 00:59:42 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:51.567 00:59:42 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:51.567 00:59:42 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:51.567 00:59:42 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:51.567 00:59:42 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:51.567 00:59:42 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:51.567 00:59:42 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:51.567 00:59:42 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:51.567 00:59:42 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:51.567 00:59:42 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:51.567 00:59:42 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:51.567 00:59:42 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:51.567 00:59:42 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:51.567 00:59:42 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:51.567 00:59:42 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:51.567 #define SPDK_CONFIG_H 00:06:51.567 #define SPDK_CONFIG_APPS 1 00:06:51.567 #define SPDK_CONFIG_ARCH native 00:06:51.567 #undef SPDK_CONFIG_ASAN 00:06:51.567 #undef SPDK_CONFIG_AVAHI 00:06:51.567 #undef SPDK_CONFIG_CET 00:06:51.567 #define SPDK_CONFIG_COVERAGE 1 00:06:51.567 #define SPDK_CONFIG_CROSS_PREFIX 00:06:51.567 #undef SPDK_CONFIG_CRYPTO 00:06:51.567 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:51.567 #undef SPDK_CONFIG_CUSTOMOCF 00:06:51.567 #undef SPDK_CONFIG_DAOS 00:06:51.567 #define SPDK_CONFIG_DAOS_DIR 00:06:51.567 #define SPDK_CONFIG_DEBUG 1 00:06:51.567 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:51.567 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:51.567 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:51.567 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:51.567 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:51.567 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:51.567 #define SPDK_CONFIG_EXAMPLES 1 00:06:51.567 #undef SPDK_CONFIG_FC 00:06:51.567 #define SPDK_CONFIG_FC_PATH 00:06:51.567 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:51.567 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:51.567 #undef SPDK_CONFIG_FUSE 00:06:51.567 #undef SPDK_CONFIG_FUZZER 00:06:51.567 #define SPDK_CONFIG_FUZZER_LIB 00:06:51.567 #undef SPDK_CONFIG_GOLANG 00:06:51.567 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:51.567 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:51.567 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:51.567 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:51.567 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:51.567 #define SPDK_CONFIG_IDXD 1 00:06:51.567 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:51.567 #undef SPDK_CONFIG_IPSEC_MB 00:06:51.567 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:51.567 #define SPDK_CONFIG_ISAL 1 00:06:51.567 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:51.567 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:51.567 #define SPDK_CONFIG_LIBDIR 00:06:51.567 #undef SPDK_CONFIG_LTO 00:06:51.567 #define SPDK_CONFIG_MAX_LCORES 00:06:51.567 #define SPDK_CONFIG_NVME_CUSE 1 00:06:51.567 #undef SPDK_CONFIG_OCF 00:06:51.567 #define SPDK_CONFIG_OCF_PATH 00:06:51.567 #define SPDK_CONFIG_OPENSSL_PATH 00:06:51.567 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:51.567 #undef SPDK_CONFIG_PGO_USE 00:06:51.567 #define SPDK_CONFIG_PREFIX /usr/local 00:06:51.567 #undef SPDK_CONFIG_RAID5F 00:06:51.567 #undef SPDK_CONFIG_RBD 00:06:51.567 #define SPDK_CONFIG_RDMA 1 00:06:51.567 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:51.567 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:51.567 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:51.567 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:51.567 #define SPDK_CONFIG_SHARED 1 00:06:51.567 #undef SPDK_CONFIG_SMA 00:06:51.567 #define SPDK_CONFIG_TESTS 1 00:06:51.567 #undef SPDK_CONFIG_TSAN 00:06:51.567 #define SPDK_CONFIG_UBLK 1 00:06:51.567 #define SPDK_CONFIG_UBSAN 1 00:06:51.567 #undef SPDK_CONFIG_UNIT_TESTS 00:06:51.567 #undef SPDK_CONFIG_URING 00:06:51.567 #define SPDK_CONFIG_URING_PATH 00:06:51.567 #undef SPDK_CONFIG_URING_ZNS 00:06:51.567 #undef SPDK_CONFIG_USDT 00:06:51.567 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:51.568 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:51.568 #undef SPDK_CONFIG_VFIO_USER 00:06:51.568 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:51.568 #define SPDK_CONFIG_VHOST 1 00:06:51.568 #define SPDK_CONFIG_VIRTIO 1 00:06:51.568 #undef SPDK_CONFIG_VTUNE 00:06:51.568 #define SPDK_CONFIG_VTUNE_DIR 00:06:51.568 #define SPDK_CONFIG_WERROR 1 00:06:51.568 #define SPDK_CONFIG_WPDK_DIR 00:06:51.568 #undef SPDK_CONFIG_XNVME 00:06:51.568 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:51.568 00:59:42 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:51.568 00:59:42 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:51.568 00:59:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:51.568 00:59:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:51.568 00:59:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:51.568 00:59:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.568 00:59:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.568 00:59:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.568 00:59:42 -- paths/export.sh@5 -- # export PATH 00:06:51.568 00:59:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.568 00:59:42 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:51.568 00:59:42 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:51.828 00:59:42 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:51.828 00:59:42 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:51.828 00:59:42 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:51.828 00:59:42 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:51.828 00:59:42 -- pm/common@16 -- # TEST_TAG=N/A 00:06:51.828 00:59:42 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:51.828 00:59:42 -- common/autotest_common.sh@52 -- # : 1 00:06:51.828 00:59:42 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:51.828 00:59:42 -- common/autotest_common.sh@56 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:51.828 00:59:42 -- common/autotest_common.sh@58 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:51.828 00:59:42 -- common/autotest_common.sh@60 -- # : 1 00:06:51.828 00:59:42 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:51.828 00:59:42 -- common/autotest_common.sh@62 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:51.828 00:59:42 -- common/autotest_common.sh@64 -- # : 00:06:51.828 00:59:42 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:51.828 00:59:42 -- common/autotest_common.sh@66 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:51.828 00:59:42 -- common/autotest_common.sh@68 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:51.828 00:59:42 -- common/autotest_common.sh@70 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:51.828 00:59:42 -- common/autotest_common.sh@72 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:51.828 00:59:42 -- common/autotest_common.sh@74 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:51.828 00:59:42 -- common/autotest_common.sh@76 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:51.828 00:59:42 -- common/autotest_common.sh@78 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:51.828 00:59:42 -- common/autotest_common.sh@80 -- # : 1 00:06:51.828 00:59:42 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:51.828 00:59:42 -- common/autotest_common.sh@82 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:51.828 00:59:42 -- common/autotest_common.sh@84 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:51.828 00:59:42 -- common/autotest_common.sh@86 -- # : 1 00:06:51.828 00:59:42 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:51.828 00:59:42 -- common/autotest_common.sh@88 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:51.828 00:59:42 -- common/autotest_common.sh@90 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:51.828 00:59:42 -- common/autotest_common.sh@92 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:51.828 00:59:42 -- common/autotest_common.sh@94 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:51.828 00:59:42 -- common/autotest_common.sh@96 -- # : tcp 00:06:51.828 00:59:42 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:51.828 00:59:42 -- common/autotest_common.sh@98 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:51.828 00:59:42 -- common/autotest_common.sh@100 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:51.828 00:59:42 -- common/autotest_common.sh@102 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:51.828 00:59:42 -- common/autotest_common.sh@104 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:51.828 00:59:42 -- common/autotest_common.sh@106 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:51.828 00:59:42 -- common/autotest_common.sh@108 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:51.828 00:59:42 -- common/autotest_common.sh@110 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:51.828 00:59:42 -- common/autotest_common.sh@112 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:51.828 00:59:42 -- common/autotest_common.sh@114 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:51.828 00:59:42 -- common/autotest_common.sh@116 -- # : 1 00:06:51.828 00:59:42 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:51.828 00:59:42 -- common/autotest_common.sh@118 -- # : 00:06:51.828 00:59:42 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:51.828 00:59:42 -- common/autotest_common.sh@120 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:51.828 00:59:42 -- common/autotest_common.sh@122 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:51.828 00:59:42 -- common/autotest_common.sh@124 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:51.828 00:59:42 -- common/autotest_common.sh@126 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:51.828 00:59:42 -- common/autotest_common.sh@128 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:51.828 00:59:42 -- common/autotest_common.sh@130 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:51.828 00:59:42 -- common/autotest_common.sh@132 -- # : 00:06:51.828 00:59:42 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:51.828 00:59:42 -- common/autotest_common.sh@134 -- # : true 00:06:51.828 00:59:42 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:51.828 00:59:42 -- common/autotest_common.sh@136 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:51.828 00:59:42 -- common/autotest_common.sh@138 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:51.828 00:59:42 -- common/autotest_common.sh@140 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:51.828 00:59:42 -- common/autotest_common.sh@142 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:51.828 00:59:42 -- common/autotest_common.sh@144 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:51.828 00:59:42 -- common/autotest_common.sh@146 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:51.828 00:59:42 -- common/autotest_common.sh@148 -- # : e810 00:06:51.828 00:59:42 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:51.828 00:59:42 -- common/autotest_common.sh@150 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:51.828 00:59:42 -- common/autotest_common.sh@152 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:51.828 00:59:42 -- common/autotest_common.sh@154 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:51.828 00:59:42 -- common/autotest_common.sh@156 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:51.828 00:59:42 -- common/autotest_common.sh@158 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:51.828 00:59:42 -- common/autotest_common.sh@160 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:51.828 00:59:42 -- common/autotest_common.sh@163 -- # : 00:06:51.828 00:59:42 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:51.828 00:59:42 -- common/autotest_common.sh@165 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:51.828 00:59:42 -- common/autotest_common.sh@167 -- # : 0 00:06:51.828 00:59:42 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:51.828 00:59:42 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:51.828 00:59:42 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:51.828 00:59:42 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:51.829 00:59:42 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:51.829 00:59:42 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:51.829 00:59:42 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:51.829 00:59:42 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:51.829 00:59:42 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:51.829 00:59:42 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:51.829 00:59:42 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:51.829 00:59:42 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:51.829 00:59:42 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:51.829 00:59:42 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:51.829 00:59:42 -- common/autotest_common.sh@196 -- # cat 00:06:51.829 00:59:42 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:51.829 00:59:42 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:51.829 00:59:42 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:51.829 00:59:42 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:51.829 00:59:42 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:51.829 00:59:42 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:51.829 00:59:42 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:51.829 00:59:42 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:51.829 00:59:42 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:51.829 00:59:42 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:51.829 00:59:42 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:51.829 00:59:42 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:51.829 00:59:42 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:51.829 00:59:42 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:51.829 00:59:42 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:51.829 00:59:42 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:51.829 00:59:42 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:51.829 00:59:42 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:51.829 00:59:42 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:51.829 00:59:42 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:51.829 00:59:42 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:51.829 00:59:42 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:51.829 00:59:42 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:51.829 00:59:42 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:51.829 00:59:42 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:51.829 00:59:42 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:51.829 00:59:42 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:51.829 00:59:42 -- common/autotest_common.sh@259 -- # valgrind= 00:06:51.829 00:59:42 -- common/autotest_common.sh@265 -- # uname -s 00:06:51.829 00:59:42 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:51.829 00:59:42 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:51.829 00:59:42 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:51.829 00:59:42 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:51.829 00:59:42 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:51.829 00:59:42 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:51.829 00:59:42 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:51.829 00:59:42 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:51.829 00:59:42 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:51.829 00:59:42 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:51.829 00:59:42 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:51.829 00:59:42 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:51.829 00:59:42 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:51.829 00:59:42 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:51.829 00:59:42 -- common/autotest_common.sh@319 -- # [[ -z 947970 ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@319 -- # kill -0 947970 00:06:51.829 00:59:42 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:51.829 00:59:42 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:51.829 00:59:42 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:51.829 00:59:42 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:51.829 00:59:42 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:51.829 00:59:42 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:51.829 00:59:42 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:51.829 00:59:42 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.ss2Pej 00:06:51.829 00:59:42 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:51.829 00:59:42 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:51.829 00:59:42 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.ss2Pej/tests/target /tmp/spdk.ss2Pej 00:06:51.829 00:59:42 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@328 -- # df -T 00:06:51.829 00:59:42 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=55384662016 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988515840 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=6603853824 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991663104 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994255872 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993342464 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=917504 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:51.829 00:59:42 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:51.829 00:59:42 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:51.829 00:59:42 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:51.829 00:59:42 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:51.829 * Looking for test storage... 00:06:51.829 00:59:42 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:51.829 00:59:42 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:51.829 00:59:42 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:51.829 00:59:42 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:51.830 00:59:42 -- common/autotest_common.sh@373 -- # mount=/ 00:06:51.830 00:59:42 -- common/autotest_common.sh@375 -- # target_space=55384662016 00:06:51.830 00:59:42 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:51.830 00:59:42 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:51.830 00:59:42 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:51.830 00:59:42 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:51.830 00:59:42 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:51.830 00:59:42 -- common/autotest_common.sh@382 -- # new_size=8818446336 00:06:51.830 00:59:42 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:51.830 00:59:42 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:51.830 00:59:42 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:51.830 00:59:42 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:51.830 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:51.830 00:59:42 -- common/autotest_common.sh@390 -- # return 0 00:06:51.830 00:59:42 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:51.830 00:59:42 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:51.830 00:59:42 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:51.830 00:59:42 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:51.830 00:59:42 -- common/autotest_common.sh@1682 -- # true 00:06:51.830 00:59:42 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:51.830 00:59:42 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:51.830 00:59:42 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:51.830 00:59:42 -- common/autotest_common.sh@27 -- # exec 00:06:51.830 00:59:42 -- common/autotest_common.sh@29 -- # exec 00:06:51.830 00:59:42 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:51.830 00:59:42 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:51.830 00:59:42 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:51.830 00:59:42 -- common/autotest_common.sh@18 -- # set -x 00:06:51.830 00:59:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:51.830 00:59:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:51.830 00:59:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:51.830 00:59:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:51.830 00:59:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:51.830 00:59:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:51.830 00:59:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:51.830 00:59:42 -- scripts/common.sh@335 -- # IFS=.-: 00:06:51.830 00:59:42 -- scripts/common.sh@335 -- # read -ra ver1 00:06:51.830 00:59:42 -- scripts/common.sh@336 -- # IFS=.-: 00:06:51.830 00:59:42 -- scripts/common.sh@336 -- # read -ra ver2 00:06:51.830 00:59:42 -- scripts/common.sh@337 -- # local 'op=<' 00:06:51.830 00:59:42 -- scripts/common.sh@339 -- # ver1_l=2 00:06:51.830 00:59:42 -- scripts/common.sh@340 -- # ver2_l=1 00:06:51.830 00:59:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:51.830 00:59:42 -- scripts/common.sh@343 -- # case "$op" in 00:06:51.830 00:59:42 -- scripts/common.sh@344 -- # : 1 00:06:51.830 00:59:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:51.830 00:59:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:51.830 00:59:42 -- scripts/common.sh@364 -- # decimal 1 00:06:51.830 00:59:42 -- scripts/common.sh@352 -- # local d=1 00:06:51.830 00:59:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:51.830 00:59:42 -- scripts/common.sh@354 -- # echo 1 00:06:51.830 00:59:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:51.830 00:59:42 -- scripts/common.sh@365 -- # decimal 2 00:06:51.830 00:59:42 -- scripts/common.sh@352 -- # local d=2 00:06:51.830 00:59:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:51.830 00:59:42 -- scripts/common.sh@354 -- # echo 2 00:06:51.830 00:59:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:51.830 00:59:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:51.830 00:59:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:51.830 00:59:42 -- scripts/common.sh@367 -- # return 0 00:06:51.830 00:59:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:51.830 00:59:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:51.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.830 --rc genhtml_branch_coverage=1 00:06:51.830 --rc genhtml_function_coverage=1 00:06:51.830 --rc genhtml_legend=1 00:06:51.830 --rc geninfo_all_blocks=1 00:06:51.830 --rc geninfo_unexecuted_blocks=1 00:06:51.830 00:06:51.830 ' 00:06:51.830 00:59:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:51.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.830 --rc genhtml_branch_coverage=1 00:06:51.830 --rc genhtml_function_coverage=1 00:06:51.830 --rc genhtml_legend=1 00:06:51.830 --rc geninfo_all_blocks=1 00:06:51.830 --rc geninfo_unexecuted_blocks=1 00:06:51.830 00:06:51.830 ' 00:06:51.830 00:59:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:51.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.830 --rc genhtml_branch_coverage=1 00:06:51.830 --rc genhtml_function_coverage=1 00:06:51.830 --rc genhtml_legend=1 00:06:51.830 --rc geninfo_all_blocks=1 00:06:51.830 --rc geninfo_unexecuted_blocks=1 00:06:51.830 00:06:51.830 ' 00:06:51.830 00:59:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:51.830 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.830 --rc genhtml_branch_coverage=1 00:06:51.830 --rc genhtml_function_coverage=1 00:06:51.830 --rc genhtml_legend=1 00:06:51.830 --rc geninfo_all_blocks=1 00:06:51.830 --rc geninfo_unexecuted_blocks=1 00:06:51.830 00:06:51.830 ' 00:06:51.830 00:59:42 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:51.830 00:59:42 -- nvmf/common.sh@7 -- # uname -s 00:06:51.830 00:59:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:51.830 00:59:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:51.830 00:59:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:51.830 00:59:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:51.830 00:59:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:51.830 00:59:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:51.830 00:59:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:51.830 00:59:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:51.830 00:59:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:51.830 00:59:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:51.830 00:59:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:51.830 00:59:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:51.830 00:59:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:51.830 00:59:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:51.830 00:59:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:51.830 00:59:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:51.830 00:59:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:51.830 00:59:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:51.830 00:59:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:51.830 00:59:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.830 00:59:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.830 00:59:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.830 00:59:42 -- paths/export.sh@5 -- # export PATH 00:06:51.830 00:59:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:51.830 00:59:42 -- nvmf/common.sh@46 -- # : 0 00:06:51.830 00:59:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:51.830 00:59:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:51.830 00:59:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:51.830 00:59:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:51.830 00:59:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:51.830 00:59:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:51.830 00:59:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:51.830 00:59:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:51.830 00:59:42 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:51.830 00:59:42 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:51.830 00:59:42 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:51.830 00:59:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:51.830 00:59:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:51.830 00:59:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:51.830 00:59:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:51.830 00:59:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:51.830 00:59:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:51.830 00:59:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:51.830 00:59:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:51.831 00:59:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:51.831 00:59:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:51.831 00:59:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:51.831 00:59:42 -- common/autotest_common.sh@10 -- # set +x 00:06:53.733 00:59:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:53.734 00:59:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:53.734 00:59:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:53.734 00:59:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:53.734 00:59:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:53.734 00:59:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:53.734 00:59:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:53.734 00:59:44 -- nvmf/common.sh@294 -- # net_devs=() 00:06:53.734 00:59:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:53.734 00:59:44 -- nvmf/common.sh@295 -- # e810=() 00:06:53.734 00:59:44 -- nvmf/common.sh@295 -- # local -ga e810 00:06:53.734 00:59:44 -- nvmf/common.sh@296 -- # x722=() 00:06:53.734 00:59:44 -- nvmf/common.sh@296 -- # local -ga x722 00:06:53.734 00:59:44 -- nvmf/common.sh@297 -- # mlx=() 00:06:53.734 00:59:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:53.734 00:59:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:53.734 00:59:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:53.734 00:59:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:53.734 00:59:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:53.734 00:59:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:53.734 00:59:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:53.734 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:53.734 00:59:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:53.734 00:59:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:53.734 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:53.734 00:59:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:53.734 00:59:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:53.734 00:59:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:53.734 00:59:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:53.734 00:59:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:53.734 00:59:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:53.734 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:53.734 00:59:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:53.734 00:59:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:53.734 00:59:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:53.734 00:59:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:53.734 00:59:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:53.734 00:59:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:53.734 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:53.734 00:59:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:53.734 00:59:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:53.734 00:59:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:53.734 00:59:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:53.734 00:59:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:53.734 00:59:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:53.734 00:59:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:53.734 00:59:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:53.734 00:59:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:53.734 00:59:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:53.734 00:59:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:53.734 00:59:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:53.734 00:59:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:53.734 00:59:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:53.734 00:59:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:53.734 00:59:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:53.734 00:59:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:53.734 00:59:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:53.993 00:59:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:53.993 00:59:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:53.993 00:59:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:53.993 00:59:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:53.993 00:59:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:53.993 00:59:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:53.993 00:59:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:53.993 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:53.993 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:06:53.993 00:06:53.993 --- 10.0.0.2 ping statistics --- 00:06:53.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:53.993 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:06:53.993 00:59:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:53.993 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:53.993 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:06:53.993 00:06:53.993 --- 10.0.0.1 ping statistics --- 00:06:53.993 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:53.993 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:06:53.993 00:59:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:53.993 00:59:44 -- nvmf/common.sh@410 -- # return 0 00:06:53.993 00:59:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:53.993 00:59:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:53.993 00:59:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:53.993 00:59:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:53.993 00:59:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:53.993 00:59:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:53.993 00:59:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:53.993 00:59:44 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:53.993 00:59:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:53.993 00:59:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.993 00:59:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.993 ************************************ 00:06:53.993 START TEST nvmf_filesystem_no_in_capsule 00:06:53.993 ************************************ 00:06:53.993 00:59:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:53.993 00:59:44 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:53.993 00:59:44 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:53.993 00:59:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:53.993 00:59:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:53.993 00:59:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.993 00:59:44 -- nvmf/common.sh@469 -- # nvmfpid=949736 00:06:53.993 00:59:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:53.993 00:59:44 -- nvmf/common.sh@470 -- # waitforlisten 949736 00:06:53.993 00:59:44 -- common/autotest_common.sh@829 -- # '[' -z 949736 ']' 00:06:53.993 00:59:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:53.993 00:59:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:53.993 00:59:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:53.993 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:53.993 00:59:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:53.993 00:59:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.993 [2024-11-26 00:59:44.446564] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.993 [2024-11-26 00:59:44.446628] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:53.993 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.993 [2024-11-26 00:59:44.511525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:54.253 [2024-11-26 00:59:44.625326] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:54.253 [2024-11-26 00:59:44.625490] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:54.253 [2024-11-26 00:59:44.625507] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:54.253 [2024-11-26 00:59:44.625520] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:54.253 [2024-11-26 00:59:44.625607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:54.253 [2024-11-26 00:59:44.625672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:54.253 [2024-11-26 00:59:44.625739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:54.253 [2024-11-26 00:59:44.625742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.186 00:59:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:55.186 00:59:45 -- common/autotest_common.sh@862 -- # return 0 00:06:55.186 00:59:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:06:55.186 00:59:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:55.186 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.186 00:59:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:55.186 00:59:45 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:06:55.186 00:59:45 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:06:55.186 00:59:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.186 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.186 [2024-11-26 00:59:45.439223] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:55.186 00:59:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.186 00:59:45 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:06:55.186 00:59:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.186 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.186 Malloc1 00:06:55.186 00:59:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.186 00:59:45 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:06:55.186 00:59:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.186 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.186 00:59:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.186 00:59:45 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:06:55.186 00:59:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.186 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.186 00:59:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.186 00:59:45 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:55.186 00:59:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.186 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.186 [2024-11-26 00:59:45.629212] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:06:55.186 00:59:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.186 00:59:45 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:06:55.186 00:59:45 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:06:55.186 00:59:45 -- common/autotest_common.sh@1368 -- # local bdev_info 00:06:55.186 00:59:45 -- common/autotest_common.sh@1369 -- # local bs 00:06:55.186 00:59:45 -- common/autotest_common.sh@1370 -- # local nb 00:06:55.186 00:59:45 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:06:55.186 00:59:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.187 00:59:45 -- common/autotest_common.sh@10 -- # set +x 00:06:55.187 00:59:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.187 00:59:45 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:06:55.187 { 00:06:55.187 "name": "Malloc1", 00:06:55.187 "aliases": [ 00:06:55.187 "f613df8a-db16-478b-88e2-3eac9b89e98e" 00:06:55.187 ], 00:06:55.187 "product_name": "Malloc disk", 00:06:55.187 "block_size": 512, 00:06:55.187 "num_blocks": 1048576, 00:06:55.187 "uuid": "f613df8a-db16-478b-88e2-3eac9b89e98e", 00:06:55.187 "assigned_rate_limits": { 00:06:55.187 "rw_ios_per_sec": 0, 00:06:55.187 "rw_mbytes_per_sec": 0, 00:06:55.187 "r_mbytes_per_sec": 0, 00:06:55.187 "w_mbytes_per_sec": 0 00:06:55.187 }, 00:06:55.187 "claimed": true, 00:06:55.187 "claim_type": "exclusive_write", 00:06:55.187 "zoned": false, 00:06:55.187 "supported_io_types": { 00:06:55.187 "read": true, 00:06:55.187 "write": true, 00:06:55.187 "unmap": true, 00:06:55.187 "write_zeroes": true, 00:06:55.187 "flush": true, 00:06:55.187 "reset": true, 00:06:55.187 "compare": false, 00:06:55.187 "compare_and_write": false, 00:06:55.187 "abort": true, 00:06:55.187 "nvme_admin": false, 00:06:55.187 "nvme_io": false 00:06:55.187 }, 00:06:55.187 "memory_domains": [ 00:06:55.187 { 00:06:55.187 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:06:55.187 "dma_device_type": 2 00:06:55.187 } 00:06:55.187 ], 00:06:55.187 "driver_specific": {} 00:06:55.187 } 00:06:55.187 ]' 00:06:55.187 00:59:45 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:06:55.187 00:59:45 -- common/autotest_common.sh@1372 -- # bs=512 00:06:55.187 00:59:45 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:06:55.444 00:59:45 -- common/autotest_common.sh@1373 -- # nb=1048576 00:06:55.444 00:59:45 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:06:55.444 00:59:45 -- common/autotest_common.sh@1377 -- # echo 512 00:06:55.444 00:59:45 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:06:55.444 00:59:45 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:06:56.010 00:59:46 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:06:56.010 00:59:46 -- common/autotest_common.sh@1187 -- # local i=0 00:06:56.010 00:59:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:06:56.010 00:59:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:06:56.010 00:59:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:06:57.910 00:59:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:06:57.910 00:59:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:06:57.910 00:59:48 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:06:57.910 00:59:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:06:57.910 00:59:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:06:57.910 00:59:48 -- common/autotest_common.sh@1197 -- # return 0 00:06:57.910 00:59:48 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:06:57.910 00:59:48 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:06:57.910 00:59:48 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:06:57.910 00:59:48 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:06:57.910 00:59:48 -- setup/common.sh@76 -- # local dev=nvme0n1 00:06:57.910 00:59:48 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:06:57.910 00:59:48 -- setup/common.sh@80 -- # echo 536870912 00:06:57.910 00:59:48 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:06:57.910 00:59:48 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:06:57.910 00:59:48 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:06:57.910 00:59:48 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:06:58.168 00:59:48 -- target/filesystem.sh@69 -- # partprobe 00:06:59.100 00:59:49 -- target/filesystem.sh@70 -- # sleep 1 00:07:00.473 00:59:50 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:00.473 00:59:50 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:00.473 00:59:50 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:00.473 00:59:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:00.473 00:59:50 -- common/autotest_common.sh@10 -- # set +x 00:07:00.473 ************************************ 00:07:00.473 START TEST filesystem_ext4 00:07:00.473 ************************************ 00:07:00.473 00:59:50 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:00.473 00:59:50 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:00.473 00:59:50 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:00.473 00:59:50 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:00.473 00:59:50 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:00.473 00:59:50 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:00.473 00:59:50 -- common/autotest_common.sh@914 -- # local i=0 00:07:00.473 00:59:50 -- common/autotest_common.sh@915 -- # local force 00:07:00.473 00:59:50 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:00.473 00:59:50 -- common/autotest_common.sh@918 -- # force=-F 00:07:00.473 00:59:50 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:00.473 mke2fs 1.47.0 (5-Feb-2023) 00:07:00.473 Discarding device blocks: 0/522240 done 00:07:00.473 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:00.473 Filesystem UUID: 1ccf0fdf-0807-49d0-a64b-572903e0c156 00:07:00.473 Superblock backups stored on blocks: 00:07:00.473 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:00.473 00:07:00.473 Allocating group tables: 0/64 done 00:07:00.473 Writing inode tables: 0/64 done 00:07:02.416 Creating journal (8192 blocks): done 00:07:02.416 Writing superblocks and filesystem accounting information: 0/64 done 00:07:02.416 00:07:02.416 00:59:52 -- common/autotest_common.sh@931 -- # return 0 00:07:02.416 00:59:52 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:08.967 00:59:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:08.967 00:59:58 -- target/filesystem.sh@25 -- # sync 00:07:08.967 00:59:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:08.967 00:59:58 -- target/filesystem.sh@27 -- # sync 00:07:08.967 00:59:58 -- target/filesystem.sh@29 -- # i=0 00:07:08.967 00:59:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:08.967 00:59:58 -- target/filesystem.sh@37 -- # kill -0 949736 00:07:08.967 00:59:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:08.967 00:59:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:08.967 00:59:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:08.967 00:59:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:08.967 00:07:08.967 real 0m7.996s 00:07:08.967 user 0m0.021s 00:07:08.967 sys 0m0.067s 00:07:08.967 00:59:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.967 00:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:08.967 ************************************ 00:07:08.967 END TEST filesystem_ext4 00:07:08.967 ************************************ 00:07:08.967 00:59:58 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:08.967 00:59:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:08.967 00:59:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.967 00:59:58 -- common/autotest_common.sh@10 -- # set +x 00:07:08.967 ************************************ 00:07:08.967 START TEST filesystem_btrfs 00:07:08.967 ************************************ 00:07:08.967 00:59:58 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:08.967 00:59:58 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:08.967 00:59:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:08.967 00:59:58 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:08.967 00:59:58 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:08.967 00:59:58 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:08.967 00:59:58 -- common/autotest_common.sh@914 -- # local i=0 00:07:08.967 00:59:58 -- common/autotest_common.sh@915 -- # local force 00:07:08.967 00:59:58 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:08.967 00:59:58 -- common/autotest_common.sh@920 -- # force=-f 00:07:08.967 00:59:58 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:08.967 btrfs-progs v6.8.1 00:07:08.967 See https://btrfs.readthedocs.io for more information. 00:07:08.967 00:07:08.967 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:08.967 NOTE: several default settings have changed in version 5.15, please make sure 00:07:08.967 this does not affect your deployments: 00:07:08.967 - DUP for metadata (-m dup) 00:07:08.967 - enabled no-holes (-O no-holes) 00:07:08.967 - enabled free-space-tree (-R free-space-tree) 00:07:08.967 00:07:08.967 Label: (null) 00:07:08.967 UUID: 7e5b74a5-2e34-44a5-9470-12670ce22dd8 00:07:08.967 Node size: 16384 00:07:08.967 Sector size: 4096 (CPU page size: 4096) 00:07:08.967 Filesystem size: 510.00MiB 00:07:08.967 Block group profiles: 00:07:08.967 Data: single 8.00MiB 00:07:08.968 Metadata: DUP 32.00MiB 00:07:08.968 System: DUP 8.00MiB 00:07:08.968 SSD detected: yes 00:07:08.968 Zoned device: no 00:07:08.968 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:08.968 Checksum: crc32c 00:07:08.968 Number of devices: 1 00:07:08.968 Devices: 00:07:08.968 ID SIZE PATH 00:07:08.968 1 510.00MiB /dev/nvme0n1p1 00:07:08.968 00:07:08.968 00:59:58 -- common/autotest_common.sh@931 -- # return 0 00:07:08.968 00:59:58 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:09.225 00:59:59 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:09.225 00:59:59 -- target/filesystem.sh@25 -- # sync 00:07:09.225 00:59:59 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:09.225 00:59:59 -- target/filesystem.sh@27 -- # sync 00:07:09.225 00:59:59 -- target/filesystem.sh@29 -- # i=0 00:07:09.225 00:59:59 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:09.225 00:59:59 -- target/filesystem.sh@37 -- # kill -0 949736 00:07:09.225 00:59:59 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:09.225 00:59:59 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:09.225 00:59:59 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:09.225 00:59:59 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:09.225 00:07:09.225 real 0m1.068s 00:07:09.225 user 0m0.015s 00:07:09.225 sys 0m0.101s 00:07:09.225 00:59:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.225 00:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:09.225 ************************************ 00:07:09.225 END TEST filesystem_btrfs 00:07:09.225 ************************************ 00:07:09.225 00:59:59 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:09.225 00:59:59 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:09.225 00:59:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.225 00:59:59 -- common/autotest_common.sh@10 -- # set +x 00:07:09.225 ************************************ 00:07:09.225 START TEST filesystem_xfs 00:07:09.225 ************************************ 00:07:09.225 00:59:59 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:09.225 00:59:59 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:09.225 00:59:59 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:09.225 00:59:59 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:09.225 00:59:59 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:09.226 00:59:59 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:09.226 00:59:59 -- common/autotest_common.sh@914 -- # local i=0 00:07:09.226 00:59:59 -- common/autotest_common.sh@915 -- # local force 00:07:09.226 00:59:59 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:09.226 00:59:59 -- common/autotest_common.sh@920 -- # force=-f 00:07:09.226 00:59:59 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:09.483 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:09.483 = sectsz=512 attr=2, projid32bit=1 00:07:09.483 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:09.483 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:09.483 data = bsize=4096 blocks=130560, imaxpct=25 00:07:09.483 = sunit=0 swidth=0 blks 00:07:09.483 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:09.483 log =internal log bsize=4096 blocks=16384, version=2 00:07:09.483 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:09.483 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:10.416 Discarding blocks...Done. 00:07:10.416 01:00:00 -- common/autotest_common.sh@931 -- # return 0 00:07:10.416 01:00:00 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:12.312 01:00:02 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:12.312 01:00:02 -- target/filesystem.sh@25 -- # sync 00:07:12.312 01:00:02 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:12.312 01:00:02 -- target/filesystem.sh@27 -- # sync 00:07:12.312 01:00:02 -- target/filesystem.sh@29 -- # i=0 00:07:12.312 01:00:02 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:12.312 01:00:02 -- target/filesystem.sh@37 -- # kill -0 949736 00:07:12.312 01:00:02 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:12.312 01:00:02 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:12.312 01:00:02 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:12.312 01:00:02 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:12.312 00:07:12.312 real 0m2.806s 00:07:12.312 user 0m0.013s 00:07:12.312 sys 0m0.062s 00:07:12.312 01:00:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.312 01:00:02 -- common/autotest_common.sh@10 -- # set +x 00:07:12.312 ************************************ 00:07:12.312 END TEST filesystem_xfs 00:07:12.312 ************************************ 00:07:12.312 01:00:02 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:12.312 01:00:02 -- target/filesystem.sh@93 -- # sync 00:07:12.312 01:00:02 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:12.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:12.312 01:00:02 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:12.312 01:00:02 -- common/autotest_common.sh@1208 -- # local i=0 00:07:12.312 01:00:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:12.312 01:00:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:12.312 01:00:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:12.312 01:00:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:12.312 01:00:02 -- common/autotest_common.sh@1220 -- # return 0 00:07:12.312 01:00:02 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:12.312 01:00:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:12.312 01:00:02 -- common/autotest_common.sh@10 -- # set +x 00:07:12.312 01:00:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:12.312 01:00:02 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:12.313 01:00:02 -- target/filesystem.sh@101 -- # killprocess 949736 00:07:12.313 01:00:02 -- common/autotest_common.sh@936 -- # '[' -z 949736 ']' 00:07:12.313 01:00:02 -- common/autotest_common.sh@940 -- # kill -0 949736 00:07:12.313 01:00:02 -- common/autotest_common.sh@941 -- # uname 00:07:12.313 01:00:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:12.313 01:00:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 949736 00:07:12.313 01:00:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:12.313 01:00:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:12.313 01:00:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 949736' 00:07:12.313 killing process with pid 949736 00:07:12.313 01:00:02 -- common/autotest_common.sh@955 -- # kill 949736 00:07:12.313 01:00:02 -- common/autotest_common.sh@960 -- # wait 949736 00:07:12.880 01:00:03 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:12.880 00:07:12.880 real 0m18.795s 00:07:12.880 user 1m12.585s 00:07:12.880 sys 0m2.338s 00:07:12.880 01:00:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.880 01:00:03 -- common/autotest_common.sh@10 -- # set +x 00:07:12.880 ************************************ 00:07:12.880 END TEST nvmf_filesystem_no_in_capsule 00:07:12.880 ************************************ 00:07:12.880 01:00:03 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:12.880 01:00:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:12.880 01:00:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.880 01:00:03 -- common/autotest_common.sh@10 -- # set +x 00:07:12.880 ************************************ 00:07:12.880 START TEST nvmf_filesystem_in_capsule 00:07:12.880 ************************************ 00:07:12.880 01:00:03 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:12.880 01:00:03 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:12.880 01:00:03 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:12.880 01:00:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:12.880 01:00:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:12.880 01:00:03 -- common/autotest_common.sh@10 -- # set +x 00:07:12.880 01:00:03 -- nvmf/common.sh@469 -- # nvmfpid=952292 00:07:12.880 01:00:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:12.880 01:00:03 -- nvmf/common.sh@470 -- # waitforlisten 952292 00:07:12.880 01:00:03 -- common/autotest_common.sh@829 -- # '[' -z 952292 ']' 00:07:12.880 01:00:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:12.880 01:00:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:12.880 01:00:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:12.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:12.880 01:00:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:12.880 01:00:03 -- common/autotest_common.sh@10 -- # set +x 00:07:12.880 [2024-11-26 01:00:03.275328] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.880 [2024-11-26 01:00:03.275404] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:12.880 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.880 [2024-11-26 01:00:03.344433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:13.139 [2024-11-26 01:00:03.460899] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:13.139 [2024-11-26 01:00:03.461060] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:13.139 [2024-11-26 01:00:03.461080] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:13.139 [2024-11-26 01:00:03.461094] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:13.139 [2024-11-26 01:00:03.461160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:13.139 [2024-11-26 01:00:03.461218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:13.139 [2024-11-26 01:00:03.461271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:13.139 [2024-11-26 01:00:03.461274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.073 01:00:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:14.073 01:00:04 -- common/autotest_common.sh@862 -- # return 0 00:07:14.073 01:00:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:14.073 01:00:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:14.073 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.073 01:00:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:14.073 01:00:04 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:14.073 01:00:04 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:14.073 01:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.073 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.073 [2024-11-26 01:00:04.301356] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:14.073 01:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.073 01:00:04 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:14.073 01:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.073 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.073 Malloc1 00:07:14.073 01:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.073 01:00:04 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:14.073 01:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.073 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.073 01:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.073 01:00:04 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:14.073 01:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.073 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.073 01:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.073 01:00:04 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:14.073 01:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.073 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.073 [2024-11-26 01:00:04.487282] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:14.073 01:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.073 01:00:04 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:14.073 01:00:04 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:14.073 01:00:04 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:14.073 01:00:04 -- common/autotest_common.sh@1369 -- # local bs 00:07:14.073 01:00:04 -- common/autotest_common.sh@1370 -- # local nb 00:07:14.073 01:00:04 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:14.073 01:00:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:14.074 01:00:04 -- common/autotest_common.sh@10 -- # set +x 00:07:14.074 01:00:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:14.074 01:00:04 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:14.074 { 00:07:14.074 "name": "Malloc1", 00:07:14.074 "aliases": [ 00:07:14.074 "ef4bd00c-09df-43d7-a861-a07f65d23fe0" 00:07:14.074 ], 00:07:14.074 "product_name": "Malloc disk", 00:07:14.074 "block_size": 512, 00:07:14.074 "num_blocks": 1048576, 00:07:14.074 "uuid": "ef4bd00c-09df-43d7-a861-a07f65d23fe0", 00:07:14.074 "assigned_rate_limits": { 00:07:14.074 "rw_ios_per_sec": 0, 00:07:14.074 "rw_mbytes_per_sec": 0, 00:07:14.074 "r_mbytes_per_sec": 0, 00:07:14.074 "w_mbytes_per_sec": 0 00:07:14.074 }, 00:07:14.074 "claimed": true, 00:07:14.074 "claim_type": "exclusive_write", 00:07:14.074 "zoned": false, 00:07:14.074 "supported_io_types": { 00:07:14.074 "read": true, 00:07:14.074 "write": true, 00:07:14.074 "unmap": true, 00:07:14.074 "write_zeroes": true, 00:07:14.074 "flush": true, 00:07:14.074 "reset": true, 00:07:14.074 "compare": false, 00:07:14.074 "compare_and_write": false, 00:07:14.074 "abort": true, 00:07:14.074 "nvme_admin": false, 00:07:14.074 "nvme_io": false 00:07:14.074 }, 00:07:14.074 "memory_domains": [ 00:07:14.074 { 00:07:14.074 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:14.074 "dma_device_type": 2 00:07:14.074 } 00:07:14.074 ], 00:07:14.074 "driver_specific": {} 00:07:14.074 } 00:07:14.074 ]' 00:07:14.074 01:00:04 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:14.074 01:00:04 -- common/autotest_common.sh@1372 -- # bs=512 00:07:14.074 01:00:04 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:14.074 01:00:04 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:14.074 01:00:04 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:14.074 01:00:04 -- common/autotest_common.sh@1377 -- # echo 512 00:07:14.074 01:00:04 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:14.074 01:00:04 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:15.008 01:00:05 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:15.008 01:00:05 -- common/autotest_common.sh@1187 -- # local i=0 00:07:15.008 01:00:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:15.008 01:00:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:15.008 01:00:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:16.905 01:00:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:16.906 01:00:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:16.906 01:00:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:16.906 01:00:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:16.906 01:00:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:16.906 01:00:07 -- common/autotest_common.sh@1197 -- # return 0 00:07:16.906 01:00:07 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:16.906 01:00:07 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:16.906 01:00:07 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:16.906 01:00:07 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:16.906 01:00:07 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:16.906 01:00:07 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:16.906 01:00:07 -- setup/common.sh@80 -- # echo 536870912 00:07:16.906 01:00:07 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:16.906 01:00:07 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:16.906 01:00:07 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:16.906 01:00:07 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:16.906 01:00:07 -- target/filesystem.sh@69 -- # partprobe 00:07:17.839 01:00:08 -- target/filesystem.sh@70 -- # sleep 1 00:07:18.775 01:00:09 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:18.775 01:00:09 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:18.775 01:00:09 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:18.775 01:00:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:18.775 01:00:09 -- common/autotest_common.sh@10 -- # set +x 00:07:18.775 ************************************ 00:07:18.775 START TEST filesystem_in_capsule_ext4 00:07:18.775 ************************************ 00:07:18.775 01:00:09 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:18.775 01:00:09 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:18.775 01:00:09 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:18.775 01:00:09 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:18.775 01:00:09 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:18.775 01:00:09 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:18.775 01:00:09 -- common/autotest_common.sh@914 -- # local i=0 00:07:18.775 01:00:09 -- common/autotest_common.sh@915 -- # local force 00:07:18.775 01:00:09 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:18.775 01:00:09 -- common/autotest_common.sh@918 -- # force=-F 00:07:18.775 01:00:09 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:18.775 mke2fs 1.47.0 (5-Feb-2023) 00:07:18.775 Discarding device blocks: 0/522240 done 00:07:18.775 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:18.775 Filesystem UUID: 6e81128d-9abf-481c-937d-571d1131eb6b 00:07:18.775 Superblock backups stored on blocks: 00:07:18.775 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:18.775 00:07:18.775 Allocating group tables: 0/64 done 00:07:18.775 Writing inode tables: 0/64 done 00:07:20.179 Creating journal (8192 blocks): done 00:07:20.179 Writing superblocks and filesystem accounting information: 0/64 done 00:07:20.179 00:07:20.179 01:00:10 -- common/autotest_common.sh@931 -- # return 0 00:07:20.179 01:00:10 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:25.442 01:00:15 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:25.700 01:00:16 -- target/filesystem.sh@25 -- # sync 00:07:25.700 01:00:16 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:25.700 01:00:16 -- target/filesystem.sh@27 -- # sync 00:07:25.700 01:00:16 -- target/filesystem.sh@29 -- # i=0 00:07:25.700 01:00:16 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:25.700 01:00:16 -- target/filesystem.sh@37 -- # kill -0 952292 00:07:25.700 01:00:16 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:25.700 01:00:16 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:25.700 01:00:16 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:25.700 01:00:16 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:25.700 00:07:25.700 real 0m6.969s 00:07:25.700 user 0m0.010s 00:07:25.700 sys 0m0.071s 00:07:25.700 01:00:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.700 01:00:16 -- common/autotest_common.sh@10 -- # set +x 00:07:25.700 ************************************ 00:07:25.700 END TEST filesystem_in_capsule_ext4 00:07:25.700 ************************************ 00:07:25.700 01:00:16 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:25.700 01:00:16 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:25.700 01:00:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.700 01:00:16 -- common/autotest_common.sh@10 -- # set +x 00:07:25.700 ************************************ 00:07:25.700 START TEST filesystem_in_capsule_btrfs 00:07:25.700 ************************************ 00:07:25.700 01:00:16 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:25.700 01:00:16 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:25.700 01:00:16 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:25.700 01:00:16 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:25.700 01:00:16 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:25.700 01:00:16 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:25.700 01:00:16 -- common/autotest_common.sh@914 -- # local i=0 00:07:25.700 01:00:16 -- common/autotest_common.sh@915 -- # local force 00:07:25.700 01:00:16 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:25.700 01:00:16 -- common/autotest_common.sh@920 -- # force=-f 00:07:25.700 01:00:16 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:26.265 btrfs-progs v6.8.1 00:07:26.265 See https://btrfs.readthedocs.io for more information. 00:07:26.265 00:07:26.265 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:26.265 NOTE: several default settings have changed in version 5.15, please make sure 00:07:26.265 this does not affect your deployments: 00:07:26.265 - DUP for metadata (-m dup) 00:07:26.265 - enabled no-holes (-O no-holes) 00:07:26.265 - enabled free-space-tree (-R free-space-tree) 00:07:26.265 00:07:26.265 Label: (null) 00:07:26.265 UUID: 8dc742d6-a1af-4dab-9ba5-3e25f20258c5 00:07:26.265 Node size: 16384 00:07:26.265 Sector size: 4096 (CPU page size: 4096) 00:07:26.265 Filesystem size: 510.00MiB 00:07:26.265 Block group profiles: 00:07:26.265 Data: single 8.00MiB 00:07:26.265 Metadata: DUP 32.00MiB 00:07:26.265 System: DUP 8.00MiB 00:07:26.265 SSD detected: yes 00:07:26.265 Zoned device: no 00:07:26.265 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:26.265 Checksum: crc32c 00:07:26.265 Number of devices: 1 00:07:26.265 Devices: 00:07:26.265 ID SIZE PATH 00:07:26.265 1 510.00MiB /dev/nvme0n1p1 00:07:26.265 00:07:26.265 01:00:16 -- common/autotest_common.sh@931 -- # return 0 00:07:26.265 01:00:16 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:27.197 01:00:17 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:27.197 01:00:17 -- target/filesystem.sh@25 -- # sync 00:07:27.197 01:00:17 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:27.197 01:00:17 -- target/filesystem.sh@27 -- # sync 00:07:27.197 01:00:17 -- target/filesystem.sh@29 -- # i=0 00:07:27.197 01:00:17 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:27.197 01:00:17 -- target/filesystem.sh@37 -- # kill -0 952292 00:07:27.197 01:00:17 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:27.197 01:00:17 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:27.197 01:00:17 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:27.197 01:00:17 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:27.197 00:07:27.197 real 0m1.390s 00:07:27.197 user 0m0.019s 00:07:27.197 sys 0m0.099s 00:07:27.197 01:00:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.197 01:00:17 -- common/autotest_common.sh@10 -- # set +x 00:07:27.197 ************************************ 00:07:27.197 END TEST filesystem_in_capsule_btrfs 00:07:27.197 ************************************ 00:07:27.197 01:00:17 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:27.197 01:00:17 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:27.197 01:00:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.197 01:00:17 -- common/autotest_common.sh@10 -- # set +x 00:07:27.197 ************************************ 00:07:27.197 START TEST filesystem_in_capsule_xfs 00:07:27.197 ************************************ 00:07:27.197 01:00:17 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:27.197 01:00:17 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:27.197 01:00:17 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:27.197 01:00:17 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:27.197 01:00:17 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:27.197 01:00:17 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:27.197 01:00:17 -- common/autotest_common.sh@914 -- # local i=0 00:07:27.197 01:00:17 -- common/autotest_common.sh@915 -- # local force 00:07:27.197 01:00:17 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:27.197 01:00:17 -- common/autotest_common.sh@920 -- # force=-f 00:07:27.197 01:00:17 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:27.455 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:27.455 = sectsz=512 attr=2, projid32bit=1 00:07:27.455 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:27.455 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:27.455 data = bsize=4096 blocks=130560, imaxpct=25 00:07:27.455 = sunit=0 swidth=0 blks 00:07:27.455 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:27.455 log =internal log bsize=4096 blocks=16384, version=2 00:07:27.455 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:27.455 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:28.390 Discarding blocks...Done. 00:07:28.390 01:00:18 -- common/autotest_common.sh@931 -- # return 0 00:07:28.390 01:00:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:30.288 01:00:20 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:30.288 01:00:20 -- target/filesystem.sh@25 -- # sync 00:07:30.288 01:00:20 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:30.288 01:00:20 -- target/filesystem.sh@27 -- # sync 00:07:30.288 01:00:20 -- target/filesystem.sh@29 -- # i=0 00:07:30.288 01:00:20 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:30.288 01:00:20 -- target/filesystem.sh@37 -- # kill -0 952292 00:07:30.288 01:00:20 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:30.288 01:00:20 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:30.288 01:00:20 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:30.288 01:00:20 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:30.288 00:07:30.288 real 0m3.138s 00:07:30.288 user 0m0.018s 00:07:30.288 sys 0m0.064s 00:07:30.288 01:00:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.288 01:00:20 -- common/autotest_common.sh@10 -- # set +x 00:07:30.288 ************************************ 00:07:30.288 END TEST filesystem_in_capsule_xfs 00:07:30.288 ************************************ 00:07:30.288 01:00:20 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:30.547 01:00:20 -- target/filesystem.sh@93 -- # sync 00:07:30.547 01:00:20 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:30.547 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:30.547 01:00:21 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:30.547 01:00:21 -- common/autotest_common.sh@1208 -- # local i=0 00:07:30.547 01:00:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:30.547 01:00:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:30.547 01:00:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:30.547 01:00:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:30.547 01:00:21 -- common/autotest_common.sh@1220 -- # return 0 00:07:30.547 01:00:21 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:30.547 01:00:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:30.547 01:00:21 -- common/autotest_common.sh@10 -- # set +x 00:07:30.547 01:00:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:30.547 01:00:21 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:30.547 01:00:21 -- target/filesystem.sh@101 -- # killprocess 952292 00:07:30.547 01:00:21 -- common/autotest_common.sh@936 -- # '[' -z 952292 ']' 00:07:30.547 01:00:21 -- common/autotest_common.sh@940 -- # kill -0 952292 00:07:30.547 01:00:21 -- common/autotest_common.sh@941 -- # uname 00:07:30.547 01:00:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:30.547 01:00:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 952292 00:07:30.547 01:00:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:30.547 01:00:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:30.547 01:00:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 952292' 00:07:30.547 killing process with pid 952292 00:07:30.547 01:00:21 -- common/autotest_common.sh@955 -- # kill 952292 00:07:30.547 01:00:21 -- common/autotest_common.sh@960 -- # wait 952292 00:07:31.114 01:00:21 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:31.114 00:07:31.114 real 0m18.323s 00:07:31.114 user 1m10.853s 00:07:31.114 sys 0m2.203s 00:07:31.114 01:00:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.114 01:00:21 -- common/autotest_common.sh@10 -- # set +x 00:07:31.114 ************************************ 00:07:31.114 END TEST nvmf_filesystem_in_capsule 00:07:31.114 ************************************ 00:07:31.114 01:00:21 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:31.114 01:00:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:31.114 01:00:21 -- nvmf/common.sh@116 -- # sync 00:07:31.114 01:00:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:31.114 01:00:21 -- nvmf/common.sh@119 -- # set +e 00:07:31.114 01:00:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:31.114 01:00:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:31.114 rmmod nvme_tcp 00:07:31.114 rmmod nvme_fabrics 00:07:31.114 rmmod nvme_keyring 00:07:31.114 01:00:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:31.114 01:00:21 -- nvmf/common.sh@123 -- # set -e 00:07:31.115 01:00:21 -- nvmf/common.sh@124 -- # return 0 00:07:31.115 01:00:21 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:31.115 01:00:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:31.115 01:00:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:31.115 01:00:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:31.115 01:00:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:31.115 01:00:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:31.115 01:00:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:31.115 01:00:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:31.115 01:00:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:33.650 01:00:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:33.650 00:07:33.650 real 0m41.742s 00:07:33.650 user 2m24.457s 00:07:33.650 sys 0m6.137s 00:07:33.650 01:00:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.650 01:00:23 -- common/autotest_common.sh@10 -- # set +x 00:07:33.650 ************************************ 00:07:33.650 END TEST nvmf_filesystem 00:07:33.650 ************************************ 00:07:33.650 01:00:23 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:33.650 01:00:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:33.650 01:00:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.650 01:00:23 -- common/autotest_common.sh@10 -- # set +x 00:07:33.650 ************************************ 00:07:33.650 START TEST nvmf_discovery 00:07:33.651 ************************************ 00:07:33.651 01:00:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:33.651 * Looking for test storage... 00:07:33.651 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:33.651 01:00:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:33.651 01:00:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:33.651 01:00:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:33.651 01:00:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:33.651 01:00:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:33.651 01:00:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:33.651 01:00:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:33.651 01:00:23 -- scripts/common.sh@335 -- # IFS=.-: 00:07:33.651 01:00:23 -- scripts/common.sh@335 -- # read -ra ver1 00:07:33.651 01:00:23 -- scripts/common.sh@336 -- # IFS=.-: 00:07:33.651 01:00:23 -- scripts/common.sh@336 -- # read -ra ver2 00:07:33.651 01:00:23 -- scripts/common.sh@337 -- # local 'op=<' 00:07:33.651 01:00:23 -- scripts/common.sh@339 -- # ver1_l=2 00:07:33.651 01:00:23 -- scripts/common.sh@340 -- # ver2_l=1 00:07:33.651 01:00:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:33.651 01:00:23 -- scripts/common.sh@343 -- # case "$op" in 00:07:33.651 01:00:23 -- scripts/common.sh@344 -- # : 1 00:07:33.651 01:00:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:33.651 01:00:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:33.651 01:00:23 -- scripts/common.sh@364 -- # decimal 1 00:07:33.651 01:00:23 -- scripts/common.sh@352 -- # local d=1 00:07:33.651 01:00:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:33.651 01:00:23 -- scripts/common.sh@354 -- # echo 1 00:07:33.651 01:00:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:33.651 01:00:23 -- scripts/common.sh@365 -- # decimal 2 00:07:33.651 01:00:23 -- scripts/common.sh@352 -- # local d=2 00:07:33.651 01:00:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:33.651 01:00:23 -- scripts/common.sh@354 -- # echo 2 00:07:33.651 01:00:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:33.651 01:00:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:33.651 01:00:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:33.651 01:00:23 -- scripts/common.sh@367 -- # return 0 00:07:33.651 01:00:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:33.651 01:00:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:33.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.651 --rc genhtml_branch_coverage=1 00:07:33.651 --rc genhtml_function_coverage=1 00:07:33.651 --rc genhtml_legend=1 00:07:33.651 --rc geninfo_all_blocks=1 00:07:33.651 --rc geninfo_unexecuted_blocks=1 00:07:33.651 00:07:33.651 ' 00:07:33.651 01:00:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:33.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.651 --rc genhtml_branch_coverage=1 00:07:33.651 --rc genhtml_function_coverage=1 00:07:33.651 --rc genhtml_legend=1 00:07:33.651 --rc geninfo_all_blocks=1 00:07:33.651 --rc geninfo_unexecuted_blocks=1 00:07:33.651 00:07:33.651 ' 00:07:33.651 01:00:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:33.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.651 --rc genhtml_branch_coverage=1 00:07:33.651 --rc genhtml_function_coverage=1 00:07:33.651 --rc genhtml_legend=1 00:07:33.651 --rc geninfo_all_blocks=1 00:07:33.651 --rc geninfo_unexecuted_blocks=1 00:07:33.651 00:07:33.651 ' 00:07:33.651 01:00:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:33.651 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:33.651 --rc genhtml_branch_coverage=1 00:07:33.651 --rc genhtml_function_coverage=1 00:07:33.651 --rc genhtml_legend=1 00:07:33.651 --rc geninfo_all_blocks=1 00:07:33.651 --rc geninfo_unexecuted_blocks=1 00:07:33.651 00:07:33.651 ' 00:07:33.651 01:00:23 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:33.651 01:00:23 -- nvmf/common.sh@7 -- # uname -s 00:07:33.651 01:00:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:33.651 01:00:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:33.651 01:00:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:33.651 01:00:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:33.651 01:00:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:33.651 01:00:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:33.651 01:00:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:33.651 01:00:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:33.651 01:00:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:33.651 01:00:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:33.651 01:00:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:33.651 01:00:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:33.651 01:00:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:33.651 01:00:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:33.651 01:00:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:33.651 01:00:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:33.651 01:00:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:33.651 01:00:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:33.651 01:00:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:33.651 01:00:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.651 01:00:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.651 01:00:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.651 01:00:23 -- paths/export.sh@5 -- # export PATH 00:07:33.651 01:00:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:33.651 01:00:23 -- nvmf/common.sh@46 -- # : 0 00:07:33.651 01:00:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:33.651 01:00:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:33.651 01:00:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:33.651 01:00:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:33.651 01:00:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:33.651 01:00:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:33.651 01:00:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:33.651 01:00:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:33.651 01:00:23 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:33.651 01:00:23 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:33.651 01:00:23 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:33.651 01:00:23 -- target/discovery.sh@15 -- # hash nvme 00:07:33.651 01:00:23 -- target/discovery.sh@20 -- # nvmftestinit 00:07:33.651 01:00:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:33.651 01:00:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:33.651 01:00:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:33.651 01:00:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:33.651 01:00:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:33.651 01:00:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:33.651 01:00:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:33.651 01:00:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:33.651 01:00:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:33.651 01:00:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:33.651 01:00:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:33.651 01:00:23 -- common/autotest_common.sh@10 -- # set +x 00:07:35.557 01:00:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:35.557 01:00:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:35.557 01:00:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:35.557 01:00:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:35.557 01:00:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:35.557 01:00:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:35.557 01:00:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:35.557 01:00:25 -- nvmf/common.sh@294 -- # net_devs=() 00:07:35.557 01:00:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:35.557 01:00:25 -- nvmf/common.sh@295 -- # e810=() 00:07:35.557 01:00:25 -- nvmf/common.sh@295 -- # local -ga e810 00:07:35.557 01:00:25 -- nvmf/common.sh@296 -- # x722=() 00:07:35.557 01:00:25 -- nvmf/common.sh@296 -- # local -ga x722 00:07:35.557 01:00:25 -- nvmf/common.sh@297 -- # mlx=() 00:07:35.557 01:00:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:35.557 01:00:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:35.557 01:00:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:35.557 01:00:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:35.557 01:00:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:35.557 01:00:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:35.557 01:00:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:35.557 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:35.557 01:00:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:35.557 01:00:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:35.557 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:35.557 01:00:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:35.557 01:00:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:35.557 01:00:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:35.557 01:00:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:35.557 01:00:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:35.557 01:00:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:35.557 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:35.557 01:00:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:35.557 01:00:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:35.557 01:00:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:35.557 01:00:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:35.557 01:00:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:35.557 01:00:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:35.557 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:35.557 01:00:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:35.557 01:00:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:35.557 01:00:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:35.557 01:00:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:35.557 01:00:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:35.557 01:00:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:35.557 01:00:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:35.557 01:00:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:35.558 01:00:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:35.558 01:00:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:35.558 01:00:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:35.558 01:00:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:35.558 01:00:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:35.558 01:00:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:35.558 01:00:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:35.558 01:00:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:35.558 01:00:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:35.558 01:00:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:35.558 01:00:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:35.558 01:00:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:35.558 01:00:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:35.558 01:00:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:35.816 01:00:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:35.816 01:00:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:35.816 01:00:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:35.816 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:35.816 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.176 ms 00:07:35.816 00:07:35.816 --- 10.0.0.2 ping statistics --- 00:07:35.816 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:35.816 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:07:35.816 01:00:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:35.816 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:35.816 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:07:35.816 00:07:35.816 --- 10.0.0.1 ping statistics --- 00:07:35.816 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:35.816 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:07:35.816 01:00:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:35.816 01:00:26 -- nvmf/common.sh@410 -- # return 0 00:07:35.816 01:00:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:35.816 01:00:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:35.816 01:00:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:35.816 01:00:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:35.816 01:00:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:35.816 01:00:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:35.816 01:00:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:35.816 01:00:26 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:35.816 01:00:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:35.816 01:00:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:35.816 01:00:26 -- common/autotest_common.sh@10 -- # set +x 00:07:35.816 01:00:26 -- nvmf/common.sh@469 -- # nvmfpid=957160 00:07:35.816 01:00:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:35.816 01:00:26 -- nvmf/common.sh@470 -- # waitforlisten 957160 00:07:35.816 01:00:26 -- common/autotest_common.sh@829 -- # '[' -z 957160 ']' 00:07:35.816 01:00:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:35.816 01:00:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:35.816 01:00:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:35.816 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:35.816 01:00:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:35.816 01:00:26 -- common/autotest_common.sh@10 -- # set +x 00:07:35.816 [2024-11-26 01:00:26.199613] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:35.816 [2024-11-26 01:00:26.199695] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:35.816 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.816 [2024-11-26 01:00:26.264765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.075 [2024-11-26 01:00:26.384732] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:36.075 [2024-11-26 01:00:26.384888] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:36.075 [2024-11-26 01:00:26.384908] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:36.075 [2024-11-26 01:00:26.384922] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:36.075 [2024-11-26 01:00:26.385115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.075 [2024-11-26 01:00:26.385170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.075 [2024-11-26 01:00:26.385222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.075 [2024-11-26 01:00:26.385226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.010 01:00:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:37.010 01:00:27 -- common/autotest_common.sh@862 -- # return 0 00:07:37.010 01:00:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:37.010 01:00:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:37.010 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.010 01:00:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:37.010 01:00:27 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:37.010 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.010 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.010 [2024-11-26 01:00:27.250413] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:37.010 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.010 01:00:27 -- target/discovery.sh@26 -- # seq 1 4 00:07:37.010 01:00:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.010 01:00:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:37.010 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.010 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.010 Null1 00:07:37.010 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.010 01:00:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:37.010 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.010 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.010 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 [2024-11-26 01:00:27.290760] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.011 01:00:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 Null2 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.011 01:00:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 Null3 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:37.011 01:00:27 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 Null4 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:37.011 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.011 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.011 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.011 01:00:27 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:37.270 00:07:37.270 Discovery Log Number of Records 6, Generation counter 6 00:07:37.270 =====Discovery Log Entry 0====== 00:07:37.270 trtype: tcp 00:07:37.270 adrfam: ipv4 00:07:37.270 subtype: current discovery subsystem 00:07:37.270 treq: not required 00:07:37.270 portid: 0 00:07:37.270 trsvcid: 4420 00:07:37.270 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:37.270 traddr: 10.0.0.2 00:07:37.270 eflags: explicit discovery connections, duplicate discovery information 00:07:37.270 sectype: none 00:07:37.270 =====Discovery Log Entry 1====== 00:07:37.270 trtype: tcp 00:07:37.270 adrfam: ipv4 00:07:37.270 subtype: nvme subsystem 00:07:37.270 treq: not required 00:07:37.270 portid: 0 00:07:37.270 trsvcid: 4420 00:07:37.270 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:37.270 traddr: 10.0.0.2 00:07:37.270 eflags: none 00:07:37.270 sectype: none 00:07:37.270 =====Discovery Log Entry 2====== 00:07:37.270 trtype: tcp 00:07:37.270 adrfam: ipv4 00:07:37.270 subtype: nvme subsystem 00:07:37.270 treq: not required 00:07:37.270 portid: 0 00:07:37.270 trsvcid: 4420 00:07:37.270 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:37.270 traddr: 10.0.0.2 00:07:37.270 eflags: none 00:07:37.270 sectype: none 00:07:37.270 =====Discovery Log Entry 3====== 00:07:37.270 trtype: tcp 00:07:37.270 adrfam: ipv4 00:07:37.270 subtype: nvme subsystem 00:07:37.270 treq: not required 00:07:37.270 portid: 0 00:07:37.270 trsvcid: 4420 00:07:37.270 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:37.270 traddr: 10.0.0.2 00:07:37.270 eflags: none 00:07:37.270 sectype: none 00:07:37.270 =====Discovery Log Entry 4====== 00:07:37.270 trtype: tcp 00:07:37.270 adrfam: ipv4 00:07:37.270 subtype: nvme subsystem 00:07:37.270 treq: not required 00:07:37.270 portid: 0 00:07:37.270 trsvcid: 4420 00:07:37.270 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:37.270 traddr: 10.0.0.2 00:07:37.270 eflags: none 00:07:37.270 sectype: none 00:07:37.270 =====Discovery Log Entry 5====== 00:07:37.270 trtype: tcp 00:07:37.270 adrfam: ipv4 00:07:37.270 subtype: discovery subsystem referral 00:07:37.270 treq: not required 00:07:37.270 portid: 0 00:07:37.270 trsvcid: 4430 00:07:37.270 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:37.270 traddr: 10.0.0.2 00:07:37.270 eflags: none 00:07:37.270 sectype: none 00:07:37.270 01:00:27 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:37.270 Perform nvmf subsystem discovery via RPC 00:07:37.270 01:00:27 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:37.270 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.270 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.270 [2024-11-26 01:00:27.563428] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:37.270 [ 00:07:37.270 { 00:07:37.270 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:37.270 "subtype": "Discovery", 00:07:37.270 "listen_addresses": [ 00:07:37.270 { 00:07:37.270 "transport": "TCP", 00:07:37.270 "trtype": "TCP", 00:07:37.270 "adrfam": "IPv4", 00:07:37.270 "traddr": "10.0.0.2", 00:07:37.270 "trsvcid": "4420" 00:07:37.270 } 00:07:37.270 ], 00:07:37.270 "allow_any_host": true, 00:07:37.270 "hosts": [] 00:07:37.270 }, 00:07:37.270 { 00:07:37.270 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:37.270 "subtype": "NVMe", 00:07:37.270 "listen_addresses": [ 00:07:37.270 { 00:07:37.270 "transport": "TCP", 00:07:37.270 "trtype": "TCP", 00:07:37.270 "adrfam": "IPv4", 00:07:37.270 "traddr": "10.0.0.2", 00:07:37.270 "trsvcid": "4420" 00:07:37.270 } 00:07:37.270 ], 00:07:37.270 "allow_any_host": true, 00:07:37.270 "hosts": [], 00:07:37.270 "serial_number": "SPDK00000000000001", 00:07:37.270 "model_number": "SPDK bdev Controller", 00:07:37.270 "max_namespaces": 32, 00:07:37.270 "min_cntlid": 1, 00:07:37.270 "max_cntlid": 65519, 00:07:37.270 "namespaces": [ 00:07:37.270 { 00:07:37.270 "nsid": 1, 00:07:37.270 "bdev_name": "Null1", 00:07:37.270 "name": "Null1", 00:07:37.270 "nguid": "217C8C87347E46ECAC4F50E8F4B1ED04", 00:07:37.270 "uuid": "217c8c87-347e-46ec-ac4f-50e8f4b1ed04" 00:07:37.270 } 00:07:37.270 ] 00:07:37.270 }, 00:07:37.270 { 00:07:37.270 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:37.270 "subtype": "NVMe", 00:07:37.270 "listen_addresses": [ 00:07:37.270 { 00:07:37.270 "transport": "TCP", 00:07:37.270 "trtype": "TCP", 00:07:37.270 "adrfam": "IPv4", 00:07:37.270 "traddr": "10.0.0.2", 00:07:37.270 "trsvcid": "4420" 00:07:37.270 } 00:07:37.270 ], 00:07:37.270 "allow_any_host": true, 00:07:37.270 "hosts": [], 00:07:37.270 "serial_number": "SPDK00000000000002", 00:07:37.270 "model_number": "SPDK bdev Controller", 00:07:37.270 "max_namespaces": 32, 00:07:37.270 "min_cntlid": 1, 00:07:37.270 "max_cntlid": 65519, 00:07:37.270 "namespaces": [ 00:07:37.270 { 00:07:37.270 "nsid": 1, 00:07:37.270 "bdev_name": "Null2", 00:07:37.270 "name": "Null2", 00:07:37.270 "nguid": "FC1B651034B44F5CAD4BB1879FF974AD", 00:07:37.270 "uuid": "fc1b6510-34b4-4f5c-ad4b-b1879ff974ad" 00:07:37.270 } 00:07:37.270 ] 00:07:37.270 }, 00:07:37.270 { 00:07:37.270 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:37.270 "subtype": "NVMe", 00:07:37.270 "listen_addresses": [ 00:07:37.270 { 00:07:37.270 "transport": "TCP", 00:07:37.270 "trtype": "TCP", 00:07:37.270 "adrfam": "IPv4", 00:07:37.270 "traddr": "10.0.0.2", 00:07:37.270 "trsvcid": "4420" 00:07:37.270 } 00:07:37.270 ], 00:07:37.270 "allow_any_host": true, 00:07:37.270 "hosts": [], 00:07:37.270 "serial_number": "SPDK00000000000003", 00:07:37.270 "model_number": "SPDK bdev Controller", 00:07:37.270 "max_namespaces": 32, 00:07:37.270 "min_cntlid": 1, 00:07:37.270 "max_cntlid": 65519, 00:07:37.270 "namespaces": [ 00:07:37.270 { 00:07:37.270 "nsid": 1, 00:07:37.270 "bdev_name": "Null3", 00:07:37.270 "name": "Null3", 00:07:37.270 "nguid": "6862069275BA4FC98F91480F35D19DEA", 00:07:37.270 "uuid": "68620692-75ba-4fc9-8f91-480f35d19dea" 00:07:37.270 } 00:07:37.270 ] 00:07:37.270 }, 00:07:37.270 { 00:07:37.270 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:37.270 "subtype": "NVMe", 00:07:37.270 "listen_addresses": [ 00:07:37.270 { 00:07:37.270 "transport": "TCP", 00:07:37.270 "trtype": "TCP", 00:07:37.270 "adrfam": "IPv4", 00:07:37.270 "traddr": "10.0.0.2", 00:07:37.270 "trsvcid": "4420" 00:07:37.270 } 00:07:37.270 ], 00:07:37.270 "allow_any_host": true, 00:07:37.270 "hosts": [], 00:07:37.270 "serial_number": "SPDK00000000000004", 00:07:37.270 "model_number": "SPDK bdev Controller", 00:07:37.270 "max_namespaces": 32, 00:07:37.270 "min_cntlid": 1, 00:07:37.270 "max_cntlid": 65519, 00:07:37.270 "namespaces": [ 00:07:37.270 { 00:07:37.271 "nsid": 1, 00:07:37.271 "bdev_name": "Null4", 00:07:37.271 "name": "Null4", 00:07:37.271 "nguid": "D9F6AE9C49C245A9BB99CB6EBDE5374B", 00:07:37.271 "uuid": "d9f6ae9c-49c2-45a9-bb99-cb6ebde5374b" 00:07:37.271 } 00:07:37.271 ] 00:07:37.271 } 00:07:37.271 ] 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@42 -- # seq 1 4 00:07:37.271 01:00:27 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.271 01:00:27 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.271 01:00:27 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.271 01:00:27 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:37.271 01:00:27 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:37.271 01:00:27 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:37.271 01:00:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:37.271 01:00:27 -- common/autotest_common.sh@10 -- # set +x 00:07:37.271 01:00:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:37.271 01:00:27 -- target/discovery.sh@49 -- # check_bdevs= 00:07:37.271 01:00:27 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:37.271 01:00:27 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:37.271 01:00:27 -- target/discovery.sh@57 -- # nvmftestfini 00:07:37.271 01:00:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:37.271 01:00:27 -- nvmf/common.sh@116 -- # sync 00:07:37.271 01:00:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:37.271 01:00:27 -- nvmf/common.sh@119 -- # set +e 00:07:37.271 01:00:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:37.271 01:00:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:37.271 rmmod nvme_tcp 00:07:37.271 rmmod nvme_fabrics 00:07:37.271 rmmod nvme_keyring 00:07:37.271 01:00:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:37.271 01:00:27 -- nvmf/common.sh@123 -- # set -e 00:07:37.271 01:00:27 -- nvmf/common.sh@124 -- # return 0 00:07:37.271 01:00:27 -- nvmf/common.sh@477 -- # '[' -n 957160 ']' 00:07:37.271 01:00:27 -- nvmf/common.sh@478 -- # killprocess 957160 00:07:37.271 01:00:27 -- common/autotest_common.sh@936 -- # '[' -z 957160 ']' 00:07:37.271 01:00:27 -- common/autotest_common.sh@940 -- # kill -0 957160 00:07:37.271 01:00:27 -- common/autotest_common.sh@941 -- # uname 00:07:37.271 01:00:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:37.271 01:00:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 957160 00:07:37.271 01:00:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:37.271 01:00:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:37.271 01:00:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 957160' 00:07:37.271 killing process with pid 957160 00:07:37.271 01:00:27 -- common/autotest_common.sh@955 -- # kill 957160 00:07:37.271 [2024-11-26 01:00:27.795913] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:37.271 01:00:27 -- common/autotest_common.sh@960 -- # wait 957160 00:07:37.838 01:00:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:37.838 01:00:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:37.838 01:00:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:37.838 01:00:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:37.838 01:00:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:37.838 01:00:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.838 01:00:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.838 01:00:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.744 01:00:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:39.744 00:07:39.744 real 0m6.417s 00:07:39.744 user 0m7.773s 00:07:39.744 sys 0m1.949s 00:07:39.744 01:00:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:39.744 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:07:39.744 ************************************ 00:07:39.744 END TEST nvmf_discovery 00:07:39.744 ************************************ 00:07:39.744 01:00:30 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:39.744 01:00:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:39.744 01:00:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.744 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:07:39.744 ************************************ 00:07:39.744 START TEST nvmf_referrals 00:07:39.744 ************************************ 00:07:39.744 01:00:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:39.744 * Looking for test storage... 00:07:39.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:39.744 01:00:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:39.744 01:00:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:39.744 01:00:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:40.002 01:00:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:40.002 01:00:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:40.002 01:00:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:40.002 01:00:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:40.002 01:00:30 -- scripts/common.sh@335 -- # IFS=.-: 00:07:40.002 01:00:30 -- scripts/common.sh@335 -- # read -ra ver1 00:07:40.003 01:00:30 -- scripts/common.sh@336 -- # IFS=.-: 00:07:40.003 01:00:30 -- scripts/common.sh@336 -- # read -ra ver2 00:07:40.003 01:00:30 -- scripts/common.sh@337 -- # local 'op=<' 00:07:40.003 01:00:30 -- scripts/common.sh@339 -- # ver1_l=2 00:07:40.003 01:00:30 -- scripts/common.sh@340 -- # ver2_l=1 00:07:40.003 01:00:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:40.003 01:00:30 -- scripts/common.sh@343 -- # case "$op" in 00:07:40.003 01:00:30 -- scripts/common.sh@344 -- # : 1 00:07:40.003 01:00:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:40.003 01:00:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:40.003 01:00:30 -- scripts/common.sh@364 -- # decimal 1 00:07:40.003 01:00:30 -- scripts/common.sh@352 -- # local d=1 00:07:40.003 01:00:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:40.003 01:00:30 -- scripts/common.sh@354 -- # echo 1 00:07:40.003 01:00:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:40.003 01:00:30 -- scripts/common.sh@365 -- # decimal 2 00:07:40.003 01:00:30 -- scripts/common.sh@352 -- # local d=2 00:07:40.003 01:00:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:40.003 01:00:30 -- scripts/common.sh@354 -- # echo 2 00:07:40.003 01:00:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:40.003 01:00:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:40.003 01:00:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:40.003 01:00:30 -- scripts/common.sh@367 -- # return 0 00:07:40.003 01:00:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:40.003 01:00:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.003 --rc genhtml_branch_coverage=1 00:07:40.003 --rc genhtml_function_coverage=1 00:07:40.003 --rc genhtml_legend=1 00:07:40.003 --rc geninfo_all_blocks=1 00:07:40.003 --rc geninfo_unexecuted_blocks=1 00:07:40.003 00:07:40.003 ' 00:07:40.003 01:00:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.003 --rc genhtml_branch_coverage=1 00:07:40.003 --rc genhtml_function_coverage=1 00:07:40.003 --rc genhtml_legend=1 00:07:40.003 --rc geninfo_all_blocks=1 00:07:40.003 --rc geninfo_unexecuted_blocks=1 00:07:40.003 00:07:40.003 ' 00:07:40.003 01:00:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.003 --rc genhtml_branch_coverage=1 00:07:40.003 --rc genhtml_function_coverage=1 00:07:40.003 --rc genhtml_legend=1 00:07:40.003 --rc geninfo_all_blocks=1 00:07:40.003 --rc geninfo_unexecuted_blocks=1 00:07:40.003 00:07:40.003 ' 00:07:40.003 01:00:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:40.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:40.003 --rc genhtml_branch_coverage=1 00:07:40.003 --rc genhtml_function_coverage=1 00:07:40.003 --rc genhtml_legend=1 00:07:40.003 --rc geninfo_all_blocks=1 00:07:40.003 --rc geninfo_unexecuted_blocks=1 00:07:40.003 00:07:40.003 ' 00:07:40.003 01:00:30 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:40.003 01:00:30 -- nvmf/common.sh@7 -- # uname -s 00:07:40.003 01:00:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:40.003 01:00:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:40.003 01:00:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:40.003 01:00:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:40.003 01:00:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:40.003 01:00:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:40.003 01:00:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:40.003 01:00:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:40.003 01:00:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:40.003 01:00:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:40.003 01:00:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:40.003 01:00:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:40.003 01:00:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:40.003 01:00:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:40.003 01:00:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:40.003 01:00:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:40.003 01:00:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:40.003 01:00:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:40.003 01:00:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:40.003 01:00:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.003 01:00:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.003 01:00:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.003 01:00:30 -- paths/export.sh@5 -- # export PATH 00:07:40.003 01:00:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:40.003 01:00:30 -- nvmf/common.sh@46 -- # : 0 00:07:40.003 01:00:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:40.003 01:00:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:40.003 01:00:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:40.003 01:00:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:40.003 01:00:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:40.003 01:00:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:40.003 01:00:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:40.003 01:00:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:40.003 01:00:30 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:40.003 01:00:30 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:40.003 01:00:30 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:40.003 01:00:30 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:40.003 01:00:30 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:40.003 01:00:30 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:40.003 01:00:30 -- target/referrals.sh@37 -- # nvmftestinit 00:07:40.003 01:00:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:40.003 01:00:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:40.003 01:00:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:40.003 01:00:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:40.003 01:00:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:40.003 01:00:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:40.003 01:00:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:40.003 01:00:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:40.003 01:00:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:40.003 01:00:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:40.003 01:00:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:40.003 01:00:30 -- common/autotest_common.sh@10 -- # set +x 00:07:41.906 01:00:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.906 01:00:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:41.906 01:00:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:41.906 01:00:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:41.906 01:00:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:41.906 01:00:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:41.906 01:00:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:41.906 01:00:32 -- nvmf/common.sh@294 -- # net_devs=() 00:07:41.906 01:00:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:41.906 01:00:32 -- nvmf/common.sh@295 -- # e810=() 00:07:41.906 01:00:32 -- nvmf/common.sh@295 -- # local -ga e810 00:07:41.906 01:00:32 -- nvmf/common.sh@296 -- # x722=() 00:07:41.906 01:00:32 -- nvmf/common.sh@296 -- # local -ga x722 00:07:41.906 01:00:32 -- nvmf/common.sh@297 -- # mlx=() 00:07:41.906 01:00:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:41.906 01:00:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.906 01:00:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.906 01:00:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.906 01:00:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.906 01:00:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.906 01:00:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.907 01:00:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.907 01:00:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.907 01:00:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.907 01:00:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.907 01:00:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.907 01:00:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:41.907 01:00:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:41.907 01:00:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:41.907 01:00:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.907 01:00:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:41.907 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:41.907 01:00:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.907 01:00:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:41.907 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:41.907 01:00:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:41.907 01:00:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.907 01:00:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.907 01:00:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.907 01:00:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.907 01:00:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:41.907 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:41.907 01:00:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.907 01:00:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.907 01:00:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.907 01:00:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.907 01:00:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.907 01:00:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:41.907 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:41.907 01:00:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.907 01:00:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:41.907 01:00:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:41.907 01:00:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:41.907 01:00:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:41.907 01:00:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:41.907 01:00:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:41.907 01:00:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:41.907 01:00:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:41.907 01:00:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:41.907 01:00:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:41.907 01:00:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:41.907 01:00:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:41.907 01:00:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:41.907 01:00:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:41.907 01:00:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:41.907 01:00:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:41.907 01:00:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:41.907 01:00:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:41.907 01:00:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:41.907 01:00:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:41.907 01:00:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:41.907 01:00:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:41.907 01:00:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:42.165 01:00:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:42.165 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:42.165 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:07:42.165 00:07:42.165 --- 10.0.0.2 ping statistics --- 00:07:42.165 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.165 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:07:42.165 01:00:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:42.165 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:42.165 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:07:42.165 00:07:42.165 --- 10.0.0.1 ping statistics --- 00:07:42.165 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:42.165 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:07:42.165 01:00:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:42.165 01:00:32 -- nvmf/common.sh@410 -- # return 0 00:07:42.165 01:00:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:42.165 01:00:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:42.165 01:00:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:42.165 01:00:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:42.165 01:00:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:42.165 01:00:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:42.165 01:00:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:42.165 01:00:32 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:42.165 01:00:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:42.165 01:00:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:42.165 01:00:32 -- common/autotest_common.sh@10 -- # set +x 00:07:42.165 01:00:32 -- nvmf/common.sh@469 -- # nvmfpid=959404 00:07:42.165 01:00:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:42.165 01:00:32 -- nvmf/common.sh@470 -- # waitforlisten 959404 00:07:42.165 01:00:32 -- common/autotest_common.sh@829 -- # '[' -z 959404 ']' 00:07:42.165 01:00:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:42.165 01:00:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:42.165 01:00:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:42.165 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:42.165 01:00:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:42.165 01:00:32 -- common/autotest_common.sh@10 -- # set +x 00:07:42.165 [2024-11-26 01:00:32.518359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:42.165 [2024-11-26 01:00:32.518432] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:42.165 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.165 [2024-11-26 01:00:32.587977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:42.423 [2024-11-26 01:00:32.707718] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:42.423 [2024-11-26 01:00:32.707886] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:42.423 [2024-11-26 01:00:32.707905] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:42.423 [2024-11-26 01:00:32.707920] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:42.423 [2024-11-26 01:00:32.708023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:42.423 [2024-11-26 01:00:32.708081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:42.423 [2024-11-26 01:00:32.708137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:42.423 [2024-11-26 01:00:32.708140] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:42.988 01:00:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:42.988 01:00:33 -- common/autotest_common.sh@862 -- # return 0 00:07:42.988 01:00:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:42.988 01:00:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:42.988 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:42.988 01:00:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:42.988 01:00:33 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:42.988 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.988 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:42.988 [2024-11-26 01:00:33.510323] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:42.988 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:42.988 01:00:33 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:42.988 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:42.988 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 [2024-11-26 01:00:33.522544] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:43.246 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:43.246 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:43.246 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:43.246 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.246 01:00:33 -- target/referrals.sh@48 -- # jq length 00:07:43.246 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:43.246 01:00:33 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:43.246 01:00:33 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:43.246 01:00:33 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.246 01:00:33 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:43.246 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.246 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.246 01:00:33 -- target/referrals.sh@21 -- # sort 00:07:43.246 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:43.246 01:00:33 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:43.246 01:00:33 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:43.246 01:00:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:43.246 01:00:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:43.246 01:00:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:43.246 01:00:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:43.246 01:00:33 -- target/referrals.sh@26 -- # sort 00:07:43.505 01:00:33 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:43.505 01:00:33 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:43.505 01:00:33 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:43.505 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.505 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.505 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.505 01:00:33 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:43.505 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.505 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.505 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.505 01:00:33 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:43.505 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.505 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.505 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.505 01:00:33 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.505 01:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.505 01:00:33 -- target/referrals.sh@56 -- # jq length 00:07:43.505 01:00:33 -- common/autotest_common.sh@10 -- # set +x 00:07:43.505 01:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.505 01:00:33 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:43.505 01:00:33 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:43.505 01:00:33 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:43.505 01:00:33 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:43.505 01:00:33 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:43.505 01:00:33 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:43.505 01:00:33 -- target/referrals.sh@26 -- # sort 00:07:43.762 01:00:34 -- target/referrals.sh@26 -- # echo 00:07:43.762 01:00:34 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:43.762 01:00:34 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:43.762 01:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.762 01:00:34 -- common/autotest_common.sh@10 -- # set +x 00:07:43.762 01:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.762 01:00:34 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:43.762 01:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.763 01:00:34 -- common/autotest_common.sh@10 -- # set +x 00:07:43.763 01:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.763 01:00:34 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:43.763 01:00:34 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:43.763 01:00:34 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:43.763 01:00:34 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:43.763 01:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.763 01:00:34 -- common/autotest_common.sh@10 -- # set +x 00:07:43.763 01:00:34 -- target/referrals.sh@21 -- # sort 00:07:43.763 01:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.763 01:00:34 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:43.763 01:00:34 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:43.763 01:00:34 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:43.763 01:00:34 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:43.763 01:00:34 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:43.763 01:00:34 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:43.763 01:00:34 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:43.763 01:00:34 -- target/referrals.sh@26 -- # sort 00:07:44.020 01:00:34 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:44.020 01:00:34 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:44.020 01:00:34 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:44.020 01:00:34 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:44.020 01:00:34 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:44.020 01:00:34 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:44.020 01:00:34 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:44.278 01:00:34 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:44.278 01:00:34 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:44.278 01:00:34 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:44.278 01:00:34 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:44.278 01:00:34 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:44.278 01:00:34 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:44.278 01:00:34 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:44.278 01:00:34 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:44.278 01:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.278 01:00:34 -- common/autotest_common.sh@10 -- # set +x 00:07:44.278 01:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.278 01:00:34 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:44.278 01:00:34 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:44.278 01:00:34 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:44.278 01:00:34 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:44.278 01:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.278 01:00:34 -- target/referrals.sh@21 -- # sort 00:07:44.278 01:00:34 -- common/autotest_common.sh@10 -- # set +x 00:07:44.278 01:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:44.278 01:00:34 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:44.278 01:00:34 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:44.278 01:00:34 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:44.278 01:00:34 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:44.278 01:00:34 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:44.278 01:00:34 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:44.278 01:00:34 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:44.278 01:00:34 -- target/referrals.sh@26 -- # sort 00:07:44.535 01:00:34 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:44.536 01:00:34 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:44.536 01:00:34 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:44.536 01:00:34 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:44.536 01:00:34 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:44.536 01:00:34 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:44.536 01:00:34 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:44.793 01:00:35 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:44.793 01:00:35 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:44.793 01:00:35 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:44.793 01:00:35 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:44.793 01:00:35 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:44.793 01:00:35 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:44.793 01:00:35 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:44.793 01:00:35 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:44.793 01:00:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:44.793 01:00:35 -- common/autotest_common.sh@10 -- # set +x 00:07:45.051 01:00:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.051 01:00:35 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:45.051 01:00:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:45.051 01:00:35 -- target/referrals.sh@82 -- # jq length 00:07:45.051 01:00:35 -- common/autotest_common.sh@10 -- # set +x 00:07:45.051 01:00:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:45.051 01:00:35 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:45.051 01:00:35 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:45.051 01:00:35 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:45.051 01:00:35 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:45.051 01:00:35 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:45.051 01:00:35 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:45.051 01:00:35 -- target/referrals.sh@26 -- # sort 00:07:45.344 01:00:35 -- target/referrals.sh@26 -- # echo 00:07:45.344 01:00:35 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:45.344 01:00:35 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:45.344 01:00:35 -- target/referrals.sh@86 -- # nvmftestfini 00:07:45.344 01:00:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:45.344 01:00:35 -- nvmf/common.sh@116 -- # sync 00:07:45.344 01:00:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:45.344 01:00:35 -- nvmf/common.sh@119 -- # set +e 00:07:45.344 01:00:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:45.344 01:00:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:45.344 rmmod nvme_tcp 00:07:45.344 rmmod nvme_fabrics 00:07:45.344 rmmod nvme_keyring 00:07:45.344 01:00:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:45.344 01:00:35 -- nvmf/common.sh@123 -- # set -e 00:07:45.344 01:00:35 -- nvmf/common.sh@124 -- # return 0 00:07:45.344 01:00:35 -- nvmf/common.sh@477 -- # '[' -n 959404 ']' 00:07:45.344 01:00:35 -- nvmf/common.sh@478 -- # killprocess 959404 00:07:45.344 01:00:35 -- common/autotest_common.sh@936 -- # '[' -z 959404 ']' 00:07:45.344 01:00:35 -- common/autotest_common.sh@940 -- # kill -0 959404 00:07:45.344 01:00:35 -- common/autotest_common.sh@941 -- # uname 00:07:45.344 01:00:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:45.344 01:00:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 959404 00:07:45.344 01:00:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:45.344 01:00:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:45.344 01:00:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 959404' 00:07:45.344 killing process with pid 959404 00:07:45.344 01:00:35 -- common/autotest_common.sh@955 -- # kill 959404 00:07:45.344 01:00:35 -- common/autotest_common.sh@960 -- # wait 959404 00:07:45.648 01:00:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:45.648 01:00:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:45.648 01:00:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:45.648 01:00:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:45.648 01:00:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:45.648 01:00:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:45.648 01:00:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:45.648 01:00:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:47.582 01:00:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:47.582 00:07:47.582 real 0m7.849s 00:07:47.582 user 0m14.494s 00:07:47.582 sys 0m2.264s 00:07:47.582 01:00:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.582 01:00:38 -- common/autotest_common.sh@10 -- # set +x 00:07:47.582 ************************************ 00:07:47.582 END TEST nvmf_referrals 00:07:47.582 ************************************ 00:07:47.582 01:00:38 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:47.582 01:00:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:47.582 01:00:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.582 01:00:38 -- common/autotest_common.sh@10 -- # set +x 00:07:47.582 ************************************ 00:07:47.582 START TEST nvmf_connect_disconnect 00:07:47.582 ************************************ 00:07:47.582 01:00:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:47.582 * Looking for test storage... 00:07:47.582 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.582 01:00:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.582 01:00:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.582 01:00:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:47.841 01:00:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:47.841 01:00:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:47.841 01:00:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:47.841 01:00:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:47.841 01:00:38 -- scripts/common.sh@335 -- # IFS=.-: 00:07:47.841 01:00:38 -- scripts/common.sh@335 -- # read -ra ver1 00:07:47.841 01:00:38 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.841 01:00:38 -- scripts/common.sh@336 -- # read -ra ver2 00:07:47.841 01:00:38 -- scripts/common.sh@337 -- # local 'op=<' 00:07:47.841 01:00:38 -- scripts/common.sh@339 -- # ver1_l=2 00:07:47.841 01:00:38 -- scripts/common.sh@340 -- # ver2_l=1 00:07:47.841 01:00:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:47.841 01:00:38 -- scripts/common.sh@343 -- # case "$op" in 00:07:47.841 01:00:38 -- scripts/common.sh@344 -- # : 1 00:07:47.841 01:00:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:47.841 01:00:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.841 01:00:38 -- scripts/common.sh@364 -- # decimal 1 00:07:47.841 01:00:38 -- scripts/common.sh@352 -- # local d=1 00:07:47.841 01:00:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.841 01:00:38 -- scripts/common.sh@354 -- # echo 1 00:07:47.841 01:00:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:47.841 01:00:38 -- scripts/common.sh@365 -- # decimal 2 00:07:47.841 01:00:38 -- scripts/common.sh@352 -- # local d=2 00:07:47.841 01:00:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.841 01:00:38 -- scripts/common.sh@354 -- # echo 2 00:07:47.841 01:00:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:47.841 01:00:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:47.841 01:00:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:47.841 01:00:38 -- scripts/common.sh@367 -- # return 0 00:07:47.841 01:00:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.841 01:00:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.841 --rc genhtml_branch_coverage=1 00:07:47.841 --rc genhtml_function_coverage=1 00:07:47.841 --rc genhtml_legend=1 00:07:47.841 --rc geninfo_all_blocks=1 00:07:47.841 --rc geninfo_unexecuted_blocks=1 00:07:47.841 00:07:47.841 ' 00:07:47.841 01:00:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.841 --rc genhtml_branch_coverage=1 00:07:47.841 --rc genhtml_function_coverage=1 00:07:47.841 --rc genhtml_legend=1 00:07:47.841 --rc geninfo_all_blocks=1 00:07:47.841 --rc geninfo_unexecuted_blocks=1 00:07:47.841 00:07:47.841 ' 00:07:47.841 01:00:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.841 --rc genhtml_branch_coverage=1 00:07:47.841 --rc genhtml_function_coverage=1 00:07:47.841 --rc genhtml_legend=1 00:07:47.841 --rc geninfo_all_blocks=1 00:07:47.841 --rc geninfo_unexecuted_blocks=1 00:07:47.841 00:07:47.841 ' 00:07:47.841 01:00:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:47.841 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.842 --rc genhtml_branch_coverage=1 00:07:47.842 --rc genhtml_function_coverage=1 00:07:47.842 --rc genhtml_legend=1 00:07:47.842 --rc geninfo_all_blocks=1 00:07:47.842 --rc geninfo_unexecuted_blocks=1 00:07:47.842 00:07:47.842 ' 00:07:47.842 01:00:38 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:47.842 01:00:38 -- nvmf/common.sh@7 -- # uname -s 00:07:47.842 01:00:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:47.842 01:00:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:47.842 01:00:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:47.842 01:00:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:47.842 01:00:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:47.842 01:00:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:47.842 01:00:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:47.842 01:00:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:47.842 01:00:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:47.842 01:00:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:47.842 01:00:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.842 01:00:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.842 01:00:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:47.842 01:00:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:47.842 01:00:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:47.842 01:00:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:47.842 01:00:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:47.842 01:00:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:47.842 01:00:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:47.842 01:00:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.842 01:00:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.842 01:00:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.842 01:00:38 -- paths/export.sh@5 -- # export PATH 00:07:47.842 01:00:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.842 01:00:38 -- nvmf/common.sh@46 -- # : 0 00:07:47.842 01:00:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:47.842 01:00:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:47.842 01:00:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:47.842 01:00:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:47.842 01:00:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:47.842 01:00:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:47.842 01:00:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:47.842 01:00:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:47.842 01:00:38 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:47.842 01:00:38 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:47.842 01:00:38 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:47.842 01:00:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:47.842 01:00:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:47.842 01:00:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:47.842 01:00:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:47.842 01:00:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:47.842 01:00:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:47.842 01:00:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:47.842 01:00:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:47.842 01:00:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:47.842 01:00:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:47.842 01:00:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:47.842 01:00:38 -- common/autotest_common.sh@10 -- # set +x 00:07:49.750 01:00:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:49.750 01:00:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:49.750 01:00:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:49.750 01:00:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:49.750 01:00:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:49.750 01:00:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:49.750 01:00:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:49.750 01:00:40 -- nvmf/common.sh@294 -- # net_devs=() 00:07:49.750 01:00:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:49.750 01:00:40 -- nvmf/common.sh@295 -- # e810=() 00:07:49.750 01:00:40 -- nvmf/common.sh@295 -- # local -ga e810 00:07:49.750 01:00:40 -- nvmf/common.sh@296 -- # x722=() 00:07:49.750 01:00:40 -- nvmf/common.sh@296 -- # local -ga x722 00:07:49.750 01:00:40 -- nvmf/common.sh@297 -- # mlx=() 00:07:49.750 01:00:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:49.750 01:00:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:49.750 01:00:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:49.750 01:00:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:49.750 01:00:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:49.751 01:00:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:49.751 01:00:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:49.751 01:00:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:49.751 01:00:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:49.751 01:00:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:49.751 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:49.751 01:00:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:49.751 01:00:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:49.751 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:49.751 01:00:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:49.751 01:00:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:49.751 01:00:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:49.751 01:00:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:49.751 01:00:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:49.751 01:00:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:49.751 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:49.751 01:00:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:49.751 01:00:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:49.751 01:00:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:49.751 01:00:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:49.751 01:00:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:49.751 01:00:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:49.751 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:49.751 01:00:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:49.751 01:00:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:49.751 01:00:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:49.751 01:00:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:49.751 01:00:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:49.751 01:00:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:49.751 01:00:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:49.751 01:00:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:49.751 01:00:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:49.751 01:00:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:49.751 01:00:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:49.751 01:00:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:49.751 01:00:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:49.751 01:00:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:49.751 01:00:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:49.751 01:00:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:49.751 01:00:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:50.009 01:00:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:50.009 01:00:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:50.009 01:00:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:50.009 01:00:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:50.010 01:00:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:50.010 01:00:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:50.010 01:00:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:50.010 01:00:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:50.010 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:50.010 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:07:50.010 00:07:50.010 --- 10.0.0.2 ping statistics --- 00:07:50.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:50.010 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:07:50.010 01:00:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:50.010 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:50.010 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:07:50.010 00:07:50.010 --- 10.0.0.1 ping statistics --- 00:07:50.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:50.010 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:07:50.010 01:00:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:50.010 01:00:40 -- nvmf/common.sh@410 -- # return 0 00:07:50.010 01:00:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:50.010 01:00:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:50.010 01:00:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:50.010 01:00:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:50.010 01:00:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:50.010 01:00:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:50.010 01:00:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:50.010 01:00:40 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:50.010 01:00:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:50.010 01:00:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:50.010 01:00:40 -- common/autotest_common.sh@10 -- # set +x 00:07:50.010 01:00:40 -- nvmf/common.sh@469 -- # nvmfpid=961870 00:07:50.010 01:00:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:50.010 01:00:40 -- nvmf/common.sh@470 -- # waitforlisten 961870 00:07:50.010 01:00:40 -- common/autotest_common.sh@829 -- # '[' -z 961870 ']' 00:07:50.010 01:00:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:50.010 01:00:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:50.010 01:00:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:50.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:50.010 01:00:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:50.010 01:00:40 -- common/autotest_common.sh@10 -- # set +x 00:07:50.010 [2024-11-26 01:00:40.479861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:50.010 [2024-11-26 01:00:40.479946] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:50.010 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.269 [2024-11-26 01:00:40.549571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:50.269 [2024-11-26 01:00:40.668787] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:50.269 [2024-11-26 01:00:40.668960] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:50.269 [2024-11-26 01:00:40.668982] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:50.269 [2024-11-26 01:00:40.668997] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:50.269 [2024-11-26 01:00:40.669175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:50.269 [2024-11-26 01:00:40.669220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:50.269 [2024-11-26 01:00:40.669271] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:50.269 [2024-11-26 01:00:40.669274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:51.200 01:00:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:51.200 01:00:41 -- common/autotest_common.sh@862 -- # return 0 00:07:51.200 01:00:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:51.200 01:00:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:51.200 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.200 01:00:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:51.200 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.200 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.200 [2024-11-26 01:00:41.527446] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:51.200 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:51.200 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.200 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.200 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:51.200 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.200 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.200 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:51.200 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.200 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.200 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:51.200 01:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.200 01:00:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.200 [2024-11-26 01:00:41.579097] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:51.200 01:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:51.200 01:00:41 -- target/connect_disconnect.sh@34 -- # set +x 00:07:53.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:56.258 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:58.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.683 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:03.212 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:05.111 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:10.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:12.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.595 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.121 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.016 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.544 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.070 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.604 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.631 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.054 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.579 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.484 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.380 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.904 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.430 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.955 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.854 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.382 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.910 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.332 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.324 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.851 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.378 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.276 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.802 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.225 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.751 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.805 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.702 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.756 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.655 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.181 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.707 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.232 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.125 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.653 [2024-11-26 01:02:44.839612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d60000 is same with the state(5) to be set 00:09:54.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.170 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.690 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.215 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.113 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:08.638 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.169 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.066 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.115 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.013 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.541 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.441 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.968 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.919 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.454 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.358 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.496 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.395 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.449 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.872 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.770 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.298 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.826 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.723 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.248 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.774 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.198 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.621 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.151 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.537 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.069 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.603 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.030 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.993 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.993 01:04:32 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:42.993 01:04:32 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:42.993 01:04:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:42.993 01:04:32 -- nvmf/common.sh@116 -- # sync 00:11:42.993 01:04:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:42.993 01:04:32 -- nvmf/common.sh@119 -- # set +e 00:11:42.993 01:04:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:42.993 01:04:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:42.993 rmmod nvme_tcp 00:11:42.993 rmmod nvme_fabrics 00:11:42.993 rmmod nvme_keyring 00:11:42.993 01:04:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:42.993 01:04:32 -- nvmf/common.sh@123 -- # set -e 00:11:42.993 01:04:32 -- nvmf/common.sh@124 -- # return 0 00:11:42.993 01:04:32 -- nvmf/common.sh@477 -- # '[' -n 961870 ']' 00:11:42.993 01:04:32 -- nvmf/common.sh@478 -- # killprocess 961870 00:11:42.993 01:04:32 -- common/autotest_common.sh@936 -- # '[' -z 961870 ']' 00:11:42.993 01:04:32 -- common/autotest_common.sh@940 -- # kill -0 961870 00:11:42.993 01:04:32 -- common/autotest_common.sh@941 -- # uname 00:11:42.993 01:04:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:42.993 01:04:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 961870 00:11:42.993 01:04:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:42.993 01:04:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:42.993 01:04:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 961870' 00:11:42.993 killing process with pid 961870 00:11:42.993 01:04:33 -- common/autotest_common.sh@955 -- # kill 961870 00:11:42.993 01:04:33 -- common/autotest_common.sh@960 -- # wait 961870 00:11:42.993 01:04:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:42.993 01:04:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:42.994 01:04:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:42.994 01:04:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:42.994 01:04:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:42.994 01:04:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:42.994 01:04:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:42.994 01:04:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:44.896 01:04:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:44.896 00:11:44.896 real 3m57.350s 00:11:44.896 user 15m5.355s 00:11:44.896 sys 0m33.993s 00:11:44.896 01:04:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:44.896 01:04:35 -- common/autotest_common.sh@10 -- # set +x 00:11:44.896 ************************************ 00:11:44.896 END TEST nvmf_connect_disconnect 00:11:44.896 ************************************ 00:11:44.896 01:04:35 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:44.896 01:04:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:44.896 01:04:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:44.896 01:04:35 -- common/autotest_common.sh@10 -- # set +x 00:11:44.896 ************************************ 00:11:44.896 START TEST nvmf_multitarget 00:11:44.896 ************************************ 00:11:44.896 01:04:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:45.155 * Looking for test storage... 00:11:45.155 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:45.155 01:04:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:45.155 01:04:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:45.155 01:04:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:45.155 01:04:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:45.155 01:04:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:45.155 01:04:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:45.155 01:04:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:45.155 01:04:35 -- scripts/common.sh@335 -- # IFS=.-: 00:11:45.155 01:04:35 -- scripts/common.sh@335 -- # read -ra ver1 00:11:45.155 01:04:35 -- scripts/common.sh@336 -- # IFS=.-: 00:11:45.155 01:04:35 -- scripts/common.sh@336 -- # read -ra ver2 00:11:45.155 01:04:35 -- scripts/common.sh@337 -- # local 'op=<' 00:11:45.155 01:04:35 -- scripts/common.sh@339 -- # ver1_l=2 00:11:45.155 01:04:35 -- scripts/common.sh@340 -- # ver2_l=1 00:11:45.155 01:04:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:45.155 01:04:35 -- scripts/common.sh@343 -- # case "$op" in 00:11:45.155 01:04:35 -- scripts/common.sh@344 -- # : 1 00:11:45.155 01:04:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:45.155 01:04:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:45.155 01:04:35 -- scripts/common.sh@364 -- # decimal 1 00:11:45.155 01:04:35 -- scripts/common.sh@352 -- # local d=1 00:11:45.155 01:04:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:45.155 01:04:35 -- scripts/common.sh@354 -- # echo 1 00:11:45.155 01:04:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:45.155 01:04:35 -- scripts/common.sh@365 -- # decimal 2 00:11:45.155 01:04:35 -- scripts/common.sh@352 -- # local d=2 00:11:45.155 01:04:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:45.155 01:04:35 -- scripts/common.sh@354 -- # echo 2 00:11:45.155 01:04:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:45.155 01:04:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:45.155 01:04:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:45.155 01:04:35 -- scripts/common.sh@367 -- # return 0 00:11:45.155 01:04:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:45.155 01:04:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:45.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:45.155 --rc genhtml_branch_coverage=1 00:11:45.155 --rc genhtml_function_coverage=1 00:11:45.155 --rc genhtml_legend=1 00:11:45.155 --rc geninfo_all_blocks=1 00:11:45.155 --rc geninfo_unexecuted_blocks=1 00:11:45.155 00:11:45.155 ' 00:11:45.155 01:04:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:45.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:45.155 --rc genhtml_branch_coverage=1 00:11:45.155 --rc genhtml_function_coverage=1 00:11:45.155 --rc genhtml_legend=1 00:11:45.155 --rc geninfo_all_blocks=1 00:11:45.155 --rc geninfo_unexecuted_blocks=1 00:11:45.155 00:11:45.155 ' 00:11:45.155 01:04:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:45.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:45.155 --rc genhtml_branch_coverage=1 00:11:45.155 --rc genhtml_function_coverage=1 00:11:45.155 --rc genhtml_legend=1 00:11:45.155 --rc geninfo_all_blocks=1 00:11:45.155 --rc geninfo_unexecuted_blocks=1 00:11:45.155 00:11:45.155 ' 00:11:45.155 01:04:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:45.155 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:45.155 --rc genhtml_branch_coverage=1 00:11:45.155 --rc genhtml_function_coverage=1 00:11:45.155 --rc genhtml_legend=1 00:11:45.155 --rc geninfo_all_blocks=1 00:11:45.155 --rc geninfo_unexecuted_blocks=1 00:11:45.155 00:11:45.155 ' 00:11:45.155 01:04:35 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:45.155 01:04:35 -- nvmf/common.sh@7 -- # uname -s 00:11:45.155 01:04:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:45.155 01:04:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:45.155 01:04:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:45.155 01:04:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:45.155 01:04:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:45.155 01:04:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:45.155 01:04:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:45.155 01:04:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:45.155 01:04:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:45.155 01:04:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:45.155 01:04:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:45.155 01:04:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:45.155 01:04:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:45.155 01:04:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:45.155 01:04:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:45.155 01:04:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:45.155 01:04:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:45.155 01:04:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:45.155 01:04:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:45.155 01:04:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:45.155 01:04:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:45.155 01:04:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:45.155 01:04:35 -- paths/export.sh@5 -- # export PATH 00:11:45.155 01:04:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:45.155 01:04:35 -- nvmf/common.sh@46 -- # : 0 00:11:45.155 01:04:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:45.155 01:04:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:45.155 01:04:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:45.155 01:04:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:45.155 01:04:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:45.155 01:04:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:45.155 01:04:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:45.155 01:04:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:45.156 01:04:35 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:45.156 01:04:35 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:45.156 01:04:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:45.156 01:04:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:45.156 01:04:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:45.156 01:04:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:45.156 01:04:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:45.156 01:04:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:45.156 01:04:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:45.156 01:04:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:45.156 01:04:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:45.156 01:04:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:45.156 01:04:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:45.156 01:04:35 -- common/autotest_common.sh@10 -- # set +x 00:11:47.058 01:04:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:47.058 01:04:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:47.058 01:04:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:47.058 01:04:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:47.058 01:04:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:47.058 01:04:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:47.058 01:04:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:47.058 01:04:37 -- nvmf/common.sh@294 -- # net_devs=() 00:11:47.058 01:04:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:47.058 01:04:37 -- nvmf/common.sh@295 -- # e810=() 00:11:47.058 01:04:37 -- nvmf/common.sh@295 -- # local -ga e810 00:11:47.058 01:04:37 -- nvmf/common.sh@296 -- # x722=() 00:11:47.058 01:04:37 -- nvmf/common.sh@296 -- # local -ga x722 00:11:47.058 01:04:37 -- nvmf/common.sh@297 -- # mlx=() 00:11:47.058 01:04:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:47.058 01:04:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:47.058 01:04:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:47.058 01:04:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:47.058 01:04:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:47.058 01:04:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:47.058 01:04:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:47.058 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:47.058 01:04:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:47.058 01:04:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:47.058 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:47.058 01:04:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:47.058 01:04:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:47.058 01:04:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:47.058 01:04:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:47.058 01:04:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:47.058 01:04:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:47.058 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:47.058 01:04:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:47.058 01:04:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:47.058 01:04:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:47.058 01:04:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:47.058 01:04:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:47.058 01:04:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:47.058 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:47.058 01:04:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:47.058 01:04:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:47.058 01:04:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:47.058 01:04:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:47.058 01:04:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:47.058 01:04:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:47.058 01:04:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:47.058 01:04:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:47.058 01:04:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:47.058 01:04:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:47.058 01:04:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:47.058 01:04:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:47.058 01:04:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:47.058 01:04:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:47.058 01:04:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:47.058 01:04:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:47.058 01:04:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:47.058 01:04:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:47.058 01:04:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:47.058 01:04:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:47.058 01:04:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:47.058 01:04:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:47.058 01:04:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:47.058 01:04:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:47.058 01:04:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:47.317 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:47.317 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:11:47.317 00:11:47.317 --- 10.0.0.2 ping statistics --- 00:11:47.317 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:47.317 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:11:47.317 01:04:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:47.317 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:47.317 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:11:47.317 00:11:47.317 --- 10.0.0.1 ping statistics --- 00:11:47.317 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:47.317 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:11:47.317 01:04:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:47.317 01:04:37 -- nvmf/common.sh@410 -- # return 0 00:11:47.317 01:04:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:47.317 01:04:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:47.317 01:04:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:47.317 01:04:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:47.317 01:04:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:47.317 01:04:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:47.317 01:04:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:47.317 01:04:37 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:47.317 01:04:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:47.317 01:04:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:47.317 01:04:37 -- common/autotest_common.sh@10 -- # set +x 00:11:47.317 01:04:37 -- nvmf/common.sh@469 -- # nvmfpid=993906 00:11:47.317 01:04:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:47.317 01:04:37 -- nvmf/common.sh@470 -- # waitforlisten 993906 00:11:47.317 01:04:37 -- common/autotest_common.sh@829 -- # '[' -z 993906 ']' 00:11:47.317 01:04:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:47.317 01:04:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:47.317 01:04:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:47.317 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:47.317 01:04:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:47.317 01:04:37 -- common/autotest_common.sh@10 -- # set +x 00:11:47.317 [2024-11-26 01:04:37.662058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:47.317 [2024-11-26 01:04:37.662125] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:47.317 EAL: No free 2048 kB hugepages reported on node 1 00:11:47.317 [2024-11-26 01:04:37.726634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:47.317 [2024-11-26 01:04:37.832214] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:47.317 [2024-11-26 01:04:37.832375] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:47.317 [2024-11-26 01:04:37.832409] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:47.317 [2024-11-26 01:04:37.832422] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:47.317 [2024-11-26 01:04:37.832602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:47.317 [2024-11-26 01:04:37.832629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:47.317 [2024-11-26 01:04:37.832681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:47.317 [2024-11-26 01:04:37.832684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:48.250 01:04:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:48.250 01:04:38 -- common/autotest_common.sh@862 -- # return 0 00:11:48.250 01:04:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:48.250 01:04:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:48.250 01:04:38 -- common/autotest_common.sh@10 -- # set +x 00:11:48.250 01:04:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:48.250 01:04:38 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:48.250 01:04:38 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:48.250 01:04:38 -- target/multitarget.sh@21 -- # jq length 00:11:48.508 01:04:38 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:48.508 01:04:38 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:48.508 "nvmf_tgt_1" 00:11:48.508 01:04:38 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:48.508 "nvmf_tgt_2" 00:11:48.508 01:04:39 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:48.508 01:04:39 -- target/multitarget.sh@28 -- # jq length 00:11:48.771 01:04:39 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:48.771 01:04:39 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:48.771 true 00:11:48.771 01:04:39 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:49.033 true 00:11:49.033 01:04:39 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:49.033 01:04:39 -- target/multitarget.sh@35 -- # jq length 00:11:49.033 01:04:39 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:49.033 01:04:39 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:49.033 01:04:39 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:49.033 01:04:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:49.033 01:04:39 -- nvmf/common.sh@116 -- # sync 00:11:49.033 01:04:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:49.033 01:04:39 -- nvmf/common.sh@119 -- # set +e 00:11:49.033 01:04:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:49.033 01:04:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:49.033 rmmod nvme_tcp 00:11:49.033 rmmod nvme_fabrics 00:11:49.033 rmmod nvme_keyring 00:11:49.033 01:04:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:49.033 01:04:39 -- nvmf/common.sh@123 -- # set -e 00:11:49.033 01:04:39 -- nvmf/common.sh@124 -- # return 0 00:11:49.033 01:04:39 -- nvmf/common.sh@477 -- # '[' -n 993906 ']' 00:11:49.033 01:04:39 -- nvmf/common.sh@478 -- # killprocess 993906 00:11:49.033 01:04:39 -- common/autotest_common.sh@936 -- # '[' -z 993906 ']' 00:11:49.033 01:04:39 -- common/autotest_common.sh@940 -- # kill -0 993906 00:11:49.033 01:04:39 -- common/autotest_common.sh@941 -- # uname 00:11:49.033 01:04:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:49.033 01:04:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 993906 00:11:49.291 01:04:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:49.291 01:04:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:49.291 01:04:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 993906' 00:11:49.291 killing process with pid 993906 00:11:49.291 01:04:39 -- common/autotest_common.sh@955 -- # kill 993906 00:11:49.291 01:04:39 -- common/autotest_common.sh@960 -- # wait 993906 00:11:49.551 01:04:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:49.551 01:04:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:49.551 01:04:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:49.551 01:04:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:49.551 01:04:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:49.551 01:04:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.551 01:04:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.551 01:04:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.460 01:04:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:51.460 00:11:51.460 real 0m6.491s 00:11:51.460 user 0m9.669s 00:11:51.460 sys 0m1.902s 00:11:51.460 01:04:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:51.460 01:04:41 -- common/autotest_common.sh@10 -- # set +x 00:11:51.460 ************************************ 00:11:51.460 END TEST nvmf_multitarget 00:11:51.460 ************************************ 00:11:51.460 01:04:41 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:51.460 01:04:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:51.460 01:04:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:51.460 01:04:41 -- common/autotest_common.sh@10 -- # set +x 00:11:51.460 ************************************ 00:11:51.460 START TEST nvmf_rpc 00:11:51.460 ************************************ 00:11:51.460 01:04:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:51.460 * Looking for test storage... 00:11:51.460 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:51.460 01:04:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:51.460 01:04:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:51.460 01:04:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:51.720 01:04:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:51.720 01:04:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:51.720 01:04:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:51.720 01:04:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:51.720 01:04:42 -- scripts/common.sh@335 -- # IFS=.-: 00:11:51.720 01:04:42 -- scripts/common.sh@335 -- # read -ra ver1 00:11:51.720 01:04:42 -- scripts/common.sh@336 -- # IFS=.-: 00:11:51.720 01:04:42 -- scripts/common.sh@336 -- # read -ra ver2 00:11:51.720 01:04:42 -- scripts/common.sh@337 -- # local 'op=<' 00:11:51.720 01:04:42 -- scripts/common.sh@339 -- # ver1_l=2 00:11:51.720 01:04:42 -- scripts/common.sh@340 -- # ver2_l=1 00:11:51.720 01:04:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:51.720 01:04:42 -- scripts/common.sh@343 -- # case "$op" in 00:11:51.720 01:04:42 -- scripts/common.sh@344 -- # : 1 00:11:51.720 01:04:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:51.720 01:04:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:51.720 01:04:42 -- scripts/common.sh@364 -- # decimal 1 00:11:51.720 01:04:42 -- scripts/common.sh@352 -- # local d=1 00:11:51.720 01:04:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:51.720 01:04:42 -- scripts/common.sh@354 -- # echo 1 00:11:51.720 01:04:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:51.720 01:04:42 -- scripts/common.sh@365 -- # decimal 2 00:11:51.720 01:04:42 -- scripts/common.sh@352 -- # local d=2 00:11:51.720 01:04:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:51.720 01:04:42 -- scripts/common.sh@354 -- # echo 2 00:11:51.720 01:04:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:51.720 01:04:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:51.720 01:04:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:51.720 01:04:42 -- scripts/common.sh@367 -- # return 0 00:11:51.720 01:04:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:51.720 01:04:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:51.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.720 --rc genhtml_branch_coverage=1 00:11:51.720 --rc genhtml_function_coverage=1 00:11:51.720 --rc genhtml_legend=1 00:11:51.720 --rc geninfo_all_blocks=1 00:11:51.720 --rc geninfo_unexecuted_blocks=1 00:11:51.720 00:11:51.720 ' 00:11:51.720 01:04:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:51.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.720 --rc genhtml_branch_coverage=1 00:11:51.720 --rc genhtml_function_coverage=1 00:11:51.720 --rc genhtml_legend=1 00:11:51.720 --rc geninfo_all_blocks=1 00:11:51.720 --rc geninfo_unexecuted_blocks=1 00:11:51.720 00:11:51.720 ' 00:11:51.720 01:04:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:51.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.720 --rc genhtml_branch_coverage=1 00:11:51.720 --rc genhtml_function_coverage=1 00:11:51.720 --rc genhtml_legend=1 00:11:51.720 --rc geninfo_all_blocks=1 00:11:51.720 --rc geninfo_unexecuted_blocks=1 00:11:51.720 00:11:51.720 ' 00:11:51.720 01:04:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:51.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.720 --rc genhtml_branch_coverage=1 00:11:51.720 --rc genhtml_function_coverage=1 00:11:51.720 --rc genhtml_legend=1 00:11:51.720 --rc geninfo_all_blocks=1 00:11:51.720 --rc geninfo_unexecuted_blocks=1 00:11:51.720 00:11:51.720 ' 00:11:51.720 01:04:42 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:51.720 01:04:42 -- nvmf/common.sh@7 -- # uname -s 00:11:51.720 01:04:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:51.720 01:04:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:51.720 01:04:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:51.720 01:04:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:51.720 01:04:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:51.720 01:04:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:51.720 01:04:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:51.720 01:04:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:51.720 01:04:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:51.720 01:04:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:51.720 01:04:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.720 01:04:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.720 01:04:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:51.720 01:04:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:51.720 01:04:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:51.720 01:04:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:51.720 01:04:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:51.720 01:04:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:51.720 01:04:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:51.720 01:04:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.720 01:04:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.720 01:04:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.720 01:04:42 -- paths/export.sh@5 -- # export PATH 00:11:51.720 01:04:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.720 01:04:42 -- nvmf/common.sh@46 -- # : 0 00:11:51.720 01:04:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:51.720 01:04:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:51.720 01:04:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:51.720 01:04:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:51.720 01:04:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:51.720 01:04:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:51.720 01:04:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:51.720 01:04:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:51.720 01:04:42 -- target/rpc.sh@11 -- # loops=5 00:11:51.720 01:04:42 -- target/rpc.sh@23 -- # nvmftestinit 00:11:51.720 01:04:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:51.720 01:04:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:51.720 01:04:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:51.720 01:04:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:51.720 01:04:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:51.721 01:04:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:51.721 01:04:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:51.721 01:04:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.721 01:04:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:51.721 01:04:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:51.721 01:04:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:51.721 01:04:42 -- common/autotest_common.sh@10 -- # set +x 00:11:54.252 01:04:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:54.252 01:04:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:54.252 01:04:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:54.252 01:04:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:54.252 01:04:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:54.252 01:04:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:54.252 01:04:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:54.252 01:04:44 -- nvmf/common.sh@294 -- # net_devs=() 00:11:54.252 01:04:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:54.252 01:04:44 -- nvmf/common.sh@295 -- # e810=() 00:11:54.252 01:04:44 -- nvmf/common.sh@295 -- # local -ga e810 00:11:54.252 01:04:44 -- nvmf/common.sh@296 -- # x722=() 00:11:54.252 01:04:44 -- nvmf/common.sh@296 -- # local -ga x722 00:11:54.252 01:04:44 -- nvmf/common.sh@297 -- # mlx=() 00:11:54.252 01:04:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:54.252 01:04:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:54.252 01:04:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:54.252 01:04:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:54.252 01:04:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:54.252 01:04:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:54.252 01:04:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:54.252 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:54.252 01:04:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:54.252 01:04:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:54.252 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:54.252 01:04:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:54.252 01:04:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:54.252 01:04:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:54.253 01:04:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:54.253 01:04:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:54.253 01:04:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:54.253 01:04:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:54.253 01:04:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:54.253 01:04:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:54.253 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:54.253 01:04:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:54.253 01:04:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:54.253 01:04:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:54.253 01:04:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:54.253 01:04:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:54.253 01:04:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:54.253 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:54.253 01:04:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:54.253 01:04:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:54.253 01:04:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:54.253 01:04:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:54.253 01:04:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:54.253 01:04:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:54.253 01:04:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:54.253 01:04:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:54.253 01:04:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:54.253 01:04:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:54.253 01:04:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:54.253 01:04:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:54.253 01:04:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:54.253 01:04:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:54.253 01:04:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:54.253 01:04:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:54.253 01:04:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:54.253 01:04:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:54.253 01:04:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:54.253 01:04:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:54.253 01:04:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:54.253 01:04:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:54.253 01:04:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:54.253 01:04:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:54.253 01:04:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:54.253 01:04:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:54.253 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:54.253 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:11:54.253 00:11:54.253 --- 10.0.0.2 ping statistics --- 00:11:54.253 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:54.253 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:11:54.253 01:04:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:54.253 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:54.253 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:11:54.253 00:11:54.253 --- 10.0.0.1 ping statistics --- 00:11:54.253 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:54.253 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:11:54.253 01:04:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:54.253 01:04:44 -- nvmf/common.sh@410 -- # return 0 00:11:54.253 01:04:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:54.253 01:04:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:54.253 01:04:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:54.253 01:04:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:54.253 01:04:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:54.253 01:04:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:54.253 01:04:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:54.253 01:04:44 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:11:54.253 01:04:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:54.253 01:04:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:54.253 01:04:44 -- common/autotest_common.sh@10 -- # set +x 00:11:54.253 01:04:44 -- nvmf/common.sh@469 -- # nvmfpid=996161 00:11:54.253 01:04:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:54.253 01:04:44 -- nvmf/common.sh@470 -- # waitforlisten 996161 00:11:54.253 01:04:44 -- common/autotest_common.sh@829 -- # '[' -z 996161 ']' 00:11:54.253 01:04:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:54.253 01:04:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:54.253 01:04:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:54.253 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:54.253 01:04:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:54.253 01:04:44 -- common/autotest_common.sh@10 -- # set +x 00:11:54.253 [2024-11-26 01:04:44.460047] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:54.253 [2024-11-26 01:04:44.460126] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:54.253 EAL: No free 2048 kB hugepages reported on node 1 00:11:54.253 [2024-11-26 01:04:44.520904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:54.253 [2024-11-26 01:04:44.625868] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:54.253 [2024-11-26 01:04:44.626018] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:54.253 [2024-11-26 01:04:44.626036] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:54.253 [2024-11-26 01:04:44.626049] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:54.253 [2024-11-26 01:04:44.626099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:54.253 [2024-11-26 01:04:44.626158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:54.253 [2024-11-26 01:04:44.626223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:54.253 [2024-11-26 01:04:44.626226] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:55.187 01:04:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:55.187 01:04:45 -- common/autotest_common.sh@862 -- # return 0 00:11:55.187 01:04:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:55.187 01:04:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:55.187 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.187 01:04:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:55.187 01:04:45 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:11:55.187 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.187 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.187 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.187 01:04:45 -- target/rpc.sh@26 -- # stats='{ 00:11:55.187 "tick_rate": 2700000000, 00:11:55.187 "poll_groups": [ 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_0", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [] 00:11:55.187 }, 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_1", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [] 00:11:55.187 }, 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_2", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [] 00:11:55.187 }, 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_3", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [] 00:11:55.187 } 00:11:55.187 ] 00:11:55.187 }' 00:11:55.187 01:04:45 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:11:55.187 01:04:45 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:11:55.187 01:04:45 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:11:55.187 01:04:45 -- target/rpc.sh@15 -- # wc -l 00:11:55.187 01:04:45 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:11:55.187 01:04:45 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:11:55.187 01:04:45 -- target/rpc.sh@29 -- # [[ null == null ]] 00:11:55.187 01:04:45 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:55.187 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.187 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.187 [2024-11-26 01:04:45.557634] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:55.187 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.187 01:04:45 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:11:55.187 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.187 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.187 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.187 01:04:45 -- target/rpc.sh@33 -- # stats='{ 00:11:55.187 "tick_rate": 2700000000, 00:11:55.187 "poll_groups": [ 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_0", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [ 00:11:55.187 { 00:11:55.187 "trtype": "TCP" 00:11:55.187 } 00:11:55.187 ] 00:11:55.187 }, 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_1", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [ 00:11:55.187 { 00:11:55.187 "trtype": "TCP" 00:11:55.187 } 00:11:55.187 ] 00:11:55.187 }, 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_2", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [ 00:11:55.187 { 00:11:55.187 "trtype": "TCP" 00:11:55.187 } 00:11:55.187 ] 00:11:55.187 }, 00:11:55.187 { 00:11:55.187 "name": "nvmf_tgt_poll_group_3", 00:11:55.187 "admin_qpairs": 0, 00:11:55.187 "io_qpairs": 0, 00:11:55.187 "current_admin_qpairs": 0, 00:11:55.187 "current_io_qpairs": 0, 00:11:55.187 "pending_bdev_io": 0, 00:11:55.187 "completed_nvme_io": 0, 00:11:55.187 "transports": [ 00:11:55.187 { 00:11:55.187 "trtype": "TCP" 00:11:55.187 } 00:11:55.187 ] 00:11:55.188 } 00:11:55.188 ] 00:11:55.188 }' 00:11:55.188 01:04:45 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:11:55.188 01:04:45 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:55.188 01:04:45 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:55.188 01:04:45 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:55.188 01:04:45 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:11:55.188 01:04:45 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:11:55.188 01:04:45 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:55.188 01:04:45 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:55.188 01:04:45 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:55.188 01:04:45 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:11:55.188 01:04:45 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:11:55.188 01:04:45 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:11:55.188 01:04:45 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:11:55.188 01:04:45 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:55.188 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.188 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.188 Malloc1 00:11:55.188 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.188 01:04:45 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:55.188 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.188 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.188 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.188 01:04:45 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:55.188 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.188 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.188 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.188 01:04:45 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:11:55.188 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.188 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.188 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.188 01:04:45 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:11:55.188 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.188 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.188 [2024-11-26 01:04:45.710978] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:11:55.188 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.188 01:04:45 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:55.188 01:04:45 -- common/autotest_common.sh@650 -- # local es=0 00:11:55.188 01:04:45 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:55.188 01:04:45 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:55.188 01:04:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:55.188 01:04:45 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:55.188 01:04:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:55.188 01:04:45 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:55.446 01:04:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:55.446 01:04:45 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:55.446 01:04:45 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:55.446 01:04:45 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:11:55.446 [2024-11-26 01:04:45.733365] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:55.446 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:55.446 could not add new controller: failed to write to nvme-fabrics device 00:11:55.446 01:04:45 -- common/autotest_common.sh@653 -- # es=1 00:11:55.446 01:04:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:55.446 01:04:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:55.446 01:04:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:55.446 01:04:45 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:55.446 01:04:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:55.446 01:04:45 -- common/autotest_common.sh@10 -- # set +x 00:11:55.446 01:04:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:55.446 01:04:45 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:56.012 01:04:46 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:11:56.012 01:04:46 -- common/autotest_common.sh@1187 -- # local i=0 00:11:56.012 01:04:46 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:56.012 01:04:46 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:56.012 01:04:46 -- common/autotest_common.sh@1194 -- # sleep 2 00:11:58.540 01:04:48 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:11:58.540 01:04:48 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:11:58.540 01:04:48 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:11:58.540 01:04:48 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:11:58.540 01:04:48 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:11:58.540 01:04:48 -- common/autotest_common.sh@1197 -- # return 0 00:11:58.540 01:04:48 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:58.540 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.540 01:04:48 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:58.540 01:04:48 -- common/autotest_common.sh@1208 -- # local i=0 00:11:58.540 01:04:48 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:11:58.540 01:04:48 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.540 01:04:48 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:11:58.540 01:04:48 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:58.540 01:04:48 -- common/autotest_common.sh@1220 -- # return 0 00:11:58.540 01:04:48 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:58.540 01:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.540 01:04:48 -- common/autotest_common.sh@10 -- # set +x 00:11:58.540 01:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.540 01:04:48 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.540 01:04:48 -- common/autotest_common.sh@650 -- # local es=0 00:11:58.540 01:04:48 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.540 01:04:48 -- common/autotest_common.sh@638 -- # local arg=nvme 00:11:58.540 01:04:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:58.540 01:04:48 -- common/autotest_common.sh@642 -- # type -t nvme 00:11:58.540 01:04:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:58.540 01:04:48 -- common/autotest_common.sh@644 -- # type -P nvme 00:11:58.540 01:04:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:58.540 01:04:48 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:11:58.540 01:04:48 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:11:58.540 01:04:48 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.540 [2024-11-26 01:04:48.553370] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:11:58.540 Failed to write to /dev/nvme-fabrics: Input/output error 00:11:58.540 could not add new controller: failed to write to nvme-fabrics device 00:11:58.540 01:04:48 -- common/autotest_common.sh@653 -- # es=1 00:11:58.540 01:04:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:58.540 01:04:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:58.540 01:04:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:58.540 01:04:48 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:11:58.540 01:04:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:58.540 01:04:48 -- common/autotest_common.sh@10 -- # set +x 00:11:58.540 01:04:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:58.540 01:04:48 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:11:58.797 01:04:49 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:11:58.797 01:04:49 -- common/autotest_common.sh@1187 -- # local i=0 00:11:58.797 01:04:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:11:58.797 01:04:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:11:58.797 01:04:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:00.695 01:04:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:00.695 01:04:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:00.695 01:04:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:00.695 01:04:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:00.695 01:04:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:00.695 01:04:51 -- common/autotest_common.sh@1197 -- # return 0 00:12:00.695 01:04:51 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:00.953 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.953 01:04:51 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:00.953 01:04:51 -- common/autotest_common.sh@1208 -- # local i=0 00:12:00.953 01:04:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:00.953 01:04:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:00.953 01:04:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:00.953 01:04:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:00.953 01:04:51 -- common/autotest_common.sh@1220 -- # return 0 00:12:00.953 01:04:51 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:00.953 01:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.953 01:04:51 -- common/autotest_common.sh@10 -- # set +x 00:12:00.953 01:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.953 01:04:51 -- target/rpc.sh@81 -- # seq 1 5 00:12:00.953 01:04:51 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:00.953 01:04:51 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:00.953 01:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.953 01:04:51 -- common/autotest_common.sh@10 -- # set +x 00:12:00.953 01:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.953 01:04:51 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:00.953 01:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.953 01:04:51 -- common/autotest_common.sh@10 -- # set +x 00:12:00.953 [2024-11-26 01:04:51.304162] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:00.953 01:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.953 01:04:51 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:00.953 01:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.953 01:04:51 -- common/autotest_common.sh@10 -- # set +x 00:12:00.953 01:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.953 01:04:51 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:00.953 01:04:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.953 01:04:51 -- common/autotest_common.sh@10 -- # set +x 00:12:00.953 01:04:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.953 01:04:51 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:01.518 01:04:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:01.518 01:04:52 -- common/autotest_common.sh@1187 -- # local i=0 00:12:01.518 01:04:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:01.518 01:04:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:01.518 01:04:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:04.151 01:04:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:04.151 01:04:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:04.151 01:04:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:04.151 01:04:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:04.151 01:04:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:04.151 01:04:54 -- common/autotest_common.sh@1197 -- # return 0 00:12:04.151 01:04:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:04.151 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.151 01:04:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:04.151 01:04:54 -- common/autotest_common.sh@1208 -- # local i=0 00:12:04.151 01:04:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:04.151 01:04:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.151 01:04:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:04.151 01:04:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.151 01:04:54 -- common/autotest_common.sh@1220 -- # return 0 00:12:04.151 01:04:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:04.151 01:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.151 01:04:54 -- common/autotest_common.sh@10 -- # set +x 00:12:04.151 01:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.151 01:04:54 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:04.152 01:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.152 01:04:54 -- common/autotest_common.sh@10 -- # set +x 00:12:04.152 01:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.152 01:04:54 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:04.152 01:04:54 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:04.152 01:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.152 01:04:54 -- common/autotest_common.sh@10 -- # set +x 00:12:04.152 01:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.152 01:04:54 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:04.152 01:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.152 01:04:54 -- common/autotest_common.sh@10 -- # set +x 00:12:04.152 [2024-11-26 01:04:54.161209] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:04.152 01:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.152 01:04:54 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:04.152 01:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.152 01:04:54 -- common/autotest_common.sh@10 -- # set +x 00:12:04.152 01:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.152 01:04:54 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:04.152 01:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.152 01:04:54 -- common/autotest_common.sh@10 -- # set +x 00:12:04.152 01:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.152 01:04:54 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.410 01:04:54 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:04.410 01:04:54 -- common/autotest_common.sh@1187 -- # local i=0 00:12:04.410 01:04:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:04.410 01:04:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:04.410 01:04:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:06.935 01:04:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:06.935 01:04:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:06.935 01:04:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:06.935 01:04:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:06.935 01:04:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:06.935 01:04:56 -- common/autotest_common.sh@1197 -- # return 0 00:12:06.935 01:04:56 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:06.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.935 01:04:56 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:06.935 01:04:56 -- common/autotest_common.sh@1208 -- # local i=0 00:12:06.935 01:04:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:06.935 01:04:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.935 01:04:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:06.935 01:04:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:06.935 01:04:56 -- common/autotest_common.sh@1220 -- # return 0 00:12:06.935 01:04:56 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:06.935 01:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.935 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:12:06.935 01:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.935 01:04:56 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:06.935 01:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.935 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:12:06.935 01:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.935 01:04:56 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:06.935 01:04:56 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:06.935 01:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.935 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:12:06.935 01:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.935 01:04:56 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:06.935 01:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.935 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:12:06.935 [2024-11-26 01:04:56.984453] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:06.935 01:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.936 01:04:56 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:06.936 01:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.936 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:12:06.936 01:04:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.936 01:04:56 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:06.936 01:04:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:06.936 01:04:56 -- common/autotest_common.sh@10 -- # set +x 00:12:06.936 01:04:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:06.936 01:04:57 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:07.193 01:04:57 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:07.193 01:04:57 -- common/autotest_common.sh@1187 -- # local i=0 00:12:07.193 01:04:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:07.193 01:04:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:07.193 01:04:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:09.718 01:04:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:09.718 01:04:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:09.718 01:04:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:09.718 01:04:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:09.718 01:04:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:09.718 01:04:59 -- common/autotest_common.sh@1197 -- # return 0 00:12:09.718 01:04:59 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:09.718 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.718 01:04:59 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:09.718 01:04:59 -- common/autotest_common.sh@1208 -- # local i=0 00:12:09.718 01:04:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:09.718 01:04:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.718 01:04:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:09.718 01:04:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:09.718 01:04:59 -- common/autotest_common.sh@1220 -- # return 0 00:12:09.718 01:04:59 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:09.718 01:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.718 01:04:59 -- common/autotest_common.sh@10 -- # set +x 00:12:09.718 01:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.718 01:04:59 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:09.718 01:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.718 01:04:59 -- common/autotest_common.sh@10 -- # set +x 00:12:09.718 01:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.718 01:04:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:09.718 01:04:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:09.718 01:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.718 01:04:59 -- common/autotest_common.sh@10 -- # set +x 00:12:09.718 01:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.718 01:04:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:09.718 01:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.718 01:04:59 -- common/autotest_common.sh@10 -- # set +x 00:12:09.718 [2024-11-26 01:04:59.841267] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:09.718 01:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.718 01:04:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:09.718 01:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.718 01:04:59 -- common/autotest_common.sh@10 -- # set +x 00:12:09.718 01:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.718 01:04:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:09.718 01:04:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.718 01:04:59 -- common/autotest_common.sh@10 -- # set +x 00:12:09.718 01:04:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.718 01:04:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:09.976 01:05:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:09.976 01:05:00 -- common/autotest_common.sh@1187 -- # local i=0 00:12:09.976 01:05:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:09.976 01:05:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:09.976 01:05:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:12.501 01:05:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:12.501 01:05:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:12.501 01:05:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:12.501 01:05:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:12.501 01:05:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:12.501 01:05:02 -- common/autotest_common.sh@1197 -- # return 0 00:12:12.501 01:05:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:12.501 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.501 01:05:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:12.501 01:05:02 -- common/autotest_common.sh@1208 -- # local i=0 00:12:12.501 01:05:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:12.501 01:05:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.501 01:05:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:12.501 01:05:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:12.501 01:05:02 -- common/autotest_common.sh@1220 -- # return 0 00:12:12.501 01:05:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:12.501 01:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.501 01:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:12.501 01:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.501 01:05:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:12.501 01:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.501 01:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:12.501 01:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.501 01:05:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:12.501 01:05:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:12.501 01:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.501 01:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:12.501 01:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.501 01:05:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:12.501 01:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.501 01:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:12.501 [2024-11-26 01:05:02.621835] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:12.501 01:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.501 01:05:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:12.501 01:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.501 01:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:12.501 01:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.501 01:05:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:12.501 01:05:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.501 01:05:02 -- common/autotest_common.sh@10 -- # set +x 00:12:12.501 01:05:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.501 01:05:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:12.759 01:05:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:12.759 01:05:03 -- common/autotest_common.sh@1187 -- # local i=0 00:12:12.759 01:05:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:12.759 01:05:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:12.759 01:05:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:15.286 01:05:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:15.286 01:05:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:15.286 01:05:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:15.286 01:05:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:15.286 01:05:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:15.286 01:05:05 -- common/autotest_common.sh@1197 -- # return 0 00:12:15.286 01:05:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:15.286 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.286 01:05:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:15.286 01:05:05 -- common/autotest_common.sh@1208 -- # local i=0 00:12:15.286 01:05:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:15.286 01:05:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:15.286 01:05:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:15.286 01:05:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:15.286 01:05:05 -- common/autotest_common.sh@1220 -- # return 0 00:12:15.286 01:05:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.286 01:05:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.286 01:05:05 -- target/rpc.sh@99 -- # seq 1 5 00:12:15.286 01:05:05 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:15.286 01:05:05 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.286 01:05:05 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 [2024-11-26 01:05:05.391022] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.286 01:05:05 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.286 01:05:05 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.286 01:05:05 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.286 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.286 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.286 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:15.287 01:05:05 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 [2024-11-26 01:05:05.439089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:15.287 01:05:05 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 [2024-11-26 01:05:05.487235] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:15.287 01:05:05 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 [2024-11-26 01:05:05.535393] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:15.287 01:05:05 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 [2024-11-26 01:05:05.583571] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:15.287 01:05:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.287 01:05:05 -- common/autotest_common.sh@10 -- # set +x 00:12:15.287 01:05:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.287 01:05:05 -- target/rpc.sh@110 -- # stats='{ 00:12:15.287 "tick_rate": 2700000000, 00:12:15.287 "poll_groups": [ 00:12:15.287 { 00:12:15.287 "name": "nvmf_tgt_poll_group_0", 00:12:15.287 "admin_qpairs": 2, 00:12:15.287 "io_qpairs": 84, 00:12:15.287 "current_admin_qpairs": 0, 00:12:15.287 "current_io_qpairs": 0, 00:12:15.287 "pending_bdev_io": 0, 00:12:15.287 "completed_nvme_io": 185, 00:12:15.287 "transports": [ 00:12:15.287 { 00:12:15.287 "trtype": "TCP" 00:12:15.287 } 00:12:15.287 ] 00:12:15.287 }, 00:12:15.287 { 00:12:15.287 "name": "nvmf_tgt_poll_group_1", 00:12:15.287 "admin_qpairs": 2, 00:12:15.287 "io_qpairs": 84, 00:12:15.287 "current_admin_qpairs": 0, 00:12:15.287 "current_io_qpairs": 0, 00:12:15.287 "pending_bdev_io": 0, 00:12:15.287 "completed_nvme_io": 86, 00:12:15.287 "transports": [ 00:12:15.287 { 00:12:15.287 "trtype": "TCP" 00:12:15.287 } 00:12:15.287 ] 00:12:15.287 }, 00:12:15.287 { 00:12:15.287 "name": "nvmf_tgt_poll_group_2", 00:12:15.287 "admin_qpairs": 1, 00:12:15.287 "io_qpairs": 84, 00:12:15.287 "current_admin_qpairs": 0, 00:12:15.287 "current_io_qpairs": 0, 00:12:15.287 "pending_bdev_io": 0, 00:12:15.288 "completed_nvme_io": 233, 00:12:15.288 "transports": [ 00:12:15.288 { 00:12:15.288 "trtype": "TCP" 00:12:15.288 } 00:12:15.288 ] 00:12:15.288 }, 00:12:15.288 { 00:12:15.288 "name": "nvmf_tgt_poll_group_3", 00:12:15.288 "admin_qpairs": 2, 00:12:15.288 "io_qpairs": 84, 00:12:15.288 "current_admin_qpairs": 0, 00:12:15.288 "current_io_qpairs": 0, 00:12:15.288 "pending_bdev_io": 0, 00:12:15.288 "completed_nvme_io": 182, 00:12:15.288 "transports": [ 00:12:15.288 { 00:12:15.288 "trtype": "TCP" 00:12:15.288 } 00:12:15.288 ] 00:12:15.288 } 00:12:15.288 ] 00:12:15.288 }' 00:12:15.288 01:05:05 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:15.288 01:05:05 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:15.288 01:05:05 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:15.288 01:05:05 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:15.288 01:05:05 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:15.288 01:05:05 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:15.288 01:05:05 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:15.288 01:05:05 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:15.288 01:05:05 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:15.288 01:05:05 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:15.288 01:05:05 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:15.288 01:05:05 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:15.288 01:05:05 -- target/rpc.sh@123 -- # nvmftestfini 00:12:15.288 01:05:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:15.288 01:05:05 -- nvmf/common.sh@116 -- # sync 00:12:15.288 01:05:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:15.288 01:05:05 -- nvmf/common.sh@119 -- # set +e 00:12:15.288 01:05:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:15.288 01:05:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:15.288 rmmod nvme_tcp 00:12:15.288 rmmod nvme_fabrics 00:12:15.288 rmmod nvme_keyring 00:12:15.288 01:05:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:15.288 01:05:05 -- nvmf/common.sh@123 -- # set -e 00:12:15.288 01:05:05 -- nvmf/common.sh@124 -- # return 0 00:12:15.288 01:05:05 -- nvmf/common.sh@477 -- # '[' -n 996161 ']' 00:12:15.288 01:05:05 -- nvmf/common.sh@478 -- # killprocess 996161 00:12:15.288 01:05:05 -- common/autotest_common.sh@936 -- # '[' -z 996161 ']' 00:12:15.288 01:05:05 -- common/autotest_common.sh@940 -- # kill -0 996161 00:12:15.288 01:05:05 -- common/autotest_common.sh@941 -- # uname 00:12:15.288 01:05:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:15.288 01:05:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 996161 00:12:15.546 01:05:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:15.546 01:05:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:15.546 01:05:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 996161' 00:12:15.546 killing process with pid 996161 00:12:15.546 01:05:05 -- common/autotest_common.sh@955 -- # kill 996161 00:12:15.546 01:05:05 -- common/autotest_common.sh@960 -- # wait 996161 00:12:15.806 01:05:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:15.806 01:05:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:15.806 01:05:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:15.806 01:05:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:15.806 01:05:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:15.806 01:05:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:15.806 01:05:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:15.806 01:05:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:17.710 01:05:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:17.710 00:12:17.710 real 0m26.246s 00:12:17.710 user 1m25.521s 00:12:17.710 sys 0m4.164s 00:12:17.710 01:05:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:17.710 01:05:08 -- common/autotest_common.sh@10 -- # set +x 00:12:17.710 ************************************ 00:12:17.710 END TEST nvmf_rpc 00:12:17.710 ************************************ 00:12:17.710 01:05:08 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:17.710 01:05:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:17.710 01:05:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:17.710 01:05:08 -- common/autotest_common.sh@10 -- # set +x 00:12:17.710 ************************************ 00:12:17.710 START TEST nvmf_invalid 00:12:17.710 ************************************ 00:12:17.710 01:05:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:17.969 * Looking for test storage... 00:12:17.969 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:17.969 01:05:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:17.969 01:05:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:17.969 01:05:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:17.969 01:05:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:17.969 01:05:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:17.969 01:05:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:17.969 01:05:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:17.969 01:05:08 -- scripts/common.sh@335 -- # IFS=.-: 00:12:17.969 01:05:08 -- scripts/common.sh@335 -- # read -ra ver1 00:12:17.969 01:05:08 -- scripts/common.sh@336 -- # IFS=.-: 00:12:17.969 01:05:08 -- scripts/common.sh@336 -- # read -ra ver2 00:12:17.969 01:05:08 -- scripts/common.sh@337 -- # local 'op=<' 00:12:17.969 01:05:08 -- scripts/common.sh@339 -- # ver1_l=2 00:12:17.969 01:05:08 -- scripts/common.sh@340 -- # ver2_l=1 00:12:17.969 01:05:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:17.969 01:05:08 -- scripts/common.sh@343 -- # case "$op" in 00:12:17.970 01:05:08 -- scripts/common.sh@344 -- # : 1 00:12:17.970 01:05:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:17.970 01:05:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:17.970 01:05:08 -- scripts/common.sh@364 -- # decimal 1 00:12:17.970 01:05:08 -- scripts/common.sh@352 -- # local d=1 00:12:17.970 01:05:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:17.970 01:05:08 -- scripts/common.sh@354 -- # echo 1 00:12:17.970 01:05:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:17.970 01:05:08 -- scripts/common.sh@365 -- # decimal 2 00:12:17.970 01:05:08 -- scripts/common.sh@352 -- # local d=2 00:12:17.970 01:05:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:17.970 01:05:08 -- scripts/common.sh@354 -- # echo 2 00:12:17.970 01:05:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:17.970 01:05:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:17.970 01:05:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:17.970 01:05:08 -- scripts/common.sh@367 -- # return 0 00:12:17.970 01:05:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:17.970 01:05:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:17.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:17.970 --rc genhtml_branch_coverage=1 00:12:17.970 --rc genhtml_function_coverage=1 00:12:17.970 --rc genhtml_legend=1 00:12:17.970 --rc geninfo_all_blocks=1 00:12:17.970 --rc geninfo_unexecuted_blocks=1 00:12:17.970 00:12:17.970 ' 00:12:17.970 01:05:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:17.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:17.970 --rc genhtml_branch_coverage=1 00:12:17.970 --rc genhtml_function_coverage=1 00:12:17.970 --rc genhtml_legend=1 00:12:17.970 --rc geninfo_all_blocks=1 00:12:17.970 --rc geninfo_unexecuted_blocks=1 00:12:17.970 00:12:17.970 ' 00:12:17.970 01:05:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:17.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:17.970 --rc genhtml_branch_coverage=1 00:12:17.970 --rc genhtml_function_coverage=1 00:12:17.970 --rc genhtml_legend=1 00:12:17.970 --rc geninfo_all_blocks=1 00:12:17.970 --rc geninfo_unexecuted_blocks=1 00:12:17.970 00:12:17.970 ' 00:12:17.970 01:05:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:17.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:17.970 --rc genhtml_branch_coverage=1 00:12:17.970 --rc genhtml_function_coverage=1 00:12:17.970 --rc genhtml_legend=1 00:12:17.970 --rc geninfo_all_blocks=1 00:12:17.970 --rc geninfo_unexecuted_blocks=1 00:12:17.970 00:12:17.970 ' 00:12:17.970 01:05:08 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:17.970 01:05:08 -- nvmf/common.sh@7 -- # uname -s 00:12:17.970 01:05:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:17.970 01:05:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:17.970 01:05:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:17.970 01:05:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:17.970 01:05:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:17.970 01:05:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:17.970 01:05:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:17.970 01:05:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:17.970 01:05:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:17.970 01:05:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:17.970 01:05:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:17.970 01:05:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:17.970 01:05:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:17.970 01:05:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:17.970 01:05:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:17.970 01:05:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:17.970 01:05:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:17.970 01:05:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:17.970 01:05:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:17.970 01:05:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.970 01:05:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.970 01:05:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.970 01:05:08 -- paths/export.sh@5 -- # export PATH 00:12:17.970 01:05:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:17.970 01:05:08 -- nvmf/common.sh@46 -- # : 0 00:12:17.970 01:05:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:17.970 01:05:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:17.970 01:05:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:17.970 01:05:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:17.970 01:05:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:17.970 01:05:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:17.970 01:05:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:17.970 01:05:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:17.970 01:05:08 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:17.970 01:05:08 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:17.970 01:05:08 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:17.970 01:05:08 -- target/invalid.sh@14 -- # target=foobar 00:12:17.970 01:05:08 -- target/invalid.sh@16 -- # RANDOM=0 00:12:17.970 01:05:08 -- target/invalid.sh@34 -- # nvmftestinit 00:12:17.970 01:05:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:17.970 01:05:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:17.970 01:05:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:17.970 01:05:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:17.970 01:05:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:17.970 01:05:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:17.970 01:05:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:17.970 01:05:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:17.970 01:05:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:17.970 01:05:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:17.970 01:05:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:17.970 01:05:08 -- common/autotest_common.sh@10 -- # set +x 00:12:20.505 01:05:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:20.506 01:05:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:20.506 01:05:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:20.506 01:05:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:20.506 01:05:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:20.506 01:05:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:20.506 01:05:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:20.506 01:05:10 -- nvmf/common.sh@294 -- # net_devs=() 00:12:20.506 01:05:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:20.506 01:05:10 -- nvmf/common.sh@295 -- # e810=() 00:12:20.506 01:05:10 -- nvmf/common.sh@295 -- # local -ga e810 00:12:20.506 01:05:10 -- nvmf/common.sh@296 -- # x722=() 00:12:20.506 01:05:10 -- nvmf/common.sh@296 -- # local -ga x722 00:12:20.506 01:05:10 -- nvmf/common.sh@297 -- # mlx=() 00:12:20.506 01:05:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:20.506 01:05:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:20.506 01:05:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:20.506 01:05:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:20.506 01:05:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:20.506 01:05:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:20.506 01:05:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:20.506 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:20.506 01:05:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:20.506 01:05:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:20.506 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:20.506 01:05:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:20.506 01:05:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:20.506 01:05:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:20.506 01:05:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:20.506 01:05:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:20.506 01:05:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:20.506 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:20.506 01:05:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:20.506 01:05:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:20.506 01:05:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:20.506 01:05:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:20.506 01:05:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:20.506 01:05:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:20.506 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:20.506 01:05:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:20.506 01:05:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:20.506 01:05:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:20.506 01:05:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:20.506 01:05:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:20.506 01:05:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:20.506 01:05:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:20.506 01:05:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:20.506 01:05:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:20.506 01:05:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:20.506 01:05:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:20.506 01:05:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:20.506 01:05:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:20.506 01:05:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:20.506 01:05:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:20.506 01:05:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:20.506 01:05:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:20.506 01:05:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:20.506 01:05:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:20.506 01:05:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:20.506 01:05:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:20.506 01:05:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:20.506 01:05:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:20.506 01:05:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:20.506 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:20.506 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.210 ms 00:12:20.506 00:12:20.506 --- 10.0.0.2 ping statistics --- 00:12:20.506 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:20.506 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:12:20.506 01:05:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:20.506 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:20.506 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:12:20.506 00:12:20.506 --- 10.0.0.1 ping statistics --- 00:12:20.506 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:20.506 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:12:20.506 01:05:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:20.506 01:05:10 -- nvmf/common.sh@410 -- # return 0 00:12:20.506 01:05:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:20.506 01:05:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:20.506 01:05:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:20.506 01:05:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:20.506 01:05:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:20.506 01:05:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:20.506 01:05:10 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:20.506 01:05:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:20.506 01:05:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:20.506 01:05:10 -- common/autotest_common.sh@10 -- # set +x 00:12:20.507 01:05:10 -- nvmf/common.sh@469 -- # nvmfpid=1000883 00:12:20.507 01:05:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:20.507 01:05:10 -- nvmf/common.sh@470 -- # waitforlisten 1000883 00:12:20.507 01:05:10 -- common/autotest_common.sh@829 -- # '[' -z 1000883 ']' 00:12:20.507 01:05:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:20.507 01:05:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:20.507 01:05:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:20.507 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:20.507 01:05:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:20.507 01:05:10 -- common/autotest_common.sh@10 -- # set +x 00:12:20.507 [2024-11-26 01:05:10.669189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:20.507 [2024-11-26 01:05:10.669253] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:20.507 EAL: No free 2048 kB hugepages reported on node 1 00:12:20.507 [2024-11-26 01:05:10.734593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:20.507 [2024-11-26 01:05:10.847365] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:20.507 [2024-11-26 01:05:10.847530] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:20.507 [2024-11-26 01:05:10.847548] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:20.507 [2024-11-26 01:05:10.847561] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:20.507 [2024-11-26 01:05:10.847630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:20.507 [2024-11-26 01:05:10.847698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:20.507 [2024-11-26 01:05:10.847752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:20.507 [2024-11-26 01:05:10.847755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:21.441 01:05:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:21.441 01:05:11 -- common/autotest_common.sh@862 -- # return 0 00:12:21.441 01:05:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:21.441 01:05:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:21.441 01:05:11 -- common/autotest_common.sh@10 -- # set +x 00:12:21.441 01:05:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:21.441 01:05:11 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:21.441 01:05:11 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode10379 00:12:21.441 [2024-11-26 01:05:11.959189] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:21.699 01:05:11 -- target/invalid.sh@40 -- # out='request: 00:12:21.699 { 00:12:21.699 "nqn": "nqn.2016-06.io.spdk:cnode10379", 00:12:21.699 "tgt_name": "foobar", 00:12:21.699 "method": "nvmf_create_subsystem", 00:12:21.699 "req_id": 1 00:12:21.699 } 00:12:21.699 Got JSON-RPC error response 00:12:21.699 response: 00:12:21.699 { 00:12:21.699 "code": -32603, 00:12:21.699 "message": "Unable to find target foobar" 00:12:21.699 }' 00:12:21.699 01:05:11 -- target/invalid.sh@41 -- # [[ request: 00:12:21.699 { 00:12:21.699 "nqn": "nqn.2016-06.io.spdk:cnode10379", 00:12:21.699 "tgt_name": "foobar", 00:12:21.699 "method": "nvmf_create_subsystem", 00:12:21.699 "req_id": 1 00:12:21.699 } 00:12:21.699 Got JSON-RPC error response 00:12:21.699 response: 00:12:21.699 { 00:12:21.699 "code": -32603, 00:12:21.699 "message": "Unable to find target foobar" 00:12:21.699 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:21.699 01:05:11 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:21.699 01:05:11 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode31890 00:12:21.957 [2024-11-26 01:05:12.244140] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31890: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:21.957 01:05:12 -- target/invalid.sh@45 -- # out='request: 00:12:21.957 { 00:12:21.957 "nqn": "nqn.2016-06.io.spdk:cnode31890", 00:12:21.957 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:21.957 "method": "nvmf_create_subsystem", 00:12:21.957 "req_id": 1 00:12:21.957 } 00:12:21.957 Got JSON-RPC error response 00:12:21.957 response: 00:12:21.957 { 00:12:21.957 "code": -32602, 00:12:21.957 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:21.957 }' 00:12:21.957 01:05:12 -- target/invalid.sh@46 -- # [[ request: 00:12:21.957 { 00:12:21.957 "nqn": "nqn.2016-06.io.spdk:cnode31890", 00:12:21.957 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:21.957 "method": "nvmf_create_subsystem", 00:12:21.957 "req_id": 1 00:12:21.957 } 00:12:21.957 Got JSON-RPC error response 00:12:21.957 response: 00:12:21.957 { 00:12:21.957 "code": -32602, 00:12:21.957 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:21.957 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:21.957 01:05:12 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:21.957 01:05:12 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode9419 00:12:21.957 [2024-11-26 01:05:12.488905] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9419: invalid model number 'SPDK_Controller' 00:12:22.215 01:05:12 -- target/invalid.sh@50 -- # out='request: 00:12:22.215 { 00:12:22.215 "nqn": "nqn.2016-06.io.spdk:cnode9419", 00:12:22.215 "model_number": "SPDK_Controller\u001f", 00:12:22.215 "method": "nvmf_create_subsystem", 00:12:22.215 "req_id": 1 00:12:22.215 } 00:12:22.215 Got JSON-RPC error response 00:12:22.215 response: 00:12:22.215 { 00:12:22.215 "code": -32602, 00:12:22.215 "message": "Invalid MN SPDK_Controller\u001f" 00:12:22.215 }' 00:12:22.215 01:05:12 -- target/invalid.sh@51 -- # [[ request: 00:12:22.215 { 00:12:22.215 "nqn": "nqn.2016-06.io.spdk:cnode9419", 00:12:22.215 "model_number": "SPDK_Controller\u001f", 00:12:22.215 "method": "nvmf_create_subsystem", 00:12:22.215 "req_id": 1 00:12:22.215 } 00:12:22.215 Got JSON-RPC error response 00:12:22.215 response: 00:12:22.215 { 00:12:22.215 "code": -32602, 00:12:22.215 "message": "Invalid MN SPDK_Controller\u001f" 00:12:22.215 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:22.215 01:05:12 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:22.215 01:05:12 -- target/invalid.sh@19 -- # local length=21 ll 00:12:22.215 01:05:12 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:22.215 01:05:12 -- target/invalid.sh@21 -- # local chars 00:12:22.215 01:05:12 -- target/invalid.sh@22 -- # local string 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 47 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=/ 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 68 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=D 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 83 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=S 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 106 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=j 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 40 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x28' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+='(' 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 34 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+='"' 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 100 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=d 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 114 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=r 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 69 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=E 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 98 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x62' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=b 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # printf %x 86 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:22.215 01:05:12 -- target/invalid.sh@25 -- # string+=V 00:12:22.215 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 83 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x53' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=S 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 74 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=J 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 75 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=K 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 72 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=H 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 77 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=M 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 56 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=8 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 49 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x31' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=1 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 37 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+=% 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 61 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+== 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # printf %x 125 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:12:22.216 01:05:12 -- target/invalid.sh@25 -- # string+='}' 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.216 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.216 01:05:12 -- target/invalid.sh@28 -- # [[ / == \- ]] 00:12:22.216 01:05:12 -- target/invalid.sh@31 -- # echo '/DSj("drEbVSJKHM81%=}' 00:12:22.216 01:05:12 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s '/DSj("drEbVSJKHM81%=}' nqn.2016-06.io.spdk:cnode30552 00:12:22.475 [2024-11-26 01:05:12.822014] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30552: invalid serial number '/DSj("drEbVSJKHM81%=}' 00:12:22.475 01:05:12 -- target/invalid.sh@54 -- # out='request: 00:12:22.475 { 00:12:22.475 "nqn": "nqn.2016-06.io.spdk:cnode30552", 00:12:22.475 "serial_number": "/DSj(\"drEbVSJKHM81%=}", 00:12:22.475 "method": "nvmf_create_subsystem", 00:12:22.475 "req_id": 1 00:12:22.475 } 00:12:22.475 Got JSON-RPC error response 00:12:22.475 response: 00:12:22.475 { 00:12:22.475 "code": -32602, 00:12:22.475 "message": "Invalid SN /DSj(\"drEbVSJKHM81%=}" 00:12:22.475 }' 00:12:22.475 01:05:12 -- target/invalid.sh@55 -- # [[ request: 00:12:22.475 { 00:12:22.475 "nqn": "nqn.2016-06.io.spdk:cnode30552", 00:12:22.475 "serial_number": "/DSj(\"drEbVSJKHM81%=}", 00:12:22.475 "method": "nvmf_create_subsystem", 00:12:22.475 "req_id": 1 00:12:22.475 } 00:12:22.475 Got JSON-RPC error response 00:12:22.475 response: 00:12:22.475 { 00:12:22.475 "code": -32602, 00:12:22.475 "message": "Invalid SN /DSj(\"drEbVSJKHM81%=}" 00:12:22.475 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:22.475 01:05:12 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:22.475 01:05:12 -- target/invalid.sh@19 -- # local length=41 ll 00:12:22.475 01:05:12 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:22.475 01:05:12 -- target/invalid.sh@21 -- # local chars 00:12:22.475 01:05:12 -- target/invalid.sh@22 -- # local string 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 117 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x75' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=u 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 113 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x71' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=q 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 41 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=')' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 42 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+='*' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 107 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=k 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 123 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+='{' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 88 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=X 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 34 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+='"' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 88 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=X 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 89 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=Y 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 68 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=D 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 41 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=')' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 75 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=K 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 70 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=F 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 114 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x72' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=r 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 107 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=k 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 90 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=Z 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 126 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x7e' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+='~' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 51 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=3 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 120 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x78' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=x 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 66 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=B 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 34 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+='"' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 41 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=')' 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # printf %x 89 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:22.475 01:05:12 -- target/invalid.sh@25 -- # string+=Y 00:12:22.475 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 85 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=U 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 64 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=@ 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 112 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x70' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=p 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 78 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=N 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 70 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=F 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 70 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x46' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=F 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 77 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=M 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 116 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=t 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 74 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=J 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 56 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=8 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 89 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=Y 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 100 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=d 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 77 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=M 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 84 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x54' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=T 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 47 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x2f' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=/ 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 65 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=A 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # printf %x 32 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:22.476 01:05:12 -- target/invalid.sh@25 -- # string+=' ' 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:22.476 01:05:12 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:22.476 01:05:12 -- target/invalid.sh@28 -- # [[ u == \- ]] 00:12:22.476 01:05:12 -- target/invalid.sh@31 -- # echo 'uq)*k{X"XYD)KFrkZ~3xB")YU@pNFFMtJ8YdMT/A ' 00:12:22.476 01:05:12 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'uq)*k{X"XYD)KFrkZ~3xB")YU@pNFFMtJ8YdMT/A ' nqn.2016-06.io.spdk:cnode28484 00:12:22.734 [2024-11-26 01:05:13.187183] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28484: invalid model number 'uq)*k{X"XYD)KFrkZ~3xB")YU@pNFFMtJ8YdMT/A ' 00:12:22.734 01:05:13 -- target/invalid.sh@58 -- # out='request: 00:12:22.734 { 00:12:22.734 "nqn": "nqn.2016-06.io.spdk:cnode28484", 00:12:22.734 "model_number": "uq)*k{X\"XYD)KFrkZ~3xB\")YU@pNFFMtJ8YdMT/A ", 00:12:22.734 "method": "nvmf_create_subsystem", 00:12:22.734 "req_id": 1 00:12:22.734 } 00:12:22.734 Got JSON-RPC error response 00:12:22.734 response: 00:12:22.734 { 00:12:22.734 "code": -32602, 00:12:22.734 "message": "Invalid MN uq)*k{X\"XYD)KFrkZ~3xB\")YU@pNFFMtJ8YdMT/A " 00:12:22.734 }' 00:12:22.734 01:05:13 -- target/invalid.sh@59 -- # [[ request: 00:12:22.734 { 00:12:22.734 "nqn": "nqn.2016-06.io.spdk:cnode28484", 00:12:22.734 "model_number": "uq)*k{X\"XYD)KFrkZ~3xB\")YU@pNFFMtJ8YdMT/A ", 00:12:22.734 "method": "nvmf_create_subsystem", 00:12:22.734 "req_id": 1 00:12:22.734 } 00:12:22.734 Got JSON-RPC error response 00:12:22.734 response: 00:12:22.734 { 00:12:22.734 "code": -32602, 00:12:22.734 "message": "Invalid MN uq)*k{X\"XYD)KFrkZ~3xB\")YU@pNFFMtJ8YdMT/A " 00:12:22.734 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:22.734 01:05:13 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:22.992 [2024-11-26 01:05:13.456170] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:22.992 01:05:13 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:23.249 01:05:13 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:23.249 01:05:13 -- target/invalid.sh@67 -- # echo '' 00:12:23.249 01:05:13 -- target/invalid.sh@67 -- # head -n 1 00:12:23.249 01:05:13 -- target/invalid.sh@67 -- # IP= 00:12:23.249 01:05:13 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:23.506 [2024-11-26 01:05:13.949823] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:23.506 01:05:13 -- target/invalid.sh@69 -- # out='request: 00:12:23.506 { 00:12:23.506 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:23.506 "listen_address": { 00:12:23.506 "trtype": "tcp", 00:12:23.506 "traddr": "", 00:12:23.506 "trsvcid": "4421" 00:12:23.506 }, 00:12:23.506 "method": "nvmf_subsystem_remove_listener", 00:12:23.506 "req_id": 1 00:12:23.506 } 00:12:23.506 Got JSON-RPC error response 00:12:23.506 response: 00:12:23.506 { 00:12:23.506 "code": -32602, 00:12:23.506 "message": "Invalid parameters" 00:12:23.506 }' 00:12:23.506 01:05:13 -- target/invalid.sh@70 -- # [[ request: 00:12:23.506 { 00:12:23.506 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:23.506 "listen_address": { 00:12:23.506 "trtype": "tcp", 00:12:23.506 "traddr": "", 00:12:23.506 "trsvcid": "4421" 00:12:23.506 }, 00:12:23.506 "method": "nvmf_subsystem_remove_listener", 00:12:23.506 "req_id": 1 00:12:23.506 } 00:12:23.506 Got JSON-RPC error response 00:12:23.506 response: 00:12:23.506 { 00:12:23.506 "code": -32602, 00:12:23.506 "message": "Invalid parameters" 00:12:23.506 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:23.506 01:05:13 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29061 -i 0 00:12:23.765 [2024-11-26 01:05:14.202577] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29061: invalid cntlid range [0-65519] 00:12:23.765 01:05:14 -- target/invalid.sh@73 -- # out='request: 00:12:23.765 { 00:12:23.765 "nqn": "nqn.2016-06.io.spdk:cnode29061", 00:12:23.765 "min_cntlid": 0, 00:12:23.765 "method": "nvmf_create_subsystem", 00:12:23.765 "req_id": 1 00:12:23.765 } 00:12:23.765 Got JSON-RPC error response 00:12:23.765 response: 00:12:23.765 { 00:12:23.765 "code": -32602, 00:12:23.765 "message": "Invalid cntlid range [0-65519]" 00:12:23.765 }' 00:12:23.765 01:05:14 -- target/invalid.sh@74 -- # [[ request: 00:12:23.765 { 00:12:23.765 "nqn": "nqn.2016-06.io.spdk:cnode29061", 00:12:23.765 "min_cntlid": 0, 00:12:23.765 "method": "nvmf_create_subsystem", 00:12:23.765 "req_id": 1 00:12:23.765 } 00:12:23.765 Got JSON-RPC error response 00:12:23.765 response: 00:12:23.765 { 00:12:23.765 "code": -32602, 00:12:23.765 "message": "Invalid cntlid range [0-65519]" 00:12:23.765 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:23.765 01:05:14 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode20063 -i 65520 00:12:24.022 [2024-11-26 01:05:14.467498] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20063: invalid cntlid range [65520-65519] 00:12:24.022 01:05:14 -- target/invalid.sh@75 -- # out='request: 00:12:24.022 { 00:12:24.022 "nqn": "nqn.2016-06.io.spdk:cnode20063", 00:12:24.022 "min_cntlid": 65520, 00:12:24.022 "method": "nvmf_create_subsystem", 00:12:24.022 "req_id": 1 00:12:24.022 } 00:12:24.022 Got JSON-RPC error response 00:12:24.022 response: 00:12:24.022 { 00:12:24.022 "code": -32602, 00:12:24.022 "message": "Invalid cntlid range [65520-65519]" 00:12:24.022 }' 00:12:24.022 01:05:14 -- target/invalid.sh@76 -- # [[ request: 00:12:24.022 { 00:12:24.022 "nqn": "nqn.2016-06.io.spdk:cnode20063", 00:12:24.023 "min_cntlid": 65520, 00:12:24.023 "method": "nvmf_create_subsystem", 00:12:24.023 "req_id": 1 00:12:24.023 } 00:12:24.023 Got JSON-RPC error response 00:12:24.023 response: 00:12:24.023 { 00:12:24.023 "code": -32602, 00:12:24.023 "message": "Invalid cntlid range [65520-65519]" 00:12:24.023 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:24.023 01:05:14 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode603 -I 0 00:12:24.280 [2024-11-26 01:05:14.712354] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode603: invalid cntlid range [1-0] 00:12:24.280 01:05:14 -- target/invalid.sh@77 -- # out='request: 00:12:24.280 { 00:12:24.280 "nqn": "nqn.2016-06.io.spdk:cnode603", 00:12:24.280 "max_cntlid": 0, 00:12:24.280 "method": "nvmf_create_subsystem", 00:12:24.280 "req_id": 1 00:12:24.280 } 00:12:24.280 Got JSON-RPC error response 00:12:24.280 response: 00:12:24.280 { 00:12:24.280 "code": -32602, 00:12:24.280 "message": "Invalid cntlid range [1-0]" 00:12:24.280 }' 00:12:24.280 01:05:14 -- target/invalid.sh@78 -- # [[ request: 00:12:24.280 { 00:12:24.280 "nqn": "nqn.2016-06.io.spdk:cnode603", 00:12:24.280 "max_cntlid": 0, 00:12:24.280 "method": "nvmf_create_subsystem", 00:12:24.280 "req_id": 1 00:12:24.280 } 00:12:24.280 Got JSON-RPC error response 00:12:24.280 response: 00:12:24.280 { 00:12:24.280 "code": -32602, 00:12:24.280 "message": "Invalid cntlid range [1-0]" 00:12:24.280 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:24.280 01:05:14 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode25184 -I 65520 00:12:24.538 [2024-11-26 01:05:14.965199] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode25184: invalid cntlid range [1-65520] 00:12:24.538 01:05:14 -- target/invalid.sh@79 -- # out='request: 00:12:24.538 { 00:12:24.538 "nqn": "nqn.2016-06.io.spdk:cnode25184", 00:12:24.538 "max_cntlid": 65520, 00:12:24.538 "method": "nvmf_create_subsystem", 00:12:24.538 "req_id": 1 00:12:24.538 } 00:12:24.538 Got JSON-RPC error response 00:12:24.538 response: 00:12:24.538 { 00:12:24.538 "code": -32602, 00:12:24.538 "message": "Invalid cntlid range [1-65520]" 00:12:24.538 }' 00:12:24.538 01:05:14 -- target/invalid.sh@80 -- # [[ request: 00:12:24.538 { 00:12:24.538 "nqn": "nqn.2016-06.io.spdk:cnode25184", 00:12:24.538 "max_cntlid": 65520, 00:12:24.538 "method": "nvmf_create_subsystem", 00:12:24.538 "req_id": 1 00:12:24.538 } 00:12:24.538 Got JSON-RPC error response 00:12:24.538 response: 00:12:24.538 { 00:12:24.538 "code": -32602, 00:12:24.538 "message": "Invalid cntlid range [1-65520]" 00:12:24.538 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:24.538 01:05:14 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17899 -i 6 -I 5 00:12:24.796 [2024-11-26 01:05:15.210081] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17899: invalid cntlid range [6-5] 00:12:24.796 01:05:15 -- target/invalid.sh@83 -- # out='request: 00:12:24.796 { 00:12:24.796 "nqn": "nqn.2016-06.io.spdk:cnode17899", 00:12:24.796 "min_cntlid": 6, 00:12:24.796 "max_cntlid": 5, 00:12:24.796 "method": "nvmf_create_subsystem", 00:12:24.796 "req_id": 1 00:12:24.796 } 00:12:24.796 Got JSON-RPC error response 00:12:24.796 response: 00:12:24.796 { 00:12:24.796 "code": -32602, 00:12:24.796 "message": "Invalid cntlid range [6-5]" 00:12:24.796 }' 00:12:24.796 01:05:15 -- target/invalid.sh@84 -- # [[ request: 00:12:24.796 { 00:12:24.796 "nqn": "nqn.2016-06.io.spdk:cnode17899", 00:12:24.796 "min_cntlid": 6, 00:12:24.796 "max_cntlid": 5, 00:12:24.796 "method": "nvmf_create_subsystem", 00:12:24.796 "req_id": 1 00:12:24.796 } 00:12:24.796 Got JSON-RPC error response 00:12:24.796 response: 00:12:24.796 { 00:12:24.796 "code": -32602, 00:12:24.796 "message": "Invalid cntlid range [6-5]" 00:12:24.796 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:24.796 01:05:15 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:25.054 01:05:15 -- target/invalid.sh@87 -- # out='request: 00:12:25.054 { 00:12:25.054 "name": "foobar", 00:12:25.054 "method": "nvmf_delete_target", 00:12:25.054 "req_id": 1 00:12:25.054 } 00:12:25.054 Got JSON-RPC error response 00:12:25.054 response: 00:12:25.054 { 00:12:25.054 "code": -32602, 00:12:25.054 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:25.054 }' 00:12:25.054 01:05:15 -- target/invalid.sh@88 -- # [[ request: 00:12:25.054 { 00:12:25.054 "name": "foobar", 00:12:25.054 "method": "nvmf_delete_target", 00:12:25.054 "req_id": 1 00:12:25.054 } 00:12:25.054 Got JSON-RPC error response 00:12:25.054 response: 00:12:25.054 { 00:12:25.054 "code": -32602, 00:12:25.054 "message": "The specified target doesn't exist, cannot delete it." 00:12:25.054 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:25.054 01:05:15 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:25.054 01:05:15 -- target/invalid.sh@91 -- # nvmftestfini 00:12:25.054 01:05:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:25.054 01:05:15 -- nvmf/common.sh@116 -- # sync 00:12:25.054 01:05:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:25.054 01:05:15 -- nvmf/common.sh@119 -- # set +e 00:12:25.054 01:05:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:25.054 01:05:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:25.054 rmmod nvme_tcp 00:12:25.054 rmmod nvme_fabrics 00:12:25.054 rmmod nvme_keyring 00:12:25.054 01:05:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:25.054 01:05:15 -- nvmf/common.sh@123 -- # set -e 00:12:25.054 01:05:15 -- nvmf/common.sh@124 -- # return 0 00:12:25.054 01:05:15 -- nvmf/common.sh@477 -- # '[' -n 1000883 ']' 00:12:25.054 01:05:15 -- nvmf/common.sh@478 -- # killprocess 1000883 00:12:25.054 01:05:15 -- common/autotest_common.sh@936 -- # '[' -z 1000883 ']' 00:12:25.054 01:05:15 -- common/autotest_common.sh@940 -- # kill -0 1000883 00:12:25.054 01:05:15 -- common/autotest_common.sh@941 -- # uname 00:12:25.054 01:05:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:25.054 01:05:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1000883 00:12:25.054 01:05:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:25.054 01:05:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:25.054 01:05:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1000883' 00:12:25.054 killing process with pid 1000883 00:12:25.054 01:05:15 -- common/autotest_common.sh@955 -- # kill 1000883 00:12:25.054 01:05:15 -- common/autotest_common.sh@960 -- # wait 1000883 00:12:25.314 01:05:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:25.314 01:05:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:25.314 01:05:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:25.314 01:05:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:25.314 01:05:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:25.314 01:05:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:25.314 01:05:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:25.314 01:05:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.220 01:05:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:27.220 00:12:27.221 real 0m9.545s 00:12:27.221 user 0m23.269s 00:12:27.221 sys 0m2.519s 00:12:27.221 01:05:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:27.221 01:05:17 -- common/autotest_common.sh@10 -- # set +x 00:12:27.221 ************************************ 00:12:27.221 END TEST nvmf_invalid 00:12:27.221 ************************************ 00:12:27.479 01:05:17 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:27.480 01:05:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:27.480 01:05:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:27.480 01:05:17 -- common/autotest_common.sh@10 -- # set +x 00:12:27.480 ************************************ 00:12:27.480 START TEST nvmf_abort 00:12:27.480 ************************************ 00:12:27.480 01:05:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:27.480 * Looking for test storage... 00:12:27.480 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:27.480 01:05:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:27.480 01:05:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:27.480 01:05:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:27.480 01:05:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:27.480 01:05:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:27.480 01:05:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:27.480 01:05:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:27.480 01:05:17 -- scripts/common.sh@335 -- # IFS=.-: 00:12:27.480 01:05:17 -- scripts/common.sh@335 -- # read -ra ver1 00:12:27.480 01:05:17 -- scripts/common.sh@336 -- # IFS=.-: 00:12:27.480 01:05:17 -- scripts/common.sh@336 -- # read -ra ver2 00:12:27.480 01:05:17 -- scripts/common.sh@337 -- # local 'op=<' 00:12:27.480 01:05:17 -- scripts/common.sh@339 -- # ver1_l=2 00:12:27.480 01:05:17 -- scripts/common.sh@340 -- # ver2_l=1 00:12:27.480 01:05:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:27.480 01:05:17 -- scripts/common.sh@343 -- # case "$op" in 00:12:27.480 01:05:17 -- scripts/common.sh@344 -- # : 1 00:12:27.480 01:05:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:27.480 01:05:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:27.480 01:05:17 -- scripts/common.sh@364 -- # decimal 1 00:12:27.480 01:05:17 -- scripts/common.sh@352 -- # local d=1 00:12:27.480 01:05:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:27.480 01:05:17 -- scripts/common.sh@354 -- # echo 1 00:12:27.480 01:05:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:27.480 01:05:17 -- scripts/common.sh@365 -- # decimal 2 00:12:27.480 01:05:17 -- scripts/common.sh@352 -- # local d=2 00:12:27.480 01:05:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:27.480 01:05:17 -- scripts/common.sh@354 -- # echo 2 00:12:27.480 01:05:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:27.480 01:05:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:27.480 01:05:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:27.480 01:05:17 -- scripts/common.sh@367 -- # return 0 00:12:27.480 01:05:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:27.480 01:05:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:27.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.480 --rc genhtml_branch_coverage=1 00:12:27.480 --rc genhtml_function_coverage=1 00:12:27.480 --rc genhtml_legend=1 00:12:27.480 --rc geninfo_all_blocks=1 00:12:27.480 --rc geninfo_unexecuted_blocks=1 00:12:27.480 00:12:27.480 ' 00:12:27.480 01:05:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:27.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.480 --rc genhtml_branch_coverage=1 00:12:27.480 --rc genhtml_function_coverage=1 00:12:27.480 --rc genhtml_legend=1 00:12:27.480 --rc geninfo_all_blocks=1 00:12:27.480 --rc geninfo_unexecuted_blocks=1 00:12:27.480 00:12:27.480 ' 00:12:27.480 01:05:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:27.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.480 --rc genhtml_branch_coverage=1 00:12:27.480 --rc genhtml_function_coverage=1 00:12:27.480 --rc genhtml_legend=1 00:12:27.480 --rc geninfo_all_blocks=1 00:12:27.480 --rc geninfo_unexecuted_blocks=1 00:12:27.480 00:12:27.480 ' 00:12:27.480 01:05:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:27.480 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:27.480 --rc genhtml_branch_coverage=1 00:12:27.480 --rc genhtml_function_coverage=1 00:12:27.480 --rc genhtml_legend=1 00:12:27.480 --rc geninfo_all_blocks=1 00:12:27.480 --rc geninfo_unexecuted_blocks=1 00:12:27.480 00:12:27.480 ' 00:12:27.480 01:05:17 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:27.480 01:05:17 -- nvmf/common.sh@7 -- # uname -s 00:12:27.480 01:05:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:27.480 01:05:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:27.480 01:05:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:27.480 01:05:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:27.480 01:05:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:27.480 01:05:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:27.480 01:05:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:27.480 01:05:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:27.480 01:05:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:27.480 01:05:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:27.480 01:05:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:27.480 01:05:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:27.480 01:05:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:27.480 01:05:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:27.480 01:05:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:27.480 01:05:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:27.480 01:05:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:27.480 01:05:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:27.480 01:05:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:27.480 01:05:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.480 01:05:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.480 01:05:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.480 01:05:17 -- paths/export.sh@5 -- # export PATH 00:12:27.480 01:05:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:27.480 01:05:17 -- nvmf/common.sh@46 -- # : 0 00:12:27.480 01:05:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:27.480 01:05:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:27.480 01:05:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:27.480 01:05:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:27.480 01:05:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:27.480 01:05:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:27.480 01:05:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:27.480 01:05:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:27.480 01:05:17 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:27.480 01:05:17 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:27.480 01:05:17 -- target/abort.sh@14 -- # nvmftestinit 00:12:27.480 01:05:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:27.480 01:05:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:27.480 01:05:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:27.480 01:05:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:27.480 01:05:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:27.480 01:05:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:27.480 01:05:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:27.480 01:05:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:27.480 01:05:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:27.480 01:05:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:27.480 01:05:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:27.480 01:05:17 -- common/autotest_common.sh@10 -- # set +x 00:12:29.387 01:05:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:29.387 01:05:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:29.387 01:05:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:29.387 01:05:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:29.387 01:05:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:29.387 01:05:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:29.387 01:05:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:29.388 01:05:19 -- nvmf/common.sh@294 -- # net_devs=() 00:12:29.388 01:05:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:29.388 01:05:19 -- nvmf/common.sh@295 -- # e810=() 00:12:29.388 01:05:19 -- nvmf/common.sh@295 -- # local -ga e810 00:12:29.388 01:05:19 -- nvmf/common.sh@296 -- # x722=() 00:12:29.388 01:05:19 -- nvmf/common.sh@296 -- # local -ga x722 00:12:29.388 01:05:19 -- nvmf/common.sh@297 -- # mlx=() 00:12:29.388 01:05:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:29.388 01:05:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:29.388 01:05:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:29.388 01:05:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:29.388 01:05:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:29.388 01:05:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:29.388 01:05:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:29.388 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:29.388 01:05:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:29.388 01:05:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:29.388 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:29.388 01:05:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:29.388 01:05:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:29.388 01:05:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:29.388 01:05:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:29.388 01:05:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:29.388 01:05:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:29.388 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:29.388 01:05:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:29.388 01:05:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:29.388 01:05:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:29.388 01:05:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:29.388 01:05:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:29.388 01:05:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:29.388 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:29.388 01:05:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:29.388 01:05:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:29.388 01:05:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:29.388 01:05:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:29.388 01:05:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:29.388 01:05:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:29.388 01:05:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:29.388 01:05:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:29.388 01:05:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:29.388 01:05:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:29.388 01:05:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:29.388 01:05:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:29.388 01:05:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:29.388 01:05:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:29.388 01:05:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:29.388 01:05:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:29.388 01:05:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:29.388 01:05:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:29.388 01:05:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:29.388 01:05:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:29.388 01:05:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:29.388 01:05:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:29.388 01:05:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:29.388 01:05:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:29.388 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:29.388 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.231 ms 00:12:29.388 00:12:29.388 --- 10.0.0.2 ping statistics --- 00:12:29.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:29.388 rtt min/avg/max/mdev = 0.231/0.231/0.231/0.000 ms 00:12:29.388 01:05:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:29.388 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:29.388 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:12:29.388 00:12:29.388 --- 10.0.0.1 ping statistics --- 00:12:29.388 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:29.388 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:12:29.388 01:05:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:29.388 01:05:19 -- nvmf/common.sh@410 -- # return 0 00:12:29.388 01:05:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:29.388 01:05:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:29.388 01:05:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:29.388 01:05:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:29.388 01:05:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:29.388 01:05:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:29.646 01:05:19 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:29.646 01:05:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:29.646 01:05:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:29.646 01:05:19 -- common/autotest_common.sh@10 -- # set +x 00:12:29.646 01:05:19 -- nvmf/common.sh@469 -- # nvmfpid=1003557 00:12:29.646 01:05:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:29.646 01:05:19 -- nvmf/common.sh@470 -- # waitforlisten 1003557 00:12:29.646 01:05:19 -- common/autotest_common.sh@829 -- # '[' -z 1003557 ']' 00:12:29.646 01:05:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:29.646 01:05:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:29.646 01:05:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:29.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:29.646 01:05:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:29.646 01:05:19 -- common/autotest_common.sh@10 -- # set +x 00:12:29.646 [2024-11-26 01:05:19.971514] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:29.646 [2024-11-26 01:05:19.971586] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:29.646 EAL: No free 2048 kB hugepages reported on node 1 00:12:29.646 [2024-11-26 01:05:20.040368] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:29.646 [2024-11-26 01:05:20.161441] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:29.646 [2024-11-26 01:05:20.161616] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:29.646 [2024-11-26 01:05:20.161636] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:29.646 [2024-11-26 01:05:20.161650] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:29.646 [2024-11-26 01:05:20.161728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:29.646 [2024-11-26 01:05:20.161786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:29.646 [2024-11-26 01:05:20.161789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:30.580 01:05:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:30.580 01:05:20 -- common/autotest_common.sh@862 -- # return 0 00:12:30.580 01:05:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:30.580 01:05:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:30.580 01:05:20 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 01:05:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:30.580 01:05:20 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 [2024-11-26 01:05:21.004087] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 Malloc0 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 Delay0 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 [2024-11-26 01:05:21.069771] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:30.580 01:05:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.580 01:05:21 -- common/autotest_common.sh@10 -- # set +x 00:12:30.580 01:05:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.580 01:05:21 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:30.580 EAL: No free 2048 kB hugepages reported on node 1 00:12:30.838 [2024-11-26 01:05:21.134645] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:33.366 Initializing NVMe Controllers 00:12:33.366 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:33.366 controller IO queue size 128 less than required 00:12:33.366 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:33.366 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:33.366 Initialization complete. Launching workers. 00:12:33.366 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 34433 00:12:33.366 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34498, failed to submit 62 00:12:33.366 success 34433, unsuccess 65, failed 0 00:12:33.366 01:05:23 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:33.366 01:05:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.366 01:05:23 -- common/autotest_common.sh@10 -- # set +x 00:12:33.366 01:05:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.366 01:05:23 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:33.366 01:05:23 -- target/abort.sh@38 -- # nvmftestfini 00:12:33.366 01:05:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:33.366 01:05:23 -- nvmf/common.sh@116 -- # sync 00:12:33.366 01:05:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:33.366 01:05:23 -- nvmf/common.sh@119 -- # set +e 00:12:33.366 01:05:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:33.366 01:05:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:33.366 rmmod nvme_tcp 00:12:33.366 rmmod nvme_fabrics 00:12:33.366 rmmod nvme_keyring 00:12:33.366 01:05:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:33.366 01:05:23 -- nvmf/common.sh@123 -- # set -e 00:12:33.366 01:05:23 -- nvmf/common.sh@124 -- # return 0 00:12:33.366 01:05:23 -- nvmf/common.sh@477 -- # '[' -n 1003557 ']' 00:12:33.366 01:05:23 -- nvmf/common.sh@478 -- # killprocess 1003557 00:12:33.366 01:05:23 -- common/autotest_common.sh@936 -- # '[' -z 1003557 ']' 00:12:33.366 01:05:23 -- common/autotest_common.sh@940 -- # kill -0 1003557 00:12:33.366 01:05:23 -- common/autotest_common.sh@941 -- # uname 00:12:33.366 01:05:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:33.366 01:05:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1003557 00:12:33.366 01:05:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:33.366 01:05:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:33.366 01:05:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1003557' 00:12:33.366 killing process with pid 1003557 00:12:33.366 01:05:23 -- common/autotest_common.sh@955 -- # kill 1003557 00:12:33.366 01:05:23 -- common/autotest_common.sh@960 -- # wait 1003557 00:12:33.366 01:05:23 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:33.366 01:05:23 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:33.366 01:05:23 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:33.366 01:05:23 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:33.366 01:05:23 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:33.366 01:05:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:33.366 01:05:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:33.366 01:05:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.272 01:05:25 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:35.272 00:12:35.272 real 0m7.959s 00:12:35.272 user 0m13.003s 00:12:35.272 sys 0m2.453s 00:12:35.272 01:05:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:35.272 01:05:25 -- common/autotest_common.sh@10 -- # set +x 00:12:35.272 ************************************ 00:12:35.272 END TEST nvmf_abort 00:12:35.272 ************************************ 00:12:35.272 01:05:25 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:35.272 01:05:25 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:35.272 01:05:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:35.272 01:05:25 -- common/autotest_common.sh@10 -- # set +x 00:12:35.272 ************************************ 00:12:35.272 START TEST nvmf_ns_hotplug_stress 00:12:35.272 ************************************ 00:12:35.272 01:05:25 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:35.531 * Looking for test storage... 00:12:35.531 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:35.531 01:05:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:35.531 01:05:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:35.531 01:05:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:35.531 01:05:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:35.531 01:05:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:35.531 01:05:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:35.531 01:05:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:35.531 01:05:25 -- scripts/common.sh@335 -- # IFS=.-: 00:12:35.531 01:05:25 -- scripts/common.sh@335 -- # read -ra ver1 00:12:35.531 01:05:25 -- scripts/common.sh@336 -- # IFS=.-: 00:12:35.531 01:05:25 -- scripts/common.sh@336 -- # read -ra ver2 00:12:35.531 01:05:25 -- scripts/common.sh@337 -- # local 'op=<' 00:12:35.531 01:05:25 -- scripts/common.sh@339 -- # ver1_l=2 00:12:35.531 01:05:25 -- scripts/common.sh@340 -- # ver2_l=1 00:12:35.531 01:05:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:35.531 01:05:25 -- scripts/common.sh@343 -- # case "$op" in 00:12:35.531 01:05:25 -- scripts/common.sh@344 -- # : 1 00:12:35.531 01:05:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:35.531 01:05:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:35.531 01:05:25 -- scripts/common.sh@364 -- # decimal 1 00:12:35.531 01:05:25 -- scripts/common.sh@352 -- # local d=1 00:12:35.531 01:05:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:35.531 01:05:25 -- scripts/common.sh@354 -- # echo 1 00:12:35.531 01:05:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:35.531 01:05:25 -- scripts/common.sh@365 -- # decimal 2 00:12:35.531 01:05:25 -- scripts/common.sh@352 -- # local d=2 00:12:35.531 01:05:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:35.531 01:05:25 -- scripts/common.sh@354 -- # echo 2 00:12:35.531 01:05:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:35.531 01:05:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:35.531 01:05:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:35.531 01:05:25 -- scripts/common.sh@367 -- # return 0 00:12:35.531 01:05:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:35.531 01:05:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:35.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.531 --rc genhtml_branch_coverage=1 00:12:35.531 --rc genhtml_function_coverage=1 00:12:35.531 --rc genhtml_legend=1 00:12:35.531 --rc geninfo_all_blocks=1 00:12:35.531 --rc geninfo_unexecuted_blocks=1 00:12:35.531 00:12:35.531 ' 00:12:35.531 01:05:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:35.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.531 --rc genhtml_branch_coverage=1 00:12:35.531 --rc genhtml_function_coverage=1 00:12:35.531 --rc genhtml_legend=1 00:12:35.531 --rc geninfo_all_blocks=1 00:12:35.531 --rc geninfo_unexecuted_blocks=1 00:12:35.531 00:12:35.531 ' 00:12:35.531 01:05:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:35.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.531 --rc genhtml_branch_coverage=1 00:12:35.531 --rc genhtml_function_coverage=1 00:12:35.531 --rc genhtml_legend=1 00:12:35.531 --rc geninfo_all_blocks=1 00:12:35.531 --rc geninfo_unexecuted_blocks=1 00:12:35.531 00:12:35.531 ' 00:12:35.531 01:05:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:35.531 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:35.531 --rc genhtml_branch_coverage=1 00:12:35.531 --rc genhtml_function_coverage=1 00:12:35.531 --rc genhtml_legend=1 00:12:35.531 --rc geninfo_all_blocks=1 00:12:35.531 --rc geninfo_unexecuted_blocks=1 00:12:35.531 00:12:35.531 ' 00:12:35.531 01:05:25 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:35.531 01:05:25 -- nvmf/common.sh@7 -- # uname -s 00:12:35.531 01:05:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:35.531 01:05:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:35.531 01:05:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:35.531 01:05:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:35.531 01:05:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:35.531 01:05:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:35.531 01:05:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:35.531 01:05:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:35.531 01:05:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:35.531 01:05:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:35.531 01:05:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:35.531 01:05:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:35.531 01:05:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:35.531 01:05:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:35.531 01:05:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:35.531 01:05:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:35.531 01:05:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:35.531 01:05:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:35.531 01:05:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:35.531 01:05:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.531 01:05:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.531 01:05:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.531 01:05:25 -- paths/export.sh@5 -- # export PATH 00:12:35.531 01:05:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:35.531 01:05:25 -- nvmf/common.sh@46 -- # : 0 00:12:35.531 01:05:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:35.531 01:05:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:35.531 01:05:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:35.531 01:05:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:35.531 01:05:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:35.531 01:05:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:35.531 01:05:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:35.531 01:05:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:35.531 01:05:25 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:35.531 01:05:25 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:35.531 01:05:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:35.531 01:05:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:35.531 01:05:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:35.532 01:05:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:35.532 01:05:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:35.532 01:05:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:35.532 01:05:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:35.532 01:05:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:35.532 01:05:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:35.532 01:05:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:35.532 01:05:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:35.532 01:05:25 -- common/autotest_common.sh@10 -- # set +x 00:12:37.432 01:05:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:37.432 01:05:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:37.432 01:05:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:37.432 01:05:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:37.432 01:05:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:37.432 01:05:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:37.432 01:05:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:37.432 01:05:27 -- nvmf/common.sh@294 -- # net_devs=() 00:12:37.432 01:05:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:37.432 01:05:27 -- nvmf/common.sh@295 -- # e810=() 00:12:37.432 01:05:27 -- nvmf/common.sh@295 -- # local -ga e810 00:12:37.432 01:05:27 -- nvmf/common.sh@296 -- # x722=() 00:12:37.432 01:05:27 -- nvmf/common.sh@296 -- # local -ga x722 00:12:37.432 01:05:27 -- nvmf/common.sh@297 -- # mlx=() 00:12:37.432 01:05:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:37.432 01:05:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:37.432 01:05:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:37.433 01:05:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:37.433 01:05:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:37.433 01:05:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:37.433 01:05:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:37.433 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:37.433 01:05:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:37.433 01:05:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:37.433 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:37.433 01:05:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:37.433 01:05:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:37.433 01:05:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.433 01:05:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:37.433 01:05:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.433 01:05:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:37.433 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:37.433 01:05:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.433 01:05:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:37.433 01:05:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:37.433 01:05:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:37.433 01:05:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:37.433 01:05:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:37.433 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:37.433 01:05:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:37.433 01:05:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:37.433 01:05:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:37.433 01:05:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:37.433 01:05:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:37.433 01:05:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:37.433 01:05:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:37.433 01:05:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:37.433 01:05:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:37.433 01:05:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:37.433 01:05:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:37.433 01:05:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:37.433 01:05:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:37.433 01:05:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:37.433 01:05:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:37.433 01:05:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:37.433 01:05:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:37.433 01:05:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:37.692 01:05:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:37.692 01:05:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:37.692 01:05:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:37.692 01:05:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:37.692 01:05:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:37.692 01:05:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:37.692 01:05:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:37.692 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:37.692 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.240 ms 00:12:37.692 00:12:37.692 --- 10.0.0.2 ping statistics --- 00:12:37.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.692 rtt min/avg/max/mdev = 0.240/0.240/0.240/0.000 ms 00:12:37.692 01:05:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:37.692 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:37.692 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:12:37.692 00:12:37.692 --- 10.0.0.1 ping statistics --- 00:12:37.692 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:37.692 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:12:37.692 01:05:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:37.692 01:05:28 -- nvmf/common.sh@410 -- # return 0 00:12:37.692 01:05:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:37.692 01:05:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:37.692 01:05:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:37.692 01:05:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:37.692 01:05:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:37.692 01:05:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:37.692 01:05:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:37.692 01:05:28 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:37.692 01:05:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:37.692 01:05:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:37.692 01:05:28 -- common/autotest_common.sh@10 -- # set +x 00:12:37.692 01:05:28 -- nvmf/common.sh@469 -- # nvmfpid=1006060 00:12:37.692 01:05:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:37.692 01:05:28 -- nvmf/common.sh@470 -- # waitforlisten 1006060 00:12:37.692 01:05:28 -- common/autotest_common.sh@829 -- # '[' -z 1006060 ']' 00:12:37.692 01:05:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:37.692 01:05:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:37.692 01:05:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:37.692 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:37.692 01:05:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:37.692 01:05:28 -- common/autotest_common.sh@10 -- # set +x 00:12:37.692 [2024-11-26 01:05:28.182956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:37.692 [2024-11-26 01:05:28.183017] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:37.692 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.951 [2024-11-26 01:05:28.249134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:37.951 [2024-11-26 01:05:28.356296] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:37.951 [2024-11-26 01:05:28.356466] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:37.951 [2024-11-26 01:05:28.356483] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:37.951 [2024-11-26 01:05:28.356495] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:37.951 [2024-11-26 01:05:28.356578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:37.951 [2024-11-26 01:05:28.356644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:37.951 [2024-11-26 01:05:28.356647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:38.883 01:05:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:38.883 01:05:29 -- common/autotest_common.sh@862 -- # return 0 00:12:38.883 01:05:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:38.883 01:05:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:38.883 01:05:29 -- common/autotest_common.sh@10 -- # set +x 00:12:38.883 01:05:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:38.883 01:05:29 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:38.883 01:05:29 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:38.883 [2024-11-26 01:05:29.413750] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:39.140 01:05:29 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:39.398 01:05:29 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:39.398 [2024-11-26 01:05:29.905293] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:39.398 01:05:29 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:39.964 01:05:30 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:39.964 Malloc0 00:12:39.964 01:05:30 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:40.563 Delay0 00:12:40.563 01:05:30 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:40.848 01:05:31 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:40.848 NULL1 00:12:40.848 01:05:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:41.105 01:05:31 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=1006508 00:12:41.105 01:05:31 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:41.105 01:05:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:41.105 01:05:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:41.363 EAL: No free 2048 kB hugepages reported on node 1 00:12:42.295 Read completed with error (sct=0, sc=11) 00:12:42.295 01:05:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:42.295 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:42.810 01:05:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:42.810 01:05:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:42.810 true 00:12:43.068 01:05:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:43.068 01:05:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.633 01:05:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:43.890 01:05:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:43.890 01:05:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:44.148 true 00:12:44.148 01:05:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:44.148 01:05:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:44.406 01:05:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:44.663 01:05:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:44.663 01:05:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:44.921 true 00:12:44.921 01:05:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:44.921 01:05:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:45.178 01:05:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:45.435 01:05:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:45.435 01:05:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:45.694 true 00:12:45.694 01:05:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:45.694 01:05:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:46.627 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:46.627 01:05:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:46.885 01:05:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:46.885 01:05:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:47.142 true 00:12:47.142 01:05:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:47.142 01:05:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:47.399 01:05:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.656 01:05:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:47.656 01:05:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:47.913 true 00:12:47.913 01:05:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:47.913 01:05:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.847 01:05:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:48.847 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.847 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.847 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:48.847 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.106 01:05:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:49.106 01:05:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:49.364 true 00:12:49.364 01:05:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:49.364 01:05:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:49.622 01:05:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.879 01:05:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:49.879 01:05:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:50.137 true 00:12:50.137 01:05:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:50.137 01:05:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.071 01:05:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.328 01:05:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:51.328 01:05:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:51.586 true 00:12:51.586 01:05:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:51.586 01:05:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.843 01:05:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.101 01:05:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:52.101 01:05:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:52.359 true 00:12:52.359 01:05:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:52.359 01:05:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.292 01:05:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.292 01:05:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:12:53.292 01:05:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:12:53.549 true 00:12:53.549 01:05:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:53.549 01:05:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.806 01:05:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.063 01:05:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:12:54.063 01:05:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:12:54.321 true 00:12:54.321 01:05:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:54.321 01:05:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.578 01:05:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.837 01:05:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:12:54.837 01:05:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:12:55.094 true 00:12:55.094 01:05:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:55.094 01:05:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.026 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:56.026 01:05:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.284 01:05:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:12:56.284 01:05:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:12:56.542 true 00:12:56.542 01:05:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:56.542 01:05:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.800 01:05:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.057 01:05:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:12:57.057 01:05:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:12:57.315 true 00:12:57.315 01:05:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:57.315 01:05:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.250 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:58.250 01:05:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.508 01:05:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:12:58.508 01:05:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:12:58.765 true 00:12:58.765 01:05:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:58.765 01:05:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.022 01:05:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:59.279 01:05:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:12:59.279 01:05:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:12:59.537 true 00:12:59.537 01:05:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:12:59.537 01:05:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.468 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:00.468 01:05:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.468 01:05:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:00.468 01:05:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:00.726 true 00:13:00.726 01:05:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:00.726 01:05:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.984 01:05:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:01.242 01:05:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:01.242 01:05:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:01.500 true 00:13:01.500 01:05:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:01.500 01:05:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.433 01:05:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.433 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.691 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.691 01:05:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:02.691 01:05:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:02.948 true 00:13:02.948 01:05:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:02.948 01:05:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:03.206 01:05:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.464 01:05:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:03.464 01:05:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:03.721 true 00:13:03.721 01:05:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:03.721 01:05:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.652 01:05:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.653 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.653 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.653 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.653 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.910 01:05:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:04.910 01:05:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:04.910 true 00:13:04.910 01:05:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:04.910 01:05:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.166 01:05:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.423 01:05:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:05.423 01:05:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:05.680 true 00:13:05.680 01:05:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:05.680 01:05:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.052 01:05:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.052 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:07.052 01:05:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:07.052 01:05:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:07.310 true 00:13:07.310 01:05:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:07.310 01:05:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.567 01:05:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.825 01:05:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:07.825 01:05:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:08.082 true 00:13:08.082 01:05:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:08.082 01:05:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.016 01:05:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.273 01:05:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:09.274 01:05:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:09.532 true 00:13:09.532 01:05:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:09.532 01:05:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.822 01:06:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.114 01:06:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:10.114 01:06:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:10.380 true 00:13:10.380 01:06:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:10.380 01:06:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.637 01:06:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.896 01:06:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:10.896 01:06:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:10.896 true 00:13:11.155 01:06:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:11.155 01:06:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.095 Initializing NVMe Controllers 00:13:12.095 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:12.095 Controller IO queue size 128, less than required. 00:13:12.095 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:12.095 Controller IO queue size 128, less than required. 00:13:12.095 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:12.095 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:12.095 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:12.095 Initialization complete. Launching workers. 00:13:12.095 ======================================================== 00:13:12.095 Latency(us) 00:13:12.095 Device Information : IOPS MiB/s Average min max 00:13:12.095 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 877.10 0.43 76161.66 2290.75 1011515.61 00:13:12.095 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11319.07 5.53 11308.14 2828.70 443159.14 00:13:12.095 ======================================================== 00:13:12.095 Total : 12196.17 5.96 15972.15 2290.75 1011515.61 00:13:12.095 00:13:12.095 01:06:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.354 01:06:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:12.354 01:06:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:12.613 true 00:13:12.613 01:06:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 1006508 00:13:12.613 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (1006508) - No such process 00:13:12.613 01:06:02 -- target/ns_hotplug_stress.sh@53 -- # wait 1006508 00:13:12.613 01:06:02 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.872 01:06:03 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:13.132 01:06:03 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:13.132 01:06:03 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:13.132 01:06:03 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:13.132 01:06:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:13.133 01:06:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:13.133 null0 00:13:13.133 01:06:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:13.133 01:06:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:13.133 01:06:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:13.392 null1 00:13:13.651 01:06:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:13.651 01:06:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:13.651 01:06:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:13.651 null2 00:13:13.651 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:13.651 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:13.651 01:06:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:13.910 null3 00:13:13.910 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:13.910 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:13.910 01:06:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:14.169 null4 00:13:14.169 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:14.169 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:14.169 01:06:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:14.428 null5 00:13:14.428 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:14.428 01:06:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:14.428 01:06:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:14.686 null6 00:13:14.686 01:06:05 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:14.686 01:06:05 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:14.686 01:06:05 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:14.945 null7 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.945 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@66 -- # wait 1010781 1010782 1010783 1010786 1010788 1010790 1010792 1010794 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:14.946 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:15.204 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:15.204 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:15.204 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:15.204 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.204 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:15.204 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.463 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:15.722 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.722 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.722 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:15.722 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.722 01:06:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.722 01:06:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:15.722 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:15.980 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.238 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.239 01:06:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:16.497 01:06:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.755 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:16.756 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.014 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.273 01:06:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:17.531 01:06:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:17.790 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:18.048 01:06:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.307 01:06:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.566 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:18.825 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.084 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:19.342 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.343 01:06:09 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:19.601 01:06:09 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:19.859 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.118 01:06:10 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:20.377 01:06:10 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:20.635 01:06:11 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:20.635 01:06:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:20.635 01:06:11 -- nvmf/common.sh@116 -- # sync 00:13:20.635 01:06:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:20.635 01:06:11 -- nvmf/common.sh@119 -- # set +e 00:13:20.635 01:06:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:20.635 01:06:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:20.635 rmmod nvme_tcp 00:13:20.635 rmmod nvme_fabrics 00:13:20.635 rmmod nvme_keyring 00:13:20.635 01:06:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:20.635 01:06:11 -- nvmf/common.sh@123 -- # set -e 00:13:20.635 01:06:11 -- nvmf/common.sh@124 -- # return 0 00:13:20.635 01:06:11 -- nvmf/common.sh@477 -- # '[' -n 1006060 ']' 00:13:20.635 01:06:11 -- nvmf/common.sh@478 -- # killprocess 1006060 00:13:20.635 01:06:11 -- common/autotest_common.sh@936 -- # '[' -z 1006060 ']' 00:13:20.635 01:06:11 -- common/autotest_common.sh@940 -- # kill -0 1006060 00:13:20.635 01:06:11 -- common/autotest_common.sh@941 -- # uname 00:13:20.635 01:06:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:20.635 01:06:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1006060 00:13:20.635 01:06:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:20.635 01:06:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:20.635 01:06:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1006060' 00:13:20.635 killing process with pid 1006060 00:13:20.635 01:06:11 -- common/autotest_common.sh@955 -- # kill 1006060 00:13:20.635 01:06:11 -- common/autotest_common.sh@960 -- # wait 1006060 00:13:21.204 01:06:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:21.204 01:06:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:21.204 01:06:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:21.204 01:06:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:21.204 01:06:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:21.204 01:06:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:21.205 01:06:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:21.205 01:06:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:23.112 01:06:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:23.112 00:13:23.112 real 0m47.709s 00:13:23.112 user 3m37.181s 00:13:23.112 sys 0m15.370s 00:13:23.112 01:06:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:23.112 01:06:13 -- common/autotest_common.sh@10 -- # set +x 00:13:23.112 ************************************ 00:13:23.112 END TEST nvmf_ns_hotplug_stress 00:13:23.113 ************************************ 00:13:23.113 01:06:13 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:23.113 01:06:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:23.113 01:06:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:23.113 01:06:13 -- common/autotest_common.sh@10 -- # set +x 00:13:23.113 ************************************ 00:13:23.113 START TEST nvmf_connect_stress 00:13:23.113 ************************************ 00:13:23.113 01:06:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:23.113 * Looking for test storage... 00:13:23.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:23.113 01:06:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:23.113 01:06:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:23.113 01:06:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:23.371 01:06:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:23.371 01:06:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:23.371 01:06:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:23.371 01:06:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:23.371 01:06:13 -- scripts/common.sh@335 -- # IFS=.-: 00:13:23.371 01:06:13 -- scripts/common.sh@335 -- # read -ra ver1 00:13:23.371 01:06:13 -- scripts/common.sh@336 -- # IFS=.-: 00:13:23.371 01:06:13 -- scripts/common.sh@336 -- # read -ra ver2 00:13:23.371 01:06:13 -- scripts/common.sh@337 -- # local 'op=<' 00:13:23.371 01:06:13 -- scripts/common.sh@339 -- # ver1_l=2 00:13:23.371 01:06:13 -- scripts/common.sh@340 -- # ver2_l=1 00:13:23.371 01:06:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:23.371 01:06:13 -- scripts/common.sh@343 -- # case "$op" in 00:13:23.371 01:06:13 -- scripts/common.sh@344 -- # : 1 00:13:23.371 01:06:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:23.371 01:06:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:23.371 01:06:13 -- scripts/common.sh@364 -- # decimal 1 00:13:23.371 01:06:13 -- scripts/common.sh@352 -- # local d=1 00:13:23.371 01:06:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:23.371 01:06:13 -- scripts/common.sh@354 -- # echo 1 00:13:23.371 01:06:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:23.371 01:06:13 -- scripts/common.sh@365 -- # decimal 2 00:13:23.371 01:06:13 -- scripts/common.sh@352 -- # local d=2 00:13:23.371 01:06:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:23.371 01:06:13 -- scripts/common.sh@354 -- # echo 2 00:13:23.371 01:06:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:23.371 01:06:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:23.371 01:06:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:23.371 01:06:13 -- scripts/common.sh@367 -- # return 0 00:13:23.371 01:06:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:23.371 01:06:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:23.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.371 --rc genhtml_branch_coverage=1 00:13:23.371 --rc genhtml_function_coverage=1 00:13:23.371 --rc genhtml_legend=1 00:13:23.371 --rc geninfo_all_blocks=1 00:13:23.371 --rc geninfo_unexecuted_blocks=1 00:13:23.371 00:13:23.371 ' 00:13:23.371 01:06:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:23.371 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.371 --rc genhtml_branch_coverage=1 00:13:23.371 --rc genhtml_function_coverage=1 00:13:23.371 --rc genhtml_legend=1 00:13:23.371 --rc geninfo_all_blocks=1 00:13:23.371 --rc geninfo_unexecuted_blocks=1 00:13:23.371 00:13:23.371 ' 00:13:23.371 01:06:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:23.372 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.372 --rc genhtml_branch_coverage=1 00:13:23.372 --rc genhtml_function_coverage=1 00:13:23.372 --rc genhtml_legend=1 00:13:23.372 --rc geninfo_all_blocks=1 00:13:23.372 --rc geninfo_unexecuted_blocks=1 00:13:23.372 00:13:23.372 ' 00:13:23.372 01:06:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:23.372 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:23.372 --rc genhtml_branch_coverage=1 00:13:23.372 --rc genhtml_function_coverage=1 00:13:23.372 --rc genhtml_legend=1 00:13:23.372 --rc geninfo_all_blocks=1 00:13:23.372 --rc geninfo_unexecuted_blocks=1 00:13:23.372 00:13:23.372 ' 00:13:23.372 01:06:13 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:23.372 01:06:13 -- nvmf/common.sh@7 -- # uname -s 00:13:23.372 01:06:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:23.372 01:06:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:23.372 01:06:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:23.372 01:06:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:23.372 01:06:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:23.372 01:06:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:23.372 01:06:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:23.372 01:06:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:23.372 01:06:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:23.372 01:06:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:23.372 01:06:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:23.372 01:06:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:23.372 01:06:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:23.372 01:06:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:23.372 01:06:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:23.372 01:06:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:23.372 01:06:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:23.372 01:06:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:23.372 01:06:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:23.372 01:06:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.372 01:06:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.372 01:06:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.372 01:06:13 -- paths/export.sh@5 -- # export PATH 00:13:23.372 01:06:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:23.372 01:06:13 -- nvmf/common.sh@46 -- # : 0 00:13:23.372 01:06:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:23.372 01:06:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:23.372 01:06:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:23.372 01:06:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:23.372 01:06:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:23.372 01:06:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:23.372 01:06:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:23.372 01:06:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:23.372 01:06:13 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:23.372 01:06:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:23.372 01:06:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:23.372 01:06:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:23.372 01:06:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:23.372 01:06:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:23.372 01:06:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:23.372 01:06:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:23.372 01:06:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:23.372 01:06:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:23.372 01:06:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:23.372 01:06:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:23.372 01:06:13 -- common/autotest_common.sh@10 -- # set +x 00:13:25.275 01:06:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:25.275 01:06:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:25.275 01:06:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:25.275 01:06:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:25.275 01:06:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:25.275 01:06:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:25.275 01:06:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:25.275 01:06:15 -- nvmf/common.sh@294 -- # net_devs=() 00:13:25.275 01:06:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:25.275 01:06:15 -- nvmf/common.sh@295 -- # e810=() 00:13:25.275 01:06:15 -- nvmf/common.sh@295 -- # local -ga e810 00:13:25.275 01:06:15 -- nvmf/common.sh@296 -- # x722=() 00:13:25.275 01:06:15 -- nvmf/common.sh@296 -- # local -ga x722 00:13:25.275 01:06:15 -- nvmf/common.sh@297 -- # mlx=() 00:13:25.275 01:06:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:25.275 01:06:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:25.275 01:06:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:25.275 01:06:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:25.275 01:06:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:25.275 01:06:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:25.275 01:06:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:25.275 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:25.275 01:06:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:25.275 01:06:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:25.275 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:25.275 01:06:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:25.275 01:06:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:25.275 01:06:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.275 01:06:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:25.275 01:06:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.275 01:06:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:25.275 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:25.275 01:06:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.275 01:06:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:25.275 01:06:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.275 01:06:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:25.275 01:06:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.275 01:06:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:25.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:25.275 01:06:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.275 01:06:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:25.275 01:06:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:25.275 01:06:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:25.275 01:06:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:25.275 01:06:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:25.275 01:06:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:25.275 01:06:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:25.275 01:06:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:25.275 01:06:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:25.275 01:06:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:25.275 01:06:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:25.275 01:06:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:25.275 01:06:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:25.275 01:06:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:25.275 01:06:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:25.275 01:06:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:25.275 01:06:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:25.275 01:06:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:25.275 01:06:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:25.275 01:06:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:25.275 01:06:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:25.275 01:06:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:25.275 01:06:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:25.275 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:25.275 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:13:25.275 00:13:25.275 --- 10.0.0.2 ping statistics --- 00:13:25.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:25.275 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:13:25.275 01:06:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:25.275 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:25.275 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:13:25.275 00:13:25.275 --- 10.0.0.1 ping statistics --- 00:13:25.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:25.275 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:13:25.275 01:06:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:25.275 01:06:15 -- nvmf/common.sh@410 -- # return 0 00:13:25.275 01:06:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:25.275 01:06:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:25.275 01:06:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:25.275 01:06:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:25.276 01:06:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:25.276 01:06:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:25.535 01:06:15 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:25.535 01:06:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:25.535 01:06:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:25.535 01:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.535 01:06:15 -- nvmf/common.sh@469 -- # nvmfpid=1014087 00:13:25.535 01:06:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:25.535 01:06:15 -- nvmf/common.sh@470 -- # waitforlisten 1014087 00:13:25.535 01:06:15 -- common/autotest_common.sh@829 -- # '[' -z 1014087 ']' 00:13:25.535 01:06:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:25.535 01:06:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:25.535 01:06:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:25.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:25.535 01:06:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:25.535 01:06:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.535 [2024-11-26 01:06:15.871323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:25.535 [2024-11-26 01:06:15.871411] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:25.535 EAL: No free 2048 kB hugepages reported on node 1 00:13:25.535 [2024-11-26 01:06:15.942543] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:25.535 [2024-11-26 01:06:16.057647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:25.535 [2024-11-26 01:06:16.057853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:25.535 [2024-11-26 01:06:16.057875] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:25.535 [2024-11-26 01:06:16.057889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:25.535 [2024-11-26 01:06:16.058015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:25.535 [2024-11-26 01:06:16.058097] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:25.535 [2024-11-26 01:06:16.058101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:26.473 01:06:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:26.473 01:06:16 -- common/autotest_common.sh@862 -- # return 0 00:13:26.473 01:06:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:26.473 01:06:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:26.473 01:06:16 -- common/autotest_common.sh@10 -- # set +x 00:13:26.473 01:06:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:26.473 01:06:16 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:26.473 01:06:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.473 01:06:16 -- common/autotest_common.sh@10 -- # set +x 00:13:26.473 [2024-11-26 01:06:16.843794] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:26.473 01:06:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.473 01:06:16 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:26.473 01:06:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.473 01:06:16 -- common/autotest_common.sh@10 -- # set +x 00:13:26.473 01:06:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.473 01:06:16 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.473 01:06:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.473 01:06:16 -- common/autotest_common.sh@10 -- # set +x 00:13:26.473 [2024-11-26 01:06:16.867858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.473 01:06:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.473 01:06:16 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:26.473 01:06:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.473 01:06:16 -- common/autotest_common.sh@10 -- # set +x 00:13:26.473 NULL1 00:13:26.473 01:06:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.473 01:06:16 -- target/connect_stress.sh@21 -- # PERF_PID=1014246 00:13:26.473 01:06:16 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:26.473 01:06:16 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:26.473 01:06:16 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:26.473 01:06:16 -- target/connect_stress.sh@28 -- # cat 00:13:26.473 01:06:16 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:26.473 01:06:16 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.474 01:06:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.474 01:06:16 -- common/autotest_common.sh@10 -- # set +x 00:13:26.732 01:06:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.732 01:06:17 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:26.732 01:06:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:26.732 01:06:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.732 01:06:17 -- common/autotest_common.sh@10 -- # set +x 00:13:27.298 01:06:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.298 01:06:17 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:27.298 01:06:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.298 01:06:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.298 01:06:17 -- common/autotest_common.sh@10 -- # set +x 00:13:27.557 01:06:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.557 01:06:17 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:27.557 01:06:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.557 01:06:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.557 01:06:17 -- common/autotest_common.sh@10 -- # set +x 00:13:27.814 01:06:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.814 01:06:18 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:27.814 01:06:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:27.814 01:06:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.814 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.072 01:06:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.072 01:06:18 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:28.072 01:06:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.072 01:06:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.072 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.330 01:06:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.330 01:06:18 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:28.330 01:06:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.330 01:06:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.330 01:06:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.897 01:06:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.897 01:06:19 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:28.897 01:06:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:28.897 01:06:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.897 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:13:29.155 01:06:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.155 01:06:19 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:29.155 01:06:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.155 01:06:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.155 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:13:29.413 01:06:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.413 01:06:19 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:29.413 01:06:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.413 01:06:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.413 01:06:19 -- common/autotest_common.sh@10 -- # set +x 00:13:29.672 01:06:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.672 01:06:20 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:29.672 01:06:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.672 01:06:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.672 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:13:29.930 01:06:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.930 01:06:20 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:29.930 01:06:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:29.930 01:06:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.930 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:13:30.496 01:06:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.496 01:06:20 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:30.496 01:06:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.496 01:06:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.496 01:06:20 -- common/autotest_common.sh@10 -- # set +x 00:13:30.754 01:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.754 01:06:21 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:30.754 01:06:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:30.754 01:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.754 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.013 01:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.013 01:06:21 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:31.013 01:06:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.013 01:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.013 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.271 01:06:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.271 01:06:21 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:31.271 01:06:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.271 01:06:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.271 01:06:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.530 01:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.788 01:06:22 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:31.788 01:06:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:31.788 01:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.788 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:13:32.047 01:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.047 01:06:22 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:32.047 01:06:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.047 01:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.047 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:13:32.306 01:06:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.306 01:06:22 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:32.306 01:06:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.306 01:06:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.306 01:06:22 -- common/autotest_common.sh@10 -- # set +x 00:13:32.565 01:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.565 01:06:23 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:32.565 01:06:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.565 01:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.565 01:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:32.823 01:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.823 01:06:23 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:32.823 01:06:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:32.823 01:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.823 01:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:33.389 01:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.389 01:06:23 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:33.389 01:06:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.389 01:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.389 01:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:33.647 01:06:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.647 01:06:23 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:33.647 01:06:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.647 01:06:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.647 01:06:23 -- common/autotest_common.sh@10 -- # set +x 00:13:33.906 01:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.906 01:06:24 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:33.906 01:06:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.906 01:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.906 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:13:34.164 01:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.164 01:06:24 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:34.164 01:06:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.164 01:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.164 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:13:34.731 01:06:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.731 01:06:24 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:34.731 01:06:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.731 01:06:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.731 01:06:24 -- common/autotest_common.sh@10 -- # set +x 00:13:34.989 01:06:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.989 01:06:25 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:34.989 01:06:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.989 01:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.989 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:13:35.247 01:06:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.247 01:06:25 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:35.247 01:06:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.247 01:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.247 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:13:35.505 01:06:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.505 01:06:25 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:35.505 01:06:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.505 01:06:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.505 01:06:25 -- common/autotest_common.sh@10 -- # set +x 00:13:35.763 01:06:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.763 01:06:26 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:35.763 01:06:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.763 01:06:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.763 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:13:36.329 01:06:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.329 01:06:26 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:36.329 01:06:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.329 01:06:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.329 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:13:36.587 01:06:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.587 01:06:26 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:36.587 01:06:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.587 01:06:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.587 01:06:26 -- common/autotest_common.sh@10 -- # set +x 00:13:36.587 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:36.845 01:06:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.845 01:06:27 -- target/connect_stress.sh@34 -- # kill -0 1014246 00:13:36.846 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (1014246) - No such process 00:13:36.846 01:06:27 -- target/connect_stress.sh@38 -- # wait 1014246 00:13:36.846 01:06:27 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:36.846 01:06:27 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:36.846 01:06:27 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:36.846 01:06:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:36.846 01:06:27 -- nvmf/common.sh@116 -- # sync 00:13:36.846 01:06:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:36.846 01:06:27 -- nvmf/common.sh@119 -- # set +e 00:13:36.846 01:06:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:36.846 01:06:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:36.846 rmmod nvme_tcp 00:13:36.846 rmmod nvme_fabrics 00:13:36.846 rmmod nvme_keyring 00:13:36.846 01:06:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:36.846 01:06:27 -- nvmf/common.sh@123 -- # set -e 00:13:36.846 01:06:27 -- nvmf/common.sh@124 -- # return 0 00:13:36.846 01:06:27 -- nvmf/common.sh@477 -- # '[' -n 1014087 ']' 00:13:36.846 01:06:27 -- nvmf/common.sh@478 -- # killprocess 1014087 00:13:36.846 01:06:27 -- common/autotest_common.sh@936 -- # '[' -z 1014087 ']' 00:13:36.846 01:06:27 -- common/autotest_common.sh@940 -- # kill -0 1014087 00:13:36.846 01:06:27 -- common/autotest_common.sh@941 -- # uname 00:13:36.846 01:06:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:36.846 01:06:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1014087 00:13:36.846 01:06:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:36.846 01:06:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:36.846 01:06:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1014087' 00:13:36.846 killing process with pid 1014087 00:13:36.846 01:06:27 -- common/autotest_common.sh@955 -- # kill 1014087 00:13:36.846 01:06:27 -- common/autotest_common.sh@960 -- # wait 1014087 00:13:37.105 01:06:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:37.105 01:06:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:37.105 01:06:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:37.105 01:06:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:37.105 01:06:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:37.105 01:06:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.105 01:06:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.105 01:06:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.646 01:06:29 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:39.646 00:13:39.646 real 0m16.108s 00:13:39.646 user 0m40.884s 00:13:39.646 sys 0m5.672s 00:13:39.646 01:06:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:39.646 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:39.646 ************************************ 00:13:39.646 END TEST nvmf_connect_stress 00:13:39.646 ************************************ 00:13:39.646 01:06:29 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:39.646 01:06:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:39.646 01:06:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:39.646 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:39.646 ************************************ 00:13:39.646 START TEST nvmf_fused_ordering 00:13:39.646 ************************************ 00:13:39.646 01:06:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:39.646 * Looking for test storage... 00:13:39.646 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:39.646 01:06:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:39.646 01:06:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:39.646 01:06:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:39.646 01:06:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:39.646 01:06:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:39.646 01:06:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:39.646 01:06:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:39.646 01:06:29 -- scripts/common.sh@335 -- # IFS=.-: 00:13:39.646 01:06:29 -- scripts/common.sh@335 -- # read -ra ver1 00:13:39.646 01:06:29 -- scripts/common.sh@336 -- # IFS=.-: 00:13:39.646 01:06:29 -- scripts/common.sh@336 -- # read -ra ver2 00:13:39.646 01:06:29 -- scripts/common.sh@337 -- # local 'op=<' 00:13:39.646 01:06:29 -- scripts/common.sh@339 -- # ver1_l=2 00:13:39.646 01:06:29 -- scripts/common.sh@340 -- # ver2_l=1 00:13:39.646 01:06:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:39.646 01:06:29 -- scripts/common.sh@343 -- # case "$op" in 00:13:39.646 01:06:29 -- scripts/common.sh@344 -- # : 1 00:13:39.646 01:06:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:39.646 01:06:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:39.646 01:06:29 -- scripts/common.sh@364 -- # decimal 1 00:13:39.646 01:06:29 -- scripts/common.sh@352 -- # local d=1 00:13:39.646 01:06:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:39.646 01:06:29 -- scripts/common.sh@354 -- # echo 1 00:13:39.646 01:06:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:39.646 01:06:29 -- scripts/common.sh@365 -- # decimal 2 00:13:39.646 01:06:29 -- scripts/common.sh@352 -- # local d=2 00:13:39.646 01:06:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:39.646 01:06:29 -- scripts/common.sh@354 -- # echo 2 00:13:39.646 01:06:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:39.646 01:06:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:39.646 01:06:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:39.646 01:06:29 -- scripts/common.sh@367 -- # return 0 00:13:39.646 01:06:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:39.646 01:06:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:39.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.646 --rc genhtml_branch_coverage=1 00:13:39.646 --rc genhtml_function_coverage=1 00:13:39.646 --rc genhtml_legend=1 00:13:39.646 --rc geninfo_all_blocks=1 00:13:39.646 --rc geninfo_unexecuted_blocks=1 00:13:39.646 00:13:39.646 ' 00:13:39.646 01:06:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:39.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.646 --rc genhtml_branch_coverage=1 00:13:39.646 --rc genhtml_function_coverage=1 00:13:39.646 --rc genhtml_legend=1 00:13:39.646 --rc geninfo_all_blocks=1 00:13:39.646 --rc geninfo_unexecuted_blocks=1 00:13:39.646 00:13:39.646 ' 00:13:39.646 01:06:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:39.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.646 --rc genhtml_branch_coverage=1 00:13:39.646 --rc genhtml_function_coverage=1 00:13:39.646 --rc genhtml_legend=1 00:13:39.646 --rc geninfo_all_blocks=1 00:13:39.646 --rc geninfo_unexecuted_blocks=1 00:13:39.646 00:13:39.646 ' 00:13:39.646 01:06:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:39.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:39.646 --rc genhtml_branch_coverage=1 00:13:39.646 --rc genhtml_function_coverage=1 00:13:39.646 --rc genhtml_legend=1 00:13:39.646 --rc geninfo_all_blocks=1 00:13:39.646 --rc geninfo_unexecuted_blocks=1 00:13:39.646 00:13:39.646 ' 00:13:39.646 01:06:29 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:39.646 01:06:29 -- nvmf/common.sh@7 -- # uname -s 00:13:39.646 01:06:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:39.646 01:06:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:39.646 01:06:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:39.646 01:06:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:39.646 01:06:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:39.646 01:06:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:39.646 01:06:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:39.646 01:06:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:39.646 01:06:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:39.646 01:06:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:39.646 01:06:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.646 01:06:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:39.646 01:06:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:39.646 01:06:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:39.646 01:06:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:39.646 01:06:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:39.646 01:06:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:39.646 01:06:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:39.646 01:06:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:39.646 01:06:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.646 01:06:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.646 01:06:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.646 01:06:29 -- paths/export.sh@5 -- # export PATH 00:13:39.646 01:06:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:39.646 01:06:29 -- nvmf/common.sh@46 -- # : 0 00:13:39.647 01:06:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:39.647 01:06:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:39.647 01:06:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:39.647 01:06:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:39.647 01:06:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:39.647 01:06:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:39.647 01:06:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:39.647 01:06:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:39.647 01:06:29 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:39.647 01:06:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:39.647 01:06:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:39.647 01:06:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:39.647 01:06:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:39.647 01:06:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:39.647 01:06:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:39.647 01:06:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:39.647 01:06:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:39.647 01:06:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:39.647 01:06:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:39.647 01:06:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:39.647 01:06:29 -- common/autotest_common.sh@10 -- # set +x 00:13:41.650 01:06:31 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:41.650 01:06:31 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:41.650 01:06:31 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:41.650 01:06:31 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:41.650 01:06:31 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:41.650 01:06:31 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:41.650 01:06:31 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:41.650 01:06:31 -- nvmf/common.sh@294 -- # net_devs=() 00:13:41.650 01:06:31 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:41.650 01:06:31 -- nvmf/common.sh@295 -- # e810=() 00:13:41.650 01:06:31 -- nvmf/common.sh@295 -- # local -ga e810 00:13:41.650 01:06:31 -- nvmf/common.sh@296 -- # x722=() 00:13:41.650 01:06:31 -- nvmf/common.sh@296 -- # local -ga x722 00:13:41.650 01:06:31 -- nvmf/common.sh@297 -- # mlx=() 00:13:41.650 01:06:31 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:41.650 01:06:31 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:41.650 01:06:31 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:41.650 01:06:31 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:41.650 01:06:31 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:41.650 01:06:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.650 01:06:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:41.650 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:41.650 01:06:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:41.650 01:06:31 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:41.650 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:41.650 01:06:31 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:41.650 01:06:31 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.650 01:06:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.650 01:06:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.650 01:06:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.650 01:06:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:41.650 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:41.650 01:06:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.650 01:06:31 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:41.650 01:06:31 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:41.650 01:06:31 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:41.650 01:06:31 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:41.650 01:06:31 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:41.650 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:41.650 01:06:31 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:41.650 01:06:31 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:41.650 01:06:31 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:41.650 01:06:31 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:41.650 01:06:31 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:41.650 01:06:31 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:41.650 01:06:31 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:41.650 01:06:31 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:41.650 01:06:31 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:41.650 01:06:31 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:41.650 01:06:31 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:41.650 01:06:31 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:41.650 01:06:31 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:41.650 01:06:31 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:41.650 01:06:31 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:41.650 01:06:31 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:41.650 01:06:31 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:41.650 01:06:31 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:41.650 01:06:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:41.650 01:06:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:41.650 01:06:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:41.650 01:06:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:41.650 01:06:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:41.650 01:06:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:41.650 01:06:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:41.650 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:41.650 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.362 ms 00:13:41.650 00:13:41.650 --- 10.0.0.2 ping statistics --- 00:13:41.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:41.650 rtt min/avg/max/mdev = 0.362/0.362/0.362/0.000 ms 00:13:41.650 01:06:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:41.650 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:41.650 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:13:41.650 00:13:41.650 --- 10.0.0.1 ping statistics --- 00:13:41.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:41.650 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:13:41.650 01:06:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:41.650 01:06:32 -- nvmf/common.sh@410 -- # return 0 00:13:41.650 01:06:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:41.650 01:06:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:41.650 01:06:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:41.650 01:06:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:41.650 01:06:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:41.650 01:06:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:41.650 01:06:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:41.650 01:06:32 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:41.650 01:06:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:41.650 01:06:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:41.650 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:41.650 01:06:32 -- nvmf/common.sh@469 -- # nvmfpid=1017573 00:13:41.650 01:06:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:41.650 01:06:32 -- nvmf/common.sh@470 -- # waitforlisten 1017573 00:13:41.650 01:06:32 -- common/autotest_common.sh@829 -- # '[' -z 1017573 ']' 00:13:41.650 01:06:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:41.650 01:06:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:41.650 01:06:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:41.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:41.650 01:06:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:41.650 01:06:32 -- common/autotest_common.sh@10 -- # set +x 00:13:41.650 [2024-11-26 01:06:32.164835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:41.650 [2024-11-26 01:06:32.164904] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:41.908 EAL: No free 2048 kB hugepages reported on node 1 00:13:41.908 [2024-11-26 01:06:32.229486] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:41.908 [2024-11-26 01:06:32.336845] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:41.908 [2024-11-26 01:06:32.337005] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:41.908 [2024-11-26 01:06:32.337024] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:41.908 [2024-11-26 01:06:32.337039] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:41.908 [2024-11-26 01:06:32.337070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:42.841 01:06:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:42.841 01:06:33 -- common/autotest_common.sh@862 -- # return 0 00:13:42.841 01:06:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:42.841 01:06:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 01:06:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:42.841 01:06:33 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:42.841 01:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 [2024-11-26 01:06:33.142576] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:42.841 01:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.841 01:06:33 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:42.841 01:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 01:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.841 01:06:33 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:42.841 01:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 [2024-11-26 01:06:33.158815] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:42.841 01:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.841 01:06:33 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:42.841 01:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 NULL1 00:13:42.841 01:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.841 01:06:33 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:42.841 01:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 01:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.841 01:06:33 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:42.841 01:06:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.841 01:06:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.841 01:06:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.841 01:06:33 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:42.841 [2024-11-26 01:06:33.203634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:42.841 [2024-11-26 01:06:33.203674] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017716 ] 00:13:42.841 EAL: No free 2048 kB hugepages reported on node 1 00:13:43.099 Attached to nqn.2016-06.io.spdk:cnode1 00:13:43.100 Namespace ID: 1 size: 1GB 00:13:43.100 fused_ordering(0) 00:13:43.100 fused_ordering(1) 00:13:43.100 fused_ordering(2) 00:13:43.100 fused_ordering(3) 00:13:43.100 fused_ordering(4) 00:13:43.100 fused_ordering(5) 00:13:43.100 fused_ordering(6) 00:13:43.100 fused_ordering(7) 00:13:43.100 fused_ordering(8) 00:13:43.100 fused_ordering(9) 00:13:43.100 fused_ordering(10) 00:13:43.100 fused_ordering(11) 00:13:43.100 fused_ordering(12) 00:13:43.100 fused_ordering(13) 00:13:43.100 fused_ordering(14) 00:13:43.100 fused_ordering(15) 00:13:43.100 fused_ordering(16) 00:13:43.100 fused_ordering(17) 00:13:43.100 fused_ordering(18) 00:13:43.100 fused_ordering(19) 00:13:43.100 fused_ordering(20) 00:13:43.100 fused_ordering(21) 00:13:43.100 fused_ordering(22) 00:13:43.100 fused_ordering(23) 00:13:43.100 fused_ordering(24) 00:13:43.100 fused_ordering(25) 00:13:43.100 fused_ordering(26) 00:13:43.100 fused_ordering(27) 00:13:43.100 fused_ordering(28) 00:13:43.100 fused_ordering(29) 00:13:43.100 fused_ordering(30) 00:13:43.100 fused_ordering(31) 00:13:43.100 fused_ordering(32) 00:13:43.100 fused_ordering(33) 00:13:43.100 fused_ordering(34) 00:13:43.100 fused_ordering(35) 00:13:43.100 fused_ordering(36) 00:13:43.100 fused_ordering(37) 00:13:43.100 fused_ordering(38) 00:13:43.100 fused_ordering(39) 00:13:43.100 fused_ordering(40) 00:13:43.100 fused_ordering(41) 00:13:43.100 fused_ordering(42) 00:13:43.100 fused_ordering(43) 00:13:43.100 fused_ordering(44) 00:13:43.100 fused_ordering(45) 00:13:43.100 fused_ordering(46) 00:13:43.100 fused_ordering(47) 00:13:43.100 fused_ordering(48) 00:13:43.100 fused_ordering(49) 00:13:43.100 fused_ordering(50) 00:13:43.100 fused_ordering(51) 00:13:43.100 fused_ordering(52) 00:13:43.100 fused_ordering(53) 00:13:43.100 fused_ordering(54) 00:13:43.100 fused_ordering(55) 00:13:43.100 fused_ordering(56) 00:13:43.100 fused_ordering(57) 00:13:43.100 fused_ordering(58) 00:13:43.100 fused_ordering(59) 00:13:43.100 fused_ordering(60) 00:13:43.100 fused_ordering(61) 00:13:43.100 fused_ordering(62) 00:13:43.100 fused_ordering(63) 00:13:43.100 fused_ordering(64) 00:13:43.100 fused_ordering(65) 00:13:43.100 fused_ordering(66) 00:13:43.100 fused_ordering(67) 00:13:43.100 fused_ordering(68) 00:13:43.100 fused_ordering(69) 00:13:43.100 fused_ordering(70) 00:13:43.100 fused_ordering(71) 00:13:43.100 fused_ordering(72) 00:13:43.100 fused_ordering(73) 00:13:43.100 fused_ordering(74) 00:13:43.100 fused_ordering(75) 00:13:43.100 fused_ordering(76) 00:13:43.100 fused_ordering(77) 00:13:43.100 fused_ordering(78) 00:13:43.100 fused_ordering(79) 00:13:43.100 fused_ordering(80) 00:13:43.100 fused_ordering(81) 00:13:43.100 fused_ordering(82) 00:13:43.100 fused_ordering(83) 00:13:43.100 fused_ordering(84) 00:13:43.100 fused_ordering(85) 00:13:43.100 fused_ordering(86) 00:13:43.100 fused_ordering(87) 00:13:43.100 fused_ordering(88) 00:13:43.100 fused_ordering(89) 00:13:43.100 fused_ordering(90) 00:13:43.100 fused_ordering(91) 00:13:43.100 fused_ordering(92) 00:13:43.100 fused_ordering(93) 00:13:43.100 fused_ordering(94) 00:13:43.100 fused_ordering(95) 00:13:43.100 fused_ordering(96) 00:13:43.100 fused_ordering(97) 00:13:43.100 fused_ordering(98) 00:13:43.100 fused_ordering(99) 00:13:43.100 fused_ordering(100) 00:13:43.100 fused_ordering(101) 00:13:43.100 fused_ordering(102) 00:13:43.100 fused_ordering(103) 00:13:43.100 fused_ordering(104) 00:13:43.100 fused_ordering(105) 00:13:43.100 fused_ordering(106) 00:13:43.100 fused_ordering(107) 00:13:43.100 fused_ordering(108) 00:13:43.100 fused_ordering(109) 00:13:43.100 fused_ordering(110) 00:13:43.100 fused_ordering(111) 00:13:43.100 fused_ordering(112) 00:13:43.100 fused_ordering(113) 00:13:43.100 fused_ordering(114) 00:13:43.100 fused_ordering(115) 00:13:43.100 fused_ordering(116) 00:13:43.100 fused_ordering(117) 00:13:43.100 fused_ordering(118) 00:13:43.100 fused_ordering(119) 00:13:43.100 fused_ordering(120) 00:13:43.100 fused_ordering(121) 00:13:43.100 fused_ordering(122) 00:13:43.100 fused_ordering(123) 00:13:43.100 fused_ordering(124) 00:13:43.100 fused_ordering(125) 00:13:43.100 fused_ordering(126) 00:13:43.100 fused_ordering(127) 00:13:43.100 fused_ordering(128) 00:13:43.100 fused_ordering(129) 00:13:43.100 fused_ordering(130) 00:13:43.100 fused_ordering(131) 00:13:43.100 fused_ordering(132) 00:13:43.100 fused_ordering(133) 00:13:43.100 fused_ordering(134) 00:13:43.100 fused_ordering(135) 00:13:43.100 fused_ordering(136) 00:13:43.100 fused_ordering(137) 00:13:43.100 fused_ordering(138) 00:13:43.100 fused_ordering(139) 00:13:43.100 fused_ordering(140) 00:13:43.100 fused_ordering(141) 00:13:43.100 fused_ordering(142) 00:13:43.100 fused_ordering(143) 00:13:43.100 fused_ordering(144) 00:13:43.100 fused_ordering(145) 00:13:43.100 fused_ordering(146) 00:13:43.100 fused_ordering(147) 00:13:43.100 fused_ordering(148) 00:13:43.100 fused_ordering(149) 00:13:43.100 fused_ordering(150) 00:13:43.100 fused_ordering(151) 00:13:43.100 fused_ordering(152) 00:13:43.100 fused_ordering(153) 00:13:43.100 fused_ordering(154) 00:13:43.100 fused_ordering(155) 00:13:43.100 fused_ordering(156) 00:13:43.100 fused_ordering(157) 00:13:43.100 fused_ordering(158) 00:13:43.100 fused_ordering(159) 00:13:43.100 fused_ordering(160) 00:13:43.100 fused_ordering(161) 00:13:43.100 fused_ordering(162) 00:13:43.100 fused_ordering(163) 00:13:43.100 fused_ordering(164) 00:13:43.100 fused_ordering(165) 00:13:43.100 fused_ordering(166) 00:13:43.100 fused_ordering(167) 00:13:43.100 fused_ordering(168) 00:13:43.100 fused_ordering(169) 00:13:43.100 fused_ordering(170) 00:13:43.100 fused_ordering(171) 00:13:43.100 fused_ordering(172) 00:13:43.100 fused_ordering(173) 00:13:43.100 fused_ordering(174) 00:13:43.100 fused_ordering(175) 00:13:43.100 fused_ordering(176) 00:13:43.100 fused_ordering(177) 00:13:43.100 fused_ordering(178) 00:13:43.100 fused_ordering(179) 00:13:43.100 fused_ordering(180) 00:13:43.100 fused_ordering(181) 00:13:43.100 fused_ordering(182) 00:13:43.100 fused_ordering(183) 00:13:43.100 fused_ordering(184) 00:13:43.100 fused_ordering(185) 00:13:43.100 fused_ordering(186) 00:13:43.101 fused_ordering(187) 00:13:43.101 fused_ordering(188) 00:13:43.101 fused_ordering(189) 00:13:43.101 fused_ordering(190) 00:13:43.101 fused_ordering(191) 00:13:43.101 fused_ordering(192) 00:13:43.101 fused_ordering(193) 00:13:43.101 fused_ordering(194) 00:13:43.101 fused_ordering(195) 00:13:43.101 fused_ordering(196) 00:13:43.101 fused_ordering(197) 00:13:43.101 fused_ordering(198) 00:13:43.101 fused_ordering(199) 00:13:43.101 fused_ordering(200) 00:13:43.101 fused_ordering(201) 00:13:43.101 fused_ordering(202) 00:13:43.101 fused_ordering(203) 00:13:43.101 fused_ordering(204) 00:13:43.101 fused_ordering(205) 00:13:43.667 fused_ordering(206) 00:13:43.667 fused_ordering(207) 00:13:43.667 fused_ordering(208) 00:13:43.667 fused_ordering(209) 00:13:43.667 fused_ordering(210) 00:13:43.667 fused_ordering(211) 00:13:43.667 fused_ordering(212) 00:13:43.667 fused_ordering(213) 00:13:43.667 fused_ordering(214) 00:13:43.667 fused_ordering(215) 00:13:43.667 fused_ordering(216) 00:13:43.667 fused_ordering(217) 00:13:43.667 fused_ordering(218) 00:13:43.667 fused_ordering(219) 00:13:43.667 fused_ordering(220) 00:13:43.667 fused_ordering(221) 00:13:43.667 fused_ordering(222) 00:13:43.667 fused_ordering(223) 00:13:43.667 fused_ordering(224) 00:13:43.667 fused_ordering(225) 00:13:43.667 fused_ordering(226) 00:13:43.667 fused_ordering(227) 00:13:43.667 fused_ordering(228) 00:13:43.667 fused_ordering(229) 00:13:43.667 fused_ordering(230) 00:13:43.667 fused_ordering(231) 00:13:43.667 fused_ordering(232) 00:13:43.667 fused_ordering(233) 00:13:43.667 fused_ordering(234) 00:13:43.667 fused_ordering(235) 00:13:43.667 fused_ordering(236) 00:13:43.667 fused_ordering(237) 00:13:43.667 fused_ordering(238) 00:13:43.667 fused_ordering(239) 00:13:43.667 fused_ordering(240) 00:13:43.667 fused_ordering(241) 00:13:43.667 fused_ordering(242) 00:13:43.667 fused_ordering(243) 00:13:43.667 fused_ordering(244) 00:13:43.667 fused_ordering(245) 00:13:43.667 fused_ordering(246) 00:13:43.667 fused_ordering(247) 00:13:43.667 fused_ordering(248) 00:13:43.667 fused_ordering(249) 00:13:43.667 fused_ordering(250) 00:13:43.667 fused_ordering(251) 00:13:43.667 fused_ordering(252) 00:13:43.667 fused_ordering(253) 00:13:43.667 fused_ordering(254) 00:13:43.667 fused_ordering(255) 00:13:43.667 fused_ordering(256) 00:13:43.667 fused_ordering(257) 00:13:43.667 fused_ordering(258) 00:13:43.667 fused_ordering(259) 00:13:43.667 fused_ordering(260) 00:13:43.667 fused_ordering(261) 00:13:43.667 fused_ordering(262) 00:13:43.667 fused_ordering(263) 00:13:43.667 fused_ordering(264) 00:13:43.667 fused_ordering(265) 00:13:43.667 fused_ordering(266) 00:13:43.667 fused_ordering(267) 00:13:43.667 fused_ordering(268) 00:13:43.667 fused_ordering(269) 00:13:43.667 fused_ordering(270) 00:13:43.667 fused_ordering(271) 00:13:43.667 fused_ordering(272) 00:13:43.667 fused_ordering(273) 00:13:43.667 fused_ordering(274) 00:13:43.667 fused_ordering(275) 00:13:43.667 fused_ordering(276) 00:13:43.667 fused_ordering(277) 00:13:43.667 fused_ordering(278) 00:13:43.667 fused_ordering(279) 00:13:43.667 fused_ordering(280) 00:13:43.667 fused_ordering(281) 00:13:43.667 fused_ordering(282) 00:13:43.667 fused_ordering(283) 00:13:43.667 fused_ordering(284) 00:13:43.667 fused_ordering(285) 00:13:43.667 fused_ordering(286) 00:13:43.667 fused_ordering(287) 00:13:43.667 fused_ordering(288) 00:13:43.667 fused_ordering(289) 00:13:43.667 fused_ordering(290) 00:13:43.667 fused_ordering(291) 00:13:43.667 fused_ordering(292) 00:13:43.667 fused_ordering(293) 00:13:43.667 fused_ordering(294) 00:13:43.667 fused_ordering(295) 00:13:43.667 fused_ordering(296) 00:13:43.667 fused_ordering(297) 00:13:43.667 fused_ordering(298) 00:13:43.667 fused_ordering(299) 00:13:43.667 fused_ordering(300) 00:13:43.667 fused_ordering(301) 00:13:43.667 fused_ordering(302) 00:13:43.667 fused_ordering(303) 00:13:43.667 fused_ordering(304) 00:13:43.667 fused_ordering(305) 00:13:43.667 fused_ordering(306) 00:13:43.668 fused_ordering(307) 00:13:43.668 fused_ordering(308) 00:13:43.668 fused_ordering(309) 00:13:43.668 fused_ordering(310) 00:13:43.668 fused_ordering(311) 00:13:43.668 fused_ordering(312) 00:13:43.668 fused_ordering(313) 00:13:43.668 fused_ordering(314) 00:13:43.668 fused_ordering(315) 00:13:43.668 fused_ordering(316) 00:13:43.668 fused_ordering(317) 00:13:43.668 fused_ordering(318) 00:13:43.668 fused_ordering(319) 00:13:43.668 fused_ordering(320) 00:13:43.668 fused_ordering(321) 00:13:43.668 fused_ordering(322) 00:13:43.668 fused_ordering(323) 00:13:43.668 fused_ordering(324) 00:13:43.668 fused_ordering(325) 00:13:43.668 fused_ordering(326) 00:13:43.668 fused_ordering(327) 00:13:43.668 fused_ordering(328) 00:13:43.668 fused_ordering(329) 00:13:43.668 fused_ordering(330) 00:13:43.668 fused_ordering(331) 00:13:43.668 fused_ordering(332) 00:13:43.668 fused_ordering(333) 00:13:43.668 fused_ordering(334) 00:13:43.668 fused_ordering(335) 00:13:43.668 fused_ordering(336) 00:13:43.668 fused_ordering(337) 00:13:43.668 fused_ordering(338) 00:13:43.668 fused_ordering(339) 00:13:43.668 fused_ordering(340) 00:13:43.668 fused_ordering(341) 00:13:43.668 fused_ordering(342) 00:13:43.668 fused_ordering(343) 00:13:43.668 fused_ordering(344) 00:13:43.668 fused_ordering(345) 00:13:43.668 fused_ordering(346) 00:13:43.668 fused_ordering(347) 00:13:43.668 fused_ordering(348) 00:13:43.668 fused_ordering(349) 00:13:43.668 fused_ordering(350) 00:13:43.668 fused_ordering(351) 00:13:43.668 fused_ordering(352) 00:13:43.668 fused_ordering(353) 00:13:43.668 fused_ordering(354) 00:13:43.668 fused_ordering(355) 00:13:43.668 fused_ordering(356) 00:13:43.668 fused_ordering(357) 00:13:43.668 fused_ordering(358) 00:13:43.668 fused_ordering(359) 00:13:43.668 fused_ordering(360) 00:13:43.668 fused_ordering(361) 00:13:43.668 fused_ordering(362) 00:13:43.668 fused_ordering(363) 00:13:43.668 fused_ordering(364) 00:13:43.668 fused_ordering(365) 00:13:43.668 fused_ordering(366) 00:13:43.668 fused_ordering(367) 00:13:43.668 fused_ordering(368) 00:13:43.668 fused_ordering(369) 00:13:43.668 fused_ordering(370) 00:13:43.668 fused_ordering(371) 00:13:43.668 fused_ordering(372) 00:13:43.668 fused_ordering(373) 00:13:43.668 fused_ordering(374) 00:13:43.668 fused_ordering(375) 00:13:43.668 fused_ordering(376) 00:13:43.668 fused_ordering(377) 00:13:43.668 fused_ordering(378) 00:13:43.668 fused_ordering(379) 00:13:43.668 fused_ordering(380) 00:13:43.668 fused_ordering(381) 00:13:43.668 fused_ordering(382) 00:13:43.668 fused_ordering(383) 00:13:43.668 fused_ordering(384) 00:13:43.668 fused_ordering(385) 00:13:43.668 fused_ordering(386) 00:13:43.668 fused_ordering(387) 00:13:43.668 fused_ordering(388) 00:13:43.668 fused_ordering(389) 00:13:43.668 fused_ordering(390) 00:13:43.668 fused_ordering(391) 00:13:43.668 fused_ordering(392) 00:13:43.668 fused_ordering(393) 00:13:43.668 fused_ordering(394) 00:13:43.668 fused_ordering(395) 00:13:43.668 fused_ordering(396) 00:13:43.668 fused_ordering(397) 00:13:43.668 fused_ordering(398) 00:13:43.668 fused_ordering(399) 00:13:43.668 fused_ordering(400) 00:13:43.668 fused_ordering(401) 00:13:43.668 fused_ordering(402) 00:13:43.668 fused_ordering(403) 00:13:43.668 fused_ordering(404) 00:13:43.668 fused_ordering(405) 00:13:43.668 fused_ordering(406) 00:13:43.668 fused_ordering(407) 00:13:43.668 fused_ordering(408) 00:13:43.668 fused_ordering(409) 00:13:43.668 fused_ordering(410) 00:13:43.925 fused_ordering(411) 00:13:43.925 fused_ordering(412) 00:13:43.925 fused_ordering(413) 00:13:43.925 fused_ordering(414) 00:13:43.925 fused_ordering(415) 00:13:43.925 fused_ordering(416) 00:13:43.925 fused_ordering(417) 00:13:43.925 fused_ordering(418) 00:13:43.925 fused_ordering(419) 00:13:43.925 fused_ordering(420) 00:13:43.925 fused_ordering(421) 00:13:43.925 fused_ordering(422) 00:13:43.925 fused_ordering(423) 00:13:43.925 fused_ordering(424) 00:13:43.925 fused_ordering(425) 00:13:43.925 fused_ordering(426) 00:13:43.925 fused_ordering(427) 00:13:43.925 fused_ordering(428) 00:13:43.925 fused_ordering(429) 00:13:43.925 fused_ordering(430) 00:13:43.925 fused_ordering(431) 00:13:43.925 fused_ordering(432) 00:13:43.925 fused_ordering(433) 00:13:43.925 fused_ordering(434) 00:13:43.925 fused_ordering(435) 00:13:43.925 fused_ordering(436) 00:13:43.925 fused_ordering(437) 00:13:43.925 fused_ordering(438) 00:13:43.925 fused_ordering(439) 00:13:43.925 fused_ordering(440) 00:13:43.925 fused_ordering(441) 00:13:43.925 fused_ordering(442) 00:13:43.925 fused_ordering(443) 00:13:43.925 fused_ordering(444) 00:13:43.925 fused_ordering(445) 00:13:43.925 fused_ordering(446) 00:13:43.925 fused_ordering(447) 00:13:43.926 fused_ordering(448) 00:13:43.926 fused_ordering(449) 00:13:43.926 fused_ordering(450) 00:13:43.926 fused_ordering(451) 00:13:43.926 fused_ordering(452) 00:13:43.926 fused_ordering(453) 00:13:43.926 fused_ordering(454) 00:13:43.926 fused_ordering(455) 00:13:43.926 fused_ordering(456) 00:13:43.926 fused_ordering(457) 00:13:43.926 fused_ordering(458) 00:13:43.926 fused_ordering(459) 00:13:43.926 fused_ordering(460) 00:13:43.926 fused_ordering(461) 00:13:43.926 fused_ordering(462) 00:13:43.926 fused_ordering(463) 00:13:43.926 fused_ordering(464) 00:13:43.926 fused_ordering(465) 00:13:43.926 fused_ordering(466) 00:13:43.926 fused_ordering(467) 00:13:43.926 fused_ordering(468) 00:13:43.926 fused_ordering(469) 00:13:43.926 fused_ordering(470) 00:13:43.926 fused_ordering(471) 00:13:43.926 fused_ordering(472) 00:13:43.926 fused_ordering(473) 00:13:43.926 fused_ordering(474) 00:13:43.926 fused_ordering(475) 00:13:43.926 fused_ordering(476) 00:13:43.926 fused_ordering(477) 00:13:43.926 fused_ordering(478) 00:13:43.926 fused_ordering(479) 00:13:43.926 fused_ordering(480) 00:13:43.926 fused_ordering(481) 00:13:43.926 fused_ordering(482) 00:13:43.926 fused_ordering(483) 00:13:43.926 fused_ordering(484) 00:13:43.926 fused_ordering(485) 00:13:43.926 fused_ordering(486) 00:13:43.926 fused_ordering(487) 00:13:43.926 fused_ordering(488) 00:13:43.926 fused_ordering(489) 00:13:43.926 fused_ordering(490) 00:13:43.926 fused_ordering(491) 00:13:43.926 fused_ordering(492) 00:13:43.926 fused_ordering(493) 00:13:43.926 fused_ordering(494) 00:13:43.926 fused_ordering(495) 00:13:43.926 fused_ordering(496) 00:13:43.926 fused_ordering(497) 00:13:43.926 fused_ordering(498) 00:13:43.926 fused_ordering(499) 00:13:43.926 fused_ordering(500) 00:13:43.926 fused_ordering(501) 00:13:43.926 fused_ordering(502) 00:13:43.926 fused_ordering(503) 00:13:43.926 fused_ordering(504) 00:13:43.926 fused_ordering(505) 00:13:43.926 fused_ordering(506) 00:13:43.926 fused_ordering(507) 00:13:43.926 fused_ordering(508) 00:13:43.926 fused_ordering(509) 00:13:43.926 fused_ordering(510) 00:13:43.926 fused_ordering(511) 00:13:43.926 fused_ordering(512) 00:13:43.926 fused_ordering(513) 00:13:43.926 fused_ordering(514) 00:13:43.926 fused_ordering(515) 00:13:43.926 fused_ordering(516) 00:13:43.926 fused_ordering(517) 00:13:43.926 fused_ordering(518) 00:13:43.926 fused_ordering(519) 00:13:43.926 fused_ordering(520) 00:13:43.926 fused_ordering(521) 00:13:43.926 fused_ordering(522) 00:13:43.926 fused_ordering(523) 00:13:43.926 fused_ordering(524) 00:13:43.926 fused_ordering(525) 00:13:43.926 fused_ordering(526) 00:13:43.926 fused_ordering(527) 00:13:43.926 fused_ordering(528) 00:13:43.926 fused_ordering(529) 00:13:43.926 fused_ordering(530) 00:13:43.926 fused_ordering(531) 00:13:43.926 fused_ordering(532) 00:13:43.926 fused_ordering(533) 00:13:43.926 fused_ordering(534) 00:13:43.926 fused_ordering(535) 00:13:43.926 fused_ordering(536) 00:13:43.926 fused_ordering(537) 00:13:43.926 fused_ordering(538) 00:13:43.926 fused_ordering(539) 00:13:43.926 fused_ordering(540) 00:13:43.926 fused_ordering(541) 00:13:43.926 fused_ordering(542) 00:13:43.926 fused_ordering(543) 00:13:43.926 fused_ordering(544) 00:13:43.926 fused_ordering(545) 00:13:43.926 fused_ordering(546) 00:13:43.926 fused_ordering(547) 00:13:43.926 fused_ordering(548) 00:13:43.926 fused_ordering(549) 00:13:43.926 fused_ordering(550) 00:13:43.926 fused_ordering(551) 00:13:43.926 fused_ordering(552) 00:13:43.926 fused_ordering(553) 00:13:43.926 fused_ordering(554) 00:13:43.926 fused_ordering(555) 00:13:43.926 fused_ordering(556) 00:13:43.926 fused_ordering(557) 00:13:43.926 fused_ordering(558) 00:13:43.926 fused_ordering(559) 00:13:43.926 fused_ordering(560) 00:13:43.926 fused_ordering(561) 00:13:43.926 fused_ordering(562) 00:13:43.926 fused_ordering(563) 00:13:43.926 fused_ordering(564) 00:13:43.926 fused_ordering(565) 00:13:43.926 fused_ordering(566) 00:13:43.926 fused_ordering(567) 00:13:43.926 fused_ordering(568) 00:13:43.926 fused_ordering(569) 00:13:43.926 fused_ordering(570) 00:13:43.926 fused_ordering(571) 00:13:43.926 fused_ordering(572) 00:13:43.926 fused_ordering(573) 00:13:43.926 fused_ordering(574) 00:13:43.926 fused_ordering(575) 00:13:43.926 fused_ordering(576) 00:13:43.926 fused_ordering(577) 00:13:43.926 fused_ordering(578) 00:13:43.926 fused_ordering(579) 00:13:43.926 fused_ordering(580) 00:13:43.926 fused_ordering(581) 00:13:43.926 fused_ordering(582) 00:13:43.926 fused_ordering(583) 00:13:43.926 fused_ordering(584) 00:13:43.926 fused_ordering(585) 00:13:43.926 fused_ordering(586) 00:13:43.926 fused_ordering(587) 00:13:43.926 fused_ordering(588) 00:13:43.926 fused_ordering(589) 00:13:43.926 fused_ordering(590) 00:13:43.926 fused_ordering(591) 00:13:43.926 fused_ordering(592) 00:13:43.926 fused_ordering(593) 00:13:43.926 fused_ordering(594) 00:13:43.926 fused_ordering(595) 00:13:43.926 fused_ordering(596) 00:13:43.926 fused_ordering(597) 00:13:43.926 fused_ordering(598) 00:13:43.926 fused_ordering(599) 00:13:43.926 fused_ordering(600) 00:13:43.926 fused_ordering(601) 00:13:43.926 fused_ordering(602) 00:13:43.926 fused_ordering(603) 00:13:43.926 fused_ordering(604) 00:13:43.926 fused_ordering(605) 00:13:43.926 fused_ordering(606) 00:13:43.926 fused_ordering(607) 00:13:43.926 fused_ordering(608) 00:13:43.926 fused_ordering(609) 00:13:43.926 fused_ordering(610) 00:13:43.926 fused_ordering(611) 00:13:43.926 fused_ordering(612) 00:13:43.926 fused_ordering(613) 00:13:43.926 fused_ordering(614) 00:13:43.926 fused_ordering(615) 00:13:44.859 fused_ordering(616) 00:13:44.859 fused_ordering(617) 00:13:44.859 fused_ordering(618) 00:13:44.859 fused_ordering(619) 00:13:44.859 fused_ordering(620) 00:13:44.859 fused_ordering(621) 00:13:44.859 fused_ordering(622) 00:13:44.859 fused_ordering(623) 00:13:44.859 fused_ordering(624) 00:13:44.859 fused_ordering(625) 00:13:44.859 fused_ordering(626) 00:13:44.859 fused_ordering(627) 00:13:44.859 fused_ordering(628) 00:13:44.859 fused_ordering(629) 00:13:44.859 fused_ordering(630) 00:13:44.859 fused_ordering(631) 00:13:44.859 fused_ordering(632) 00:13:44.859 fused_ordering(633) 00:13:44.859 fused_ordering(634) 00:13:44.859 fused_ordering(635) 00:13:44.859 fused_ordering(636) 00:13:44.859 fused_ordering(637) 00:13:44.859 fused_ordering(638) 00:13:44.859 fused_ordering(639) 00:13:44.859 fused_ordering(640) 00:13:44.859 fused_ordering(641) 00:13:44.859 fused_ordering(642) 00:13:44.859 fused_ordering(643) 00:13:44.859 fused_ordering(644) 00:13:44.859 fused_ordering(645) 00:13:44.859 fused_ordering(646) 00:13:44.859 fused_ordering(647) 00:13:44.859 fused_ordering(648) 00:13:44.859 fused_ordering(649) 00:13:44.859 fused_ordering(650) 00:13:44.859 fused_ordering(651) 00:13:44.859 fused_ordering(652) 00:13:44.859 fused_ordering(653) 00:13:44.859 fused_ordering(654) 00:13:44.859 fused_ordering(655) 00:13:44.859 fused_ordering(656) 00:13:44.859 fused_ordering(657) 00:13:44.859 fused_ordering(658) 00:13:44.859 fused_ordering(659) 00:13:44.859 fused_ordering(660) 00:13:44.859 fused_ordering(661) 00:13:44.859 fused_ordering(662) 00:13:44.859 fused_ordering(663) 00:13:44.859 fused_ordering(664) 00:13:44.859 fused_ordering(665) 00:13:44.859 fused_ordering(666) 00:13:44.859 fused_ordering(667) 00:13:44.859 fused_ordering(668) 00:13:44.859 fused_ordering(669) 00:13:44.859 fused_ordering(670) 00:13:44.859 fused_ordering(671) 00:13:44.859 fused_ordering(672) 00:13:44.859 fused_ordering(673) 00:13:44.859 fused_ordering(674) 00:13:44.859 fused_ordering(675) 00:13:44.859 fused_ordering(676) 00:13:44.859 fused_ordering(677) 00:13:44.859 fused_ordering(678) 00:13:44.859 fused_ordering(679) 00:13:44.859 fused_ordering(680) 00:13:44.859 fused_ordering(681) 00:13:44.859 fused_ordering(682) 00:13:44.859 fused_ordering(683) 00:13:44.859 fused_ordering(684) 00:13:44.859 fused_ordering(685) 00:13:44.859 fused_ordering(686) 00:13:44.859 fused_ordering(687) 00:13:44.859 fused_ordering(688) 00:13:44.859 fused_ordering(689) 00:13:44.859 fused_ordering(690) 00:13:44.859 fused_ordering(691) 00:13:44.859 fused_ordering(692) 00:13:44.859 fused_ordering(693) 00:13:44.859 fused_ordering(694) 00:13:44.859 fused_ordering(695) 00:13:44.859 fused_ordering(696) 00:13:44.859 fused_ordering(697) 00:13:44.859 fused_ordering(698) 00:13:44.859 fused_ordering(699) 00:13:44.859 fused_ordering(700) 00:13:44.859 fused_ordering(701) 00:13:44.859 fused_ordering(702) 00:13:44.859 fused_ordering(703) 00:13:44.859 fused_ordering(704) 00:13:44.859 fused_ordering(705) 00:13:44.859 fused_ordering(706) 00:13:44.859 fused_ordering(707) 00:13:44.859 fused_ordering(708) 00:13:44.859 fused_ordering(709) 00:13:44.859 fused_ordering(710) 00:13:44.859 fused_ordering(711) 00:13:44.859 fused_ordering(712) 00:13:44.859 fused_ordering(713) 00:13:44.859 fused_ordering(714) 00:13:44.859 fused_ordering(715) 00:13:44.859 fused_ordering(716) 00:13:44.859 fused_ordering(717) 00:13:44.859 fused_ordering(718) 00:13:44.859 fused_ordering(719) 00:13:44.860 fused_ordering(720) 00:13:44.860 fused_ordering(721) 00:13:44.860 fused_ordering(722) 00:13:44.860 fused_ordering(723) 00:13:44.860 fused_ordering(724) 00:13:44.860 fused_ordering(725) 00:13:44.860 fused_ordering(726) 00:13:44.860 fused_ordering(727) 00:13:44.860 fused_ordering(728) 00:13:44.860 fused_ordering(729) 00:13:44.860 fused_ordering(730) 00:13:44.860 fused_ordering(731) 00:13:44.860 fused_ordering(732) 00:13:44.860 fused_ordering(733) 00:13:44.860 fused_ordering(734) 00:13:44.860 fused_ordering(735) 00:13:44.860 fused_ordering(736) 00:13:44.860 fused_ordering(737) 00:13:44.860 fused_ordering(738) 00:13:44.860 fused_ordering(739) 00:13:44.860 fused_ordering(740) 00:13:44.860 fused_ordering(741) 00:13:44.860 fused_ordering(742) 00:13:44.860 fused_ordering(743) 00:13:44.860 fused_ordering(744) 00:13:44.860 fused_ordering(745) 00:13:44.860 fused_ordering(746) 00:13:44.860 fused_ordering(747) 00:13:44.860 fused_ordering(748) 00:13:44.860 fused_ordering(749) 00:13:44.860 fused_ordering(750) 00:13:44.860 fused_ordering(751) 00:13:44.860 fused_ordering(752) 00:13:44.860 fused_ordering(753) 00:13:44.860 fused_ordering(754) 00:13:44.860 fused_ordering(755) 00:13:44.860 fused_ordering(756) 00:13:44.860 fused_ordering(757) 00:13:44.860 fused_ordering(758) 00:13:44.860 fused_ordering(759) 00:13:44.860 fused_ordering(760) 00:13:44.860 fused_ordering(761) 00:13:44.860 fused_ordering(762) 00:13:44.860 fused_ordering(763) 00:13:44.860 fused_ordering(764) 00:13:44.860 fused_ordering(765) 00:13:44.860 fused_ordering(766) 00:13:44.860 fused_ordering(767) 00:13:44.860 fused_ordering(768) 00:13:44.860 fused_ordering(769) 00:13:44.860 fused_ordering(770) 00:13:44.860 fused_ordering(771) 00:13:44.860 fused_ordering(772) 00:13:44.860 fused_ordering(773) 00:13:44.860 fused_ordering(774) 00:13:44.860 fused_ordering(775) 00:13:44.860 fused_ordering(776) 00:13:44.860 fused_ordering(777) 00:13:44.860 fused_ordering(778) 00:13:44.860 fused_ordering(779) 00:13:44.860 fused_ordering(780) 00:13:44.860 fused_ordering(781) 00:13:44.860 fused_ordering(782) 00:13:44.860 fused_ordering(783) 00:13:44.860 fused_ordering(784) 00:13:44.860 fused_ordering(785) 00:13:44.860 fused_ordering(786) 00:13:44.860 fused_ordering(787) 00:13:44.860 fused_ordering(788) 00:13:44.860 fused_ordering(789) 00:13:44.860 fused_ordering(790) 00:13:44.860 fused_ordering(791) 00:13:44.860 fused_ordering(792) 00:13:44.860 fused_ordering(793) 00:13:44.860 fused_ordering(794) 00:13:44.860 fused_ordering(795) 00:13:44.860 fused_ordering(796) 00:13:44.860 fused_ordering(797) 00:13:44.860 fused_ordering(798) 00:13:44.860 fused_ordering(799) 00:13:44.860 fused_ordering(800) 00:13:44.860 fused_ordering(801) 00:13:44.860 fused_ordering(802) 00:13:44.860 fused_ordering(803) 00:13:44.860 fused_ordering(804) 00:13:44.860 fused_ordering(805) 00:13:44.860 fused_ordering(806) 00:13:44.860 fused_ordering(807) 00:13:44.860 fused_ordering(808) 00:13:44.860 fused_ordering(809) 00:13:44.860 fused_ordering(810) 00:13:44.860 fused_ordering(811) 00:13:44.860 fused_ordering(812) 00:13:44.860 fused_ordering(813) 00:13:44.860 fused_ordering(814) 00:13:44.860 fused_ordering(815) 00:13:44.860 fused_ordering(816) 00:13:44.860 fused_ordering(817) 00:13:44.860 fused_ordering(818) 00:13:44.860 fused_ordering(819) 00:13:44.860 fused_ordering(820) 00:13:45.427 fused_ordering(821) 00:13:45.427 fused_ordering(822) 00:13:45.427 fused_ordering(823) 00:13:45.427 fused_ordering(824) 00:13:45.427 fused_ordering(825) 00:13:45.427 fused_ordering(826) 00:13:45.427 fused_ordering(827) 00:13:45.427 fused_ordering(828) 00:13:45.427 fused_ordering(829) 00:13:45.427 fused_ordering(830) 00:13:45.427 fused_ordering(831) 00:13:45.427 fused_ordering(832) 00:13:45.427 fused_ordering(833) 00:13:45.427 fused_ordering(834) 00:13:45.427 fused_ordering(835) 00:13:45.427 fused_ordering(836) 00:13:45.427 fused_ordering(837) 00:13:45.427 fused_ordering(838) 00:13:45.427 fused_ordering(839) 00:13:45.427 fused_ordering(840) 00:13:45.427 fused_ordering(841) 00:13:45.427 fused_ordering(842) 00:13:45.427 fused_ordering(843) 00:13:45.427 fused_ordering(844) 00:13:45.427 fused_ordering(845) 00:13:45.427 fused_ordering(846) 00:13:45.427 fused_ordering(847) 00:13:45.427 fused_ordering(848) 00:13:45.427 fused_ordering(849) 00:13:45.427 fused_ordering(850) 00:13:45.427 fused_ordering(851) 00:13:45.427 fused_ordering(852) 00:13:45.427 fused_ordering(853) 00:13:45.427 fused_ordering(854) 00:13:45.427 fused_ordering(855) 00:13:45.427 fused_ordering(856) 00:13:45.427 fused_ordering(857) 00:13:45.427 fused_ordering(858) 00:13:45.427 fused_ordering(859) 00:13:45.427 fused_ordering(860) 00:13:45.427 fused_ordering(861) 00:13:45.427 fused_ordering(862) 00:13:45.427 fused_ordering(863) 00:13:45.427 fused_ordering(864) 00:13:45.427 fused_ordering(865) 00:13:45.427 fused_ordering(866) 00:13:45.427 fused_ordering(867) 00:13:45.427 fused_ordering(868) 00:13:45.427 fused_ordering(869) 00:13:45.427 fused_ordering(870) 00:13:45.427 fused_ordering(871) 00:13:45.427 fused_ordering(872) 00:13:45.427 fused_ordering(873) 00:13:45.427 fused_ordering(874) 00:13:45.427 fused_ordering(875) 00:13:45.427 fused_ordering(876) 00:13:45.427 fused_ordering(877) 00:13:45.427 fused_ordering(878) 00:13:45.427 fused_ordering(879) 00:13:45.427 fused_ordering(880) 00:13:45.427 fused_ordering(881) 00:13:45.427 fused_ordering(882) 00:13:45.427 fused_ordering(883) 00:13:45.427 fused_ordering(884) 00:13:45.427 fused_ordering(885) 00:13:45.427 fused_ordering(886) 00:13:45.427 fused_ordering(887) 00:13:45.427 fused_ordering(888) 00:13:45.427 fused_ordering(889) 00:13:45.427 fused_ordering(890) 00:13:45.427 fused_ordering(891) 00:13:45.427 fused_ordering(892) 00:13:45.427 fused_ordering(893) 00:13:45.427 fused_ordering(894) 00:13:45.427 fused_ordering(895) 00:13:45.427 fused_ordering(896) 00:13:45.427 fused_ordering(897) 00:13:45.427 fused_ordering(898) 00:13:45.427 fused_ordering(899) 00:13:45.427 fused_ordering(900) 00:13:45.427 fused_ordering(901) 00:13:45.427 fused_ordering(902) 00:13:45.427 fused_ordering(903) 00:13:45.427 fused_ordering(904) 00:13:45.427 fused_ordering(905) 00:13:45.427 fused_ordering(906) 00:13:45.427 fused_ordering(907) 00:13:45.427 fused_ordering(908) 00:13:45.427 fused_ordering(909) 00:13:45.427 fused_ordering(910) 00:13:45.427 fused_ordering(911) 00:13:45.427 fused_ordering(912) 00:13:45.427 fused_ordering(913) 00:13:45.427 fused_ordering(914) 00:13:45.427 fused_ordering(915) 00:13:45.427 fused_ordering(916) 00:13:45.427 fused_ordering(917) 00:13:45.427 fused_ordering(918) 00:13:45.427 fused_ordering(919) 00:13:45.427 fused_ordering(920) 00:13:45.427 fused_ordering(921) 00:13:45.427 fused_ordering(922) 00:13:45.427 fused_ordering(923) 00:13:45.427 fused_ordering(924) 00:13:45.427 fused_ordering(925) 00:13:45.427 fused_ordering(926) 00:13:45.427 fused_ordering(927) 00:13:45.427 fused_ordering(928) 00:13:45.427 fused_ordering(929) 00:13:45.427 fused_ordering(930) 00:13:45.427 fused_ordering(931) 00:13:45.427 fused_ordering(932) 00:13:45.427 fused_ordering(933) 00:13:45.427 fused_ordering(934) 00:13:45.427 fused_ordering(935) 00:13:45.427 fused_ordering(936) 00:13:45.427 fused_ordering(937) 00:13:45.427 fused_ordering(938) 00:13:45.427 fused_ordering(939) 00:13:45.427 fused_ordering(940) 00:13:45.427 fused_ordering(941) 00:13:45.427 fused_ordering(942) 00:13:45.427 fused_ordering(943) 00:13:45.427 fused_ordering(944) 00:13:45.427 fused_ordering(945) 00:13:45.427 fused_ordering(946) 00:13:45.427 fused_ordering(947) 00:13:45.427 fused_ordering(948) 00:13:45.427 fused_ordering(949) 00:13:45.427 fused_ordering(950) 00:13:45.427 fused_ordering(951) 00:13:45.427 fused_ordering(952) 00:13:45.427 fused_ordering(953) 00:13:45.427 fused_ordering(954) 00:13:45.427 fused_ordering(955) 00:13:45.427 fused_ordering(956) 00:13:45.427 fused_ordering(957) 00:13:45.427 fused_ordering(958) 00:13:45.427 fused_ordering(959) 00:13:45.427 fused_ordering(960) 00:13:45.427 fused_ordering(961) 00:13:45.427 fused_ordering(962) 00:13:45.427 fused_ordering(963) 00:13:45.428 fused_ordering(964) 00:13:45.428 fused_ordering(965) 00:13:45.428 fused_ordering(966) 00:13:45.428 fused_ordering(967) 00:13:45.428 fused_ordering(968) 00:13:45.428 fused_ordering(969) 00:13:45.428 fused_ordering(970) 00:13:45.428 fused_ordering(971) 00:13:45.428 fused_ordering(972) 00:13:45.428 fused_ordering(973) 00:13:45.428 fused_ordering(974) 00:13:45.428 fused_ordering(975) 00:13:45.428 fused_ordering(976) 00:13:45.428 fused_ordering(977) 00:13:45.428 fused_ordering(978) 00:13:45.428 fused_ordering(979) 00:13:45.428 fused_ordering(980) 00:13:45.428 fused_ordering(981) 00:13:45.428 fused_ordering(982) 00:13:45.428 fused_ordering(983) 00:13:45.428 fused_ordering(984) 00:13:45.428 fused_ordering(985) 00:13:45.428 fused_ordering(986) 00:13:45.428 fused_ordering(987) 00:13:45.428 fused_ordering(988) 00:13:45.428 fused_ordering(989) 00:13:45.428 fused_ordering(990) 00:13:45.428 fused_ordering(991) 00:13:45.428 fused_ordering(992) 00:13:45.428 fused_ordering(993) 00:13:45.428 fused_ordering(994) 00:13:45.428 fused_ordering(995) 00:13:45.428 fused_ordering(996) 00:13:45.428 fused_ordering(997) 00:13:45.428 fused_ordering(998) 00:13:45.428 fused_ordering(999) 00:13:45.428 fused_ordering(1000) 00:13:45.428 fused_ordering(1001) 00:13:45.428 fused_ordering(1002) 00:13:45.428 fused_ordering(1003) 00:13:45.428 fused_ordering(1004) 00:13:45.428 fused_ordering(1005) 00:13:45.428 fused_ordering(1006) 00:13:45.428 fused_ordering(1007) 00:13:45.428 fused_ordering(1008) 00:13:45.428 fused_ordering(1009) 00:13:45.428 fused_ordering(1010) 00:13:45.428 fused_ordering(1011) 00:13:45.428 fused_ordering(1012) 00:13:45.428 fused_ordering(1013) 00:13:45.428 fused_ordering(1014) 00:13:45.428 fused_ordering(1015) 00:13:45.428 fused_ordering(1016) 00:13:45.428 fused_ordering(1017) 00:13:45.428 fused_ordering(1018) 00:13:45.428 fused_ordering(1019) 00:13:45.428 fused_ordering(1020) 00:13:45.428 fused_ordering(1021) 00:13:45.428 fused_ordering(1022) 00:13:45.428 fused_ordering(1023) 00:13:45.428 01:06:35 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:45.428 01:06:35 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:45.428 01:06:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:45.428 01:06:35 -- nvmf/common.sh@116 -- # sync 00:13:45.428 01:06:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:45.428 01:06:35 -- nvmf/common.sh@119 -- # set +e 00:13:45.428 01:06:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:45.428 01:06:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:45.428 rmmod nvme_tcp 00:13:45.428 rmmod nvme_fabrics 00:13:45.428 rmmod nvme_keyring 00:13:45.428 01:06:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:45.428 01:06:35 -- nvmf/common.sh@123 -- # set -e 00:13:45.428 01:06:35 -- nvmf/common.sh@124 -- # return 0 00:13:45.428 01:06:35 -- nvmf/common.sh@477 -- # '[' -n 1017573 ']' 00:13:45.428 01:06:35 -- nvmf/common.sh@478 -- # killprocess 1017573 00:13:45.428 01:06:35 -- common/autotest_common.sh@936 -- # '[' -z 1017573 ']' 00:13:45.428 01:06:35 -- common/autotest_common.sh@940 -- # kill -0 1017573 00:13:45.428 01:06:35 -- common/autotest_common.sh@941 -- # uname 00:13:45.428 01:06:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:45.428 01:06:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1017573 00:13:45.428 01:06:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:45.428 01:06:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:45.428 01:06:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1017573' 00:13:45.428 killing process with pid 1017573 00:13:45.428 01:06:35 -- common/autotest_common.sh@955 -- # kill 1017573 00:13:45.428 01:06:35 -- common/autotest_common.sh@960 -- # wait 1017573 00:13:45.687 01:06:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:45.687 01:06:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:45.687 01:06:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:45.687 01:06:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:45.687 01:06:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:45.687 01:06:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:45.687 01:06:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:45.687 01:06:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:48.221 01:06:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:48.221 00:13:48.221 real 0m8.582s 00:13:48.221 user 0m6.176s 00:13:48.221 sys 0m3.443s 00:13:48.221 01:06:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:48.221 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:48.221 ************************************ 00:13:48.221 END TEST nvmf_fused_ordering 00:13:48.221 ************************************ 00:13:48.221 01:06:38 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:48.221 01:06:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:48.221 01:06:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:48.221 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:48.221 ************************************ 00:13:48.221 START TEST nvmf_delete_subsystem 00:13:48.221 ************************************ 00:13:48.221 01:06:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:48.221 * Looking for test storage... 00:13:48.221 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:48.221 01:06:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:48.221 01:06:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:48.221 01:06:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:48.221 01:06:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:48.221 01:06:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:48.221 01:06:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:48.221 01:06:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:48.221 01:06:38 -- scripts/common.sh@335 -- # IFS=.-: 00:13:48.221 01:06:38 -- scripts/common.sh@335 -- # read -ra ver1 00:13:48.221 01:06:38 -- scripts/common.sh@336 -- # IFS=.-: 00:13:48.221 01:06:38 -- scripts/common.sh@336 -- # read -ra ver2 00:13:48.221 01:06:38 -- scripts/common.sh@337 -- # local 'op=<' 00:13:48.221 01:06:38 -- scripts/common.sh@339 -- # ver1_l=2 00:13:48.221 01:06:38 -- scripts/common.sh@340 -- # ver2_l=1 00:13:48.221 01:06:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:48.221 01:06:38 -- scripts/common.sh@343 -- # case "$op" in 00:13:48.221 01:06:38 -- scripts/common.sh@344 -- # : 1 00:13:48.221 01:06:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:48.221 01:06:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:48.221 01:06:38 -- scripts/common.sh@364 -- # decimal 1 00:13:48.221 01:06:38 -- scripts/common.sh@352 -- # local d=1 00:13:48.221 01:06:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:48.221 01:06:38 -- scripts/common.sh@354 -- # echo 1 00:13:48.221 01:06:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:48.221 01:06:38 -- scripts/common.sh@365 -- # decimal 2 00:13:48.221 01:06:38 -- scripts/common.sh@352 -- # local d=2 00:13:48.221 01:06:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:48.221 01:06:38 -- scripts/common.sh@354 -- # echo 2 00:13:48.221 01:06:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:48.221 01:06:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:48.221 01:06:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:48.221 01:06:38 -- scripts/common.sh@367 -- # return 0 00:13:48.221 01:06:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:48.221 01:06:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:48.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.221 --rc genhtml_branch_coverage=1 00:13:48.221 --rc genhtml_function_coverage=1 00:13:48.221 --rc genhtml_legend=1 00:13:48.221 --rc geninfo_all_blocks=1 00:13:48.221 --rc geninfo_unexecuted_blocks=1 00:13:48.221 00:13:48.221 ' 00:13:48.221 01:06:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:48.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.221 --rc genhtml_branch_coverage=1 00:13:48.221 --rc genhtml_function_coverage=1 00:13:48.221 --rc genhtml_legend=1 00:13:48.221 --rc geninfo_all_blocks=1 00:13:48.221 --rc geninfo_unexecuted_blocks=1 00:13:48.221 00:13:48.221 ' 00:13:48.221 01:06:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:48.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.221 --rc genhtml_branch_coverage=1 00:13:48.221 --rc genhtml_function_coverage=1 00:13:48.221 --rc genhtml_legend=1 00:13:48.221 --rc geninfo_all_blocks=1 00:13:48.221 --rc geninfo_unexecuted_blocks=1 00:13:48.221 00:13:48.221 ' 00:13:48.221 01:06:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:48.221 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:48.221 --rc genhtml_branch_coverage=1 00:13:48.221 --rc genhtml_function_coverage=1 00:13:48.221 --rc genhtml_legend=1 00:13:48.221 --rc geninfo_all_blocks=1 00:13:48.221 --rc geninfo_unexecuted_blocks=1 00:13:48.221 00:13:48.221 ' 00:13:48.221 01:06:38 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:48.221 01:06:38 -- nvmf/common.sh@7 -- # uname -s 00:13:48.221 01:06:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:48.221 01:06:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:48.221 01:06:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:48.221 01:06:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:48.221 01:06:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:48.221 01:06:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:48.221 01:06:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:48.221 01:06:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:48.221 01:06:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:48.221 01:06:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:48.221 01:06:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:48.221 01:06:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:48.221 01:06:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:48.221 01:06:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:48.221 01:06:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:48.221 01:06:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:48.221 01:06:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:48.221 01:06:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:48.221 01:06:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:48.221 01:06:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.221 01:06:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.221 01:06:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.221 01:06:38 -- paths/export.sh@5 -- # export PATH 00:13:48.221 01:06:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:48.221 01:06:38 -- nvmf/common.sh@46 -- # : 0 00:13:48.221 01:06:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:48.221 01:06:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:48.221 01:06:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:48.221 01:06:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:48.222 01:06:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:48.222 01:06:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:48.222 01:06:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:48.222 01:06:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:48.222 01:06:38 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:48.222 01:06:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:48.222 01:06:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:48.222 01:06:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:48.222 01:06:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:48.222 01:06:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:48.222 01:06:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:48.222 01:06:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:48.222 01:06:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:48.222 01:06:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:48.222 01:06:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:48.222 01:06:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:48.222 01:06:38 -- common/autotest_common.sh@10 -- # set +x 00:13:50.125 01:06:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:50.125 01:06:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:50.125 01:06:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:50.125 01:06:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:50.125 01:06:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:50.125 01:06:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:50.125 01:06:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:50.125 01:06:40 -- nvmf/common.sh@294 -- # net_devs=() 00:13:50.125 01:06:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:50.125 01:06:40 -- nvmf/common.sh@295 -- # e810=() 00:13:50.125 01:06:40 -- nvmf/common.sh@295 -- # local -ga e810 00:13:50.125 01:06:40 -- nvmf/common.sh@296 -- # x722=() 00:13:50.125 01:06:40 -- nvmf/common.sh@296 -- # local -ga x722 00:13:50.125 01:06:40 -- nvmf/common.sh@297 -- # mlx=() 00:13:50.125 01:06:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:50.125 01:06:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:50.125 01:06:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:50.125 01:06:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:50.125 01:06:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:50.125 01:06:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:50.125 01:06:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:50.125 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:50.125 01:06:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:50.125 01:06:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:50.125 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:50.125 01:06:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:50.125 01:06:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:50.125 01:06:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:50.125 01:06:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.125 01:06:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:50.125 01:06:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.126 01:06:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:50.126 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:50.126 01:06:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.126 01:06:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:50.126 01:06:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.126 01:06:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:50.126 01:06:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.126 01:06:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:50.126 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:50.126 01:06:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.126 01:06:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:50.126 01:06:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:50.126 01:06:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:50.126 01:06:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:50.126 01:06:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:50.126 01:06:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:50.126 01:06:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:50.126 01:06:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:50.126 01:06:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:50.126 01:06:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:50.126 01:06:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:50.126 01:06:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:50.126 01:06:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:50.126 01:06:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:50.126 01:06:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:50.126 01:06:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:50.126 01:06:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:50.126 01:06:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:50.126 01:06:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:50.126 01:06:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:50.126 01:06:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:50.126 01:06:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:50.126 01:06:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:50.126 01:06:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:50.126 01:06:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:50.126 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:50.126 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:13:50.126 00:13:50.126 --- 10.0.0.2 ping statistics --- 00:13:50.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:50.126 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:13:50.126 01:06:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:50.126 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:50.126 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:13:50.126 00:13:50.126 --- 10.0.0.1 ping statistics --- 00:13:50.126 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:50.126 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:13:50.126 01:06:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:50.126 01:06:40 -- nvmf/common.sh@410 -- # return 0 00:13:50.126 01:06:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:50.126 01:06:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:50.126 01:06:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:50.126 01:06:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:50.126 01:06:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:50.126 01:06:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:50.126 01:06:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:50.126 01:06:40 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:50.126 01:06:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:50.126 01:06:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:50.126 01:06:40 -- common/autotest_common.sh@10 -- # set +x 00:13:50.126 01:06:40 -- nvmf/common.sh@469 -- # nvmfpid=1019962 00:13:50.126 01:06:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:50.126 01:06:40 -- nvmf/common.sh@470 -- # waitforlisten 1019962 00:13:50.126 01:06:40 -- common/autotest_common.sh@829 -- # '[' -z 1019962 ']' 00:13:50.126 01:06:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:50.126 01:06:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:50.126 01:06:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:50.126 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:50.126 01:06:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:50.126 01:06:40 -- common/autotest_common.sh@10 -- # set +x 00:13:50.126 [2024-11-26 01:06:40.653833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:50.126 [2024-11-26 01:06:40.653897] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:50.385 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.385 [2024-11-26 01:06:40.723207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:50.385 [2024-11-26 01:06:40.841100] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:50.385 [2024-11-26 01:06:40.841275] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:50.385 [2024-11-26 01:06:40.841307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:50.385 [2024-11-26 01:06:40.841320] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:50.385 [2024-11-26 01:06:40.844710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.385 [2024-11-26 01:06:40.844723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:51.326 01:06:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:51.327 01:06:41 -- common/autotest_common.sh@862 -- # return 0 00:13:51.327 01:06:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:51.327 01:06:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 01:06:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:51.327 01:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 [2024-11-26 01:06:41.694907] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:51.327 01:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:51.327 01:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 01:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:51.327 01:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 [2024-11-26 01:06:41.711144] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:51.327 01:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:51.327 01:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 NULL1 00:13:51.327 01:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:51.327 01:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 Delay0 00:13:51.327 01:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:51.327 01:06:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.327 01:06:41 -- common/autotest_common.sh@10 -- # set +x 00:13:51.327 01:06:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@28 -- # perf_pid=1020119 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:51.327 01:06:41 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:51.327 EAL: No free 2048 kB hugepages reported on node 1 00:13:51.327 [2024-11-26 01:06:41.785829] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:53.224 01:06:43 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:53.224 01:06:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.224 01:06:43 -- common/autotest_common.sh@10 -- # set +x 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.790 starting I/O failed: -6 00:13:53.790 Read completed with error (sct=0, sc=8) 00:13:53.790 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 [2024-11-26 01:06:44.078126] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f23f0000c00 is same with the state(5) to be set 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Write completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.791 starting I/O failed: -6 00:13:53.791 Read completed with error (sct=0, sc=8) 00:13:53.792 Read completed with error (sct=0, sc=8) 00:13:53.792 starting I/O failed: -6 00:13:53.792 Write completed with error (sct=0, sc=8) 00:13:53.792 Read completed with error (sct=0, sc=8) 00:13:53.792 starting I/O failed: -6 00:13:53.792 Read completed with error (sct=0, sc=8) 00:13:53.792 starting I/O failed: -6 00:13:53.792 starting I/O failed: -6 00:13:53.792 starting I/O failed: -6 00:13:53.792 starting I/O failed: -6 00:13:53.792 starting I/O failed: -6 00:13:53.792 starting I/O failed: -6 00:13:53.792 starting I/O failed: -6 00:13:54.726 [2024-11-26 01:06:45.044376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe48960 is same with the state(5) to be set 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Read completed with error (sct=0, sc=8) 00:13:54.726 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 [2024-11-26 01:06:45.079875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f23f000c600 is same with the state(5) to be set 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 [2024-11-26 01:06:45.080148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f23f000bf20 is same with the state(5) to be set 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 [2024-11-26 01:06:45.080394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe4f3d0 is same with the state(5) to be set 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Read completed with error (sct=0, sc=8) 00:13:54.727 Write completed with error (sct=0, sc=8) 00:13:54.727 [2024-11-26 01:06:45.081313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe2f770 is same with the state(5) to be set 00:13:54.728 [2024-11-26 01:06:45.081805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe48960 (9): Bad file descriptor 00:13:54.728 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:13:54.728 01:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:54.728 01:06:45 -- target/delete_subsystem.sh@34 -- # delay=0 00:13:54.728 01:06:45 -- target/delete_subsystem.sh@35 -- # kill -0 1020119 00:13:54.728 01:06:45 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:13:54.728 Initializing NVMe Controllers 00:13:54.728 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:54.728 Controller IO queue size 128, less than required. 00:13:54.728 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:54.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:54.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:54.728 Initialization complete. Launching workers. 00:13:54.728 ======================================================== 00:13:54.728 Latency(us) 00:13:54.728 Device Information : IOPS MiB/s Average min max 00:13:54.728 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 183.08 0.09 924119.85 713.51 2004334.23 00:13:54.728 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 190.03 0.09 892709.63 570.85 1011663.33 00:13:54.728 ======================================================== 00:13:54.728 Total : 373.10 0.18 908122.36 570.85 2004334.23 00:13:54.728 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@35 -- # kill -0 1020119 00:13:55.293 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (1020119) - No such process 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@45 -- # NOT wait 1020119 00:13:55.293 01:06:45 -- common/autotest_common.sh@650 -- # local es=0 00:13:55.293 01:06:45 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 1020119 00:13:55.293 01:06:45 -- common/autotest_common.sh@638 -- # local arg=wait 00:13:55.293 01:06:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:55.293 01:06:45 -- common/autotest_common.sh@642 -- # type -t wait 00:13:55.293 01:06:45 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:55.293 01:06:45 -- common/autotest_common.sh@653 -- # wait 1020119 00:13:55.293 01:06:45 -- common/autotest_common.sh@653 -- # es=1 00:13:55.293 01:06:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:55.293 01:06:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:55.293 01:06:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:55.293 01:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.293 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:13:55.293 01:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:55.293 01:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.293 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:13:55.293 [2024-11-26 01:06:45.606356] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.293 01:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.293 01:06:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.293 01:06:45 -- common/autotest_common.sh@10 -- # set +x 00:13:55.293 01:06:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@54 -- # perf_pid=1020616 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@56 -- # delay=0 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:55.293 01:06:45 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:55.293 EAL: No free 2048 kB hugepages reported on node 1 00:13:55.293 [2024-11-26 01:06:45.668567] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:13:55.859 01:06:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:55.859 01:06:46 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:55.859 01:06:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:56.116 01:06:46 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:56.116 01:06:46 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:56.116 01:06:46 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:56.679 01:06:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:56.679 01:06:47 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:56.679 01:06:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:57.244 01:06:47 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:57.244 01:06:47 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:57.244 01:06:47 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:57.809 01:06:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:57.809 01:06:48 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:57.809 01:06:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:58.375 01:06:48 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:58.375 01:06:48 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:58.375 01:06:48 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:13:58.375 Initializing NVMe Controllers 00:13:58.375 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:58.375 Controller IO queue size 128, less than required. 00:13:58.375 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:58.375 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:13:58.375 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:13:58.375 Initialization complete. Launching workers. 00:13:58.375 ======================================================== 00:13:58.375 Latency(us) 00:13:58.375 Device Information : IOPS MiB/s Average min max 00:13:58.375 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003492.85 1000185.96 1043352.83 00:13:58.375 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004198.35 1000240.97 1011013.90 00:13:58.375 ======================================================== 00:13:58.375 Total : 256.00 0.12 1003845.60 1000185.96 1043352.83 00:13:58.375 00:13:58.633 01:06:49 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:13:58.633 01:06:49 -- target/delete_subsystem.sh@57 -- # kill -0 1020616 00:13:58.633 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (1020616) - No such process 00:13:58.633 01:06:49 -- target/delete_subsystem.sh@67 -- # wait 1020616 00:13:58.633 01:06:49 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:13:58.633 01:06:49 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:13:58.633 01:06:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:58.633 01:06:49 -- nvmf/common.sh@116 -- # sync 00:13:58.633 01:06:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:58.633 01:06:49 -- nvmf/common.sh@119 -- # set +e 00:13:58.633 01:06:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:58.633 01:06:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:58.633 rmmod nvme_tcp 00:13:58.633 rmmod nvme_fabrics 00:13:58.891 rmmod nvme_keyring 00:13:58.891 01:06:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:58.891 01:06:49 -- nvmf/common.sh@123 -- # set -e 00:13:58.891 01:06:49 -- nvmf/common.sh@124 -- # return 0 00:13:58.891 01:06:49 -- nvmf/common.sh@477 -- # '[' -n 1019962 ']' 00:13:58.891 01:06:49 -- nvmf/common.sh@478 -- # killprocess 1019962 00:13:58.891 01:06:49 -- common/autotest_common.sh@936 -- # '[' -z 1019962 ']' 00:13:58.891 01:06:49 -- common/autotest_common.sh@940 -- # kill -0 1019962 00:13:58.891 01:06:49 -- common/autotest_common.sh@941 -- # uname 00:13:58.891 01:06:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:58.891 01:06:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1019962 00:13:58.891 01:06:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:58.891 01:06:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:58.891 01:06:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1019962' 00:13:58.891 killing process with pid 1019962 00:13:58.891 01:06:49 -- common/autotest_common.sh@955 -- # kill 1019962 00:13:58.891 01:06:49 -- common/autotest_common.sh@960 -- # wait 1019962 00:13:59.150 01:06:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:59.150 01:06:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:59.150 01:06:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:59.151 01:06:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:59.151 01:06:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:59.151 01:06:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:59.151 01:06:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:59.151 01:06:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.056 01:06:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:01.056 00:14:01.056 real 0m13.310s 00:14:01.056 user 0m29.913s 00:14:01.056 sys 0m3.048s 00:14:01.056 01:06:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:01.056 01:06:51 -- common/autotest_common.sh@10 -- # set +x 00:14:01.056 ************************************ 00:14:01.056 END TEST nvmf_delete_subsystem 00:14:01.056 ************************************ 00:14:01.056 01:06:51 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:01.056 01:06:51 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:01.056 01:06:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:01.056 01:06:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:01.056 01:06:51 -- common/autotest_common.sh@10 -- # set +x 00:14:01.056 ************************************ 00:14:01.056 START TEST nvmf_nvme_cli 00:14:01.056 ************************************ 00:14:01.056 01:06:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:01.314 * Looking for test storage... 00:14:01.314 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:01.314 01:06:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:01.314 01:06:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:01.314 01:06:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:01.314 01:06:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:01.314 01:06:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:01.314 01:06:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:01.314 01:06:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:01.314 01:06:51 -- scripts/common.sh@335 -- # IFS=.-: 00:14:01.314 01:06:51 -- scripts/common.sh@335 -- # read -ra ver1 00:14:01.314 01:06:51 -- scripts/common.sh@336 -- # IFS=.-: 00:14:01.314 01:06:51 -- scripts/common.sh@336 -- # read -ra ver2 00:14:01.314 01:06:51 -- scripts/common.sh@337 -- # local 'op=<' 00:14:01.314 01:06:51 -- scripts/common.sh@339 -- # ver1_l=2 00:14:01.314 01:06:51 -- scripts/common.sh@340 -- # ver2_l=1 00:14:01.314 01:06:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:01.314 01:06:51 -- scripts/common.sh@343 -- # case "$op" in 00:14:01.314 01:06:51 -- scripts/common.sh@344 -- # : 1 00:14:01.314 01:06:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:01.314 01:06:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:01.314 01:06:51 -- scripts/common.sh@364 -- # decimal 1 00:14:01.314 01:06:51 -- scripts/common.sh@352 -- # local d=1 00:14:01.315 01:06:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:01.315 01:06:51 -- scripts/common.sh@354 -- # echo 1 00:14:01.315 01:06:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:01.315 01:06:51 -- scripts/common.sh@365 -- # decimal 2 00:14:01.315 01:06:51 -- scripts/common.sh@352 -- # local d=2 00:14:01.315 01:06:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:01.315 01:06:51 -- scripts/common.sh@354 -- # echo 2 00:14:01.315 01:06:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:01.315 01:06:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:01.315 01:06:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:01.315 01:06:51 -- scripts/common.sh@367 -- # return 0 00:14:01.315 01:06:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:01.315 01:06:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:01.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.315 --rc genhtml_branch_coverage=1 00:14:01.315 --rc genhtml_function_coverage=1 00:14:01.315 --rc genhtml_legend=1 00:14:01.315 --rc geninfo_all_blocks=1 00:14:01.315 --rc geninfo_unexecuted_blocks=1 00:14:01.315 00:14:01.315 ' 00:14:01.315 01:06:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:01.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.315 --rc genhtml_branch_coverage=1 00:14:01.315 --rc genhtml_function_coverage=1 00:14:01.315 --rc genhtml_legend=1 00:14:01.315 --rc geninfo_all_blocks=1 00:14:01.315 --rc geninfo_unexecuted_blocks=1 00:14:01.315 00:14:01.315 ' 00:14:01.315 01:06:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:01.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.315 --rc genhtml_branch_coverage=1 00:14:01.315 --rc genhtml_function_coverage=1 00:14:01.315 --rc genhtml_legend=1 00:14:01.315 --rc geninfo_all_blocks=1 00:14:01.315 --rc geninfo_unexecuted_blocks=1 00:14:01.315 00:14:01.315 ' 00:14:01.315 01:06:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:01.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:01.315 --rc genhtml_branch_coverage=1 00:14:01.315 --rc genhtml_function_coverage=1 00:14:01.315 --rc genhtml_legend=1 00:14:01.315 --rc geninfo_all_blocks=1 00:14:01.315 --rc geninfo_unexecuted_blocks=1 00:14:01.315 00:14:01.315 ' 00:14:01.315 01:06:51 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:01.315 01:06:51 -- nvmf/common.sh@7 -- # uname -s 00:14:01.315 01:06:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:01.315 01:06:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:01.315 01:06:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:01.315 01:06:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:01.315 01:06:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:01.315 01:06:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:01.315 01:06:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:01.315 01:06:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:01.315 01:06:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:01.315 01:06:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:01.315 01:06:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.315 01:06:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:01.315 01:06:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:01.315 01:06:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:01.315 01:06:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:01.315 01:06:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:01.315 01:06:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:01.315 01:06:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:01.315 01:06:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:01.315 01:06:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.315 01:06:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.315 01:06:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.315 01:06:51 -- paths/export.sh@5 -- # export PATH 00:14:01.315 01:06:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:01.315 01:06:51 -- nvmf/common.sh@46 -- # : 0 00:14:01.315 01:06:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:01.315 01:06:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:01.315 01:06:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:01.315 01:06:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:01.315 01:06:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:01.315 01:06:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:01.315 01:06:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:01.315 01:06:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:01.315 01:06:51 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:01.315 01:06:51 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:01.315 01:06:51 -- target/nvme_cli.sh@14 -- # devs=() 00:14:01.315 01:06:51 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:01.315 01:06:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:01.315 01:06:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:01.315 01:06:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:01.315 01:06:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:01.315 01:06:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:01.315 01:06:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:01.315 01:06:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:01.315 01:06:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:01.315 01:06:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:01.315 01:06:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:01.315 01:06:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:01.315 01:06:51 -- common/autotest_common.sh@10 -- # set +x 00:14:03.218 01:06:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:03.218 01:06:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:03.218 01:06:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:03.218 01:06:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:03.218 01:06:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:03.218 01:06:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:03.218 01:06:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:03.218 01:06:53 -- nvmf/common.sh@294 -- # net_devs=() 00:14:03.218 01:06:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:03.218 01:06:53 -- nvmf/common.sh@295 -- # e810=() 00:14:03.218 01:06:53 -- nvmf/common.sh@295 -- # local -ga e810 00:14:03.218 01:06:53 -- nvmf/common.sh@296 -- # x722=() 00:14:03.218 01:06:53 -- nvmf/common.sh@296 -- # local -ga x722 00:14:03.218 01:06:53 -- nvmf/common.sh@297 -- # mlx=() 00:14:03.218 01:06:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:03.218 01:06:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:03.218 01:06:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:03.218 01:06:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:03.218 01:06:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:03.218 01:06:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.218 01:06:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:03.218 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:03.218 01:06:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:03.218 01:06:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:03.218 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:03.218 01:06:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:03.218 01:06:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.218 01:06:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.218 01:06:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.218 01:06:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.218 01:06:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:03.218 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:03.218 01:06:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.218 01:06:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:03.218 01:06:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:03.218 01:06:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:03.218 01:06:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:03.218 01:06:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:03.218 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:03.218 01:06:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:03.218 01:06:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:03.218 01:06:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:03.218 01:06:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:03.218 01:06:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:03.218 01:06:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:03.218 01:06:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:03.218 01:06:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:03.218 01:06:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:03.218 01:06:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:03.218 01:06:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:03.218 01:06:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:03.218 01:06:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:03.218 01:06:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:03.218 01:06:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:03.218 01:06:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:03.218 01:06:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:03.218 01:06:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:03.476 01:06:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:03.476 01:06:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:03.476 01:06:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:03.476 01:06:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:03.476 01:06:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:03.476 01:06:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:03.476 01:06:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:03.476 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:03.476 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:14:03.476 00:14:03.476 --- 10.0.0.2 ping statistics --- 00:14:03.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.476 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:14:03.476 01:06:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:03.476 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:03.476 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:14:03.476 00:14:03.476 --- 10.0.0.1 ping statistics --- 00:14:03.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:03.476 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:14:03.476 01:06:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:03.476 01:06:53 -- nvmf/common.sh@410 -- # return 0 00:14:03.476 01:06:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:03.476 01:06:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:03.476 01:06:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:03.476 01:06:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:03.477 01:06:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:03.477 01:06:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:03.477 01:06:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:03.477 01:06:53 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:03.477 01:06:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:03.477 01:06:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:03.477 01:06:53 -- common/autotest_common.sh@10 -- # set +x 00:14:03.477 01:06:53 -- nvmf/common.sh@469 -- # nvmfpid=1023030 00:14:03.477 01:06:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:03.477 01:06:53 -- nvmf/common.sh@470 -- # waitforlisten 1023030 00:14:03.477 01:06:53 -- common/autotest_common.sh@829 -- # '[' -z 1023030 ']' 00:14:03.477 01:06:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:03.477 01:06:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:03.477 01:06:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:03.477 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:03.477 01:06:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:03.477 01:06:53 -- common/autotest_common.sh@10 -- # set +x 00:14:03.477 [2024-11-26 01:06:53.891862] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:03.477 [2024-11-26 01:06:53.891963] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:03.477 EAL: No free 2048 kB hugepages reported on node 1 00:14:03.477 [2024-11-26 01:06:53.956756] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:03.734 [2024-11-26 01:06:54.067033] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:03.735 [2024-11-26 01:06:54.067195] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:03.735 [2024-11-26 01:06:54.067227] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:03.735 [2024-11-26 01:06:54.067239] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:03.735 [2024-11-26 01:06:54.067511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:03.735 [2024-11-26 01:06:54.067574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:03.735 [2024-11-26 01:06:54.067626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:03.735 [2024-11-26 01:06:54.067629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:04.670 01:06:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:04.670 01:06:54 -- common/autotest_common.sh@862 -- # return 0 00:14:04.670 01:06:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:04.670 01:06:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 01:06:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:04.670 01:06:54 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 [2024-11-26 01:06:54.904342] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 Malloc0 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 Malloc1 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 [2024-11-26 01:06:54.986376] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:04.670 01:06:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.670 01:06:54 -- common/autotest_common.sh@10 -- # set +x 00:14:04.670 01:06:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.670 01:06:54 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:04.670 00:14:04.670 Discovery Log Number of Records 2, Generation counter 2 00:14:04.670 =====Discovery Log Entry 0====== 00:14:04.670 trtype: tcp 00:14:04.670 adrfam: ipv4 00:14:04.670 subtype: current discovery subsystem 00:14:04.670 treq: not required 00:14:04.670 portid: 0 00:14:04.670 trsvcid: 4420 00:14:04.670 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:04.670 traddr: 10.0.0.2 00:14:04.670 eflags: explicit discovery connections, duplicate discovery information 00:14:04.670 sectype: none 00:14:04.670 =====Discovery Log Entry 1====== 00:14:04.670 trtype: tcp 00:14:04.670 adrfam: ipv4 00:14:04.670 subtype: nvme subsystem 00:14:04.670 treq: not required 00:14:04.670 portid: 0 00:14:04.670 trsvcid: 4420 00:14:04.670 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:04.670 traddr: 10.0.0.2 00:14:04.670 eflags: none 00:14:04.670 sectype: none 00:14:04.670 01:06:55 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:04.670 01:06:55 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:04.670 01:06:55 -- nvmf/common.sh@510 -- # local dev _ 00:14:04.670 01:06:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:04.670 01:06:55 -- nvmf/common.sh@509 -- # nvme list 00:14:04.670 01:06:55 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:04.670 01:06:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:04.670 01:06:55 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:04.670 01:06:55 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:04.670 01:06:55 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:04.670 01:06:55 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:05.236 01:06:55 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:05.236 01:06:55 -- common/autotest_common.sh@1187 -- # local i=0 00:14:05.236 01:06:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:05.236 01:06:55 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:05.236 01:06:55 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:05.236 01:06:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:07.764 01:06:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:07.764 01:06:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:07.764 01:06:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:07.764 01:06:57 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:07.764 01:06:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:07.764 01:06:57 -- common/autotest_common.sh@1197 -- # return 0 00:14:07.764 01:06:57 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:07.764 01:06:57 -- nvmf/common.sh@510 -- # local dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@509 -- # nvme list 00:14:07.764 01:06:57 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:07.764 01:06:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:07.764 01:06:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:07.764 01:06:57 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:07.764 01:06:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:07.764 01:06:57 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:07.764 01:06:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:57 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:07.764 /dev/nvme0n2 ]] 00:14:07.764 01:06:57 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:07.764 01:06:57 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:07.764 01:06:57 -- nvmf/common.sh@510 -- # local dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:57 -- nvmf/common.sh@509 -- # nvme list 00:14:07.764 01:06:58 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:07.764 01:06:58 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:58 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:07.764 01:06:58 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:58 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:07.764 01:06:58 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:07.764 01:06:58 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.764 01:06:58 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:07.764 01:06:58 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:07.764 01:06:58 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:07.765 01:06:58 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:07.765 01:06:58 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:07.765 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:07.765 01:06:58 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:07.765 01:06:58 -- common/autotest_common.sh@1208 -- # local i=0 00:14:07.765 01:06:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:07.765 01:06:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:08.023 01:06:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:08.023 01:06:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:08.023 01:06:58 -- common/autotest_common.sh@1220 -- # return 0 00:14:08.023 01:06:58 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:08.023 01:06:58 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:08.023 01:06:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.023 01:06:58 -- common/autotest_common.sh@10 -- # set +x 00:14:08.023 01:06:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.023 01:06:58 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:08.023 01:06:58 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:08.023 01:06:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:08.023 01:06:58 -- nvmf/common.sh@116 -- # sync 00:14:08.023 01:06:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:08.023 01:06:58 -- nvmf/common.sh@119 -- # set +e 00:14:08.023 01:06:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:08.023 01:06:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:08.023 rmmod nvme_tcp 00:14:08.023 rmmod nvme_fabrics 00:14:08.023 rmmod nvme_keyring 00:14:08.023 01:06:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:08.023 01:06:58 -- nvmf/common.sh@123 -- # set -e 00:14:08.023 01:06:58 -- nvmf/common.sh@124 -- # return 0 00:14:08.023 01:06:58 -- nvmf/common.sh@477 -- # '[' -n 1023030 ']' 00:14:08.023 01:06:58 -- nvmf/common.sh@478 -- # killprocess 1023030 00:14:08.023 01:06:58 -- common/autotest_common.sh@936 -- # '[' -z 1023030 ']' 00:14:08.023 01:06:58 -- common/autotest_common.sh@940 -- # kill -0 1023030 00:14:08.023 01:06:58 -- common/autotest_common.sh@941 -- # uname 00:14:08.023 01:06:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:08.023 01:06:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1023030 00:14:08.023 01:06:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:08.023 01:06:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:08.023 01:06:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1023030' 00:14:08.023 killing process with pid 1023030 00:14:08.023 01:06:58 -- common/autotest_common.sh@955 -- # kill 1023030 00:14:08.023 01:06:58 -- common/autotest_common.sh@960 -- # wait 1023030 00:14:08.282 01:06:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:08.282 01:06:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:08.282 01:06:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:08.282 01:06:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:08.282 01:06:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:08.282 01:06:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:08.282 01:06:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:08.282 01:06:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.819 01:07:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:10.819 00:14:10.819 real 0m9.205s 00:14:10.819 user 0m19.209s 00:14:10.819 sys 0m2.239s 00:14:10.819 01:07:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:10.819 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:14:10.819 ************************************ 00:14:10.819 END TEST nvmf_nvme_cli 00:14:10.819 ************************************ 00:14:10.819 01:07:00 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:10.820 01:07:00 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:10.820 01:07:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:10.820 01:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:10.820 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:14:10.820 ************************************ 00:14:10.820 START TEST nvmf_host_management 00:14:10.820 ************************************ 00:14:10.820 01:07:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:10.820 * Looking for test storage... 00:14:10.820 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:10.820 01:07:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:10.820 01:07:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:10.820 01:07:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:10.820 01:07:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:10.820 01:07:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:10.820 01:07:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:10.820 01:07:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:10.820 01:07:00 -- scripts/common.sh@335 -- # IFS=.-: 00:14:10.820 01:07:00 -- scripts/common.sh@335 -- # read -ra ver1 00:14:10.820 01:07:00 -- scripts/common.sh@336 -- # IFS=.-: 00:14:10.820 01:07:00 -- scripts/common.sh@336 -- # read -ra ver2 00:14:10.820 01:07:00 -- scripts/common.sh@337 -- # local 'op=<' 00:14:10.820 01:07:00 -- scripts/common.sh@339 -- # ver1_l=2 00:14:10.820 01:07:00 -- scripts/common.sh@340 -- # ver2_l=1 00:14:10.820 01:07:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:10.820 01:07:00 -- scripts/common.sh@343 -- # case "$op" in 00:14:10.820 01:07:00 -- scripts/common.sh@344 -- # : 1 00:14:10.820 01:07:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:10.820 01:07:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:10.820 01:07:00 -- scripts/common.sh@364 -- # decimal 1 00:14:10.820 01:07:00 -- scripts/common.sh@352 -- # local d=1 00:14:10.820 01:07:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:10.820 01:07:00 -- scripts/common.sh@354 -- # echo 1 00:14:10.820 01:07:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:10.820 01:07:00 -- scripts/common.sh@365 -- # decimal 2 00:14:10.820 01:07:00 -- scripts/common.sh@352 -- # local d=2 00:14:10.820 01:07:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:10.820 01:07:00 -- scripts/common.sh@354 -- # echo 2 00:14:10.820 01:07:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:10.820 01:07:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:10.820 01:07:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:10.820 01:07:00 -- scripts/common.sh@367 -- # return 0 00:14:10.820 01:07:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:10.820 01:07:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:10.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.820 --rc genhtml_branch_coverage=1 00:14:10.820 --rc genhtml_function_coverage=1 00:14:10.820 --rc genhtml_legend=1 00:14:10.820 --rc geninfo_all_blocks=1 00:14:10.820 --rc geninfo_unexecuted_blocks=1 00:14:10.820 00:14:10.820 ' 00:14:10.820 01:07:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:10.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.820 --rc genhtml_branch_coverage=1 00:14:10.820 --rc genhtml_function_coverage=1 00:14:10.820 --rc genhtml_legend=1 00:14:10.820 --rc geninfo_all_blocks=1 00:14:10.820 --rc geninfo_unexecuted_blocks=1 00:14:10.820 00:14:10.820 ' 00:14:10.820 01:07:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:10.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.820 --rc genhtml_branch_coverage=1 00:14:10.820 --rc genhtml_function_coverage=1 00:14:10.820 --rc genhtml_legend=1 00:14:10.820 --rc geninfo_all_blocks=1 00:14:10.820 --rc geninfo_unexecuted_blocks=1 00:14:10.820 00:14:10.820 ' 00:14:10.820 01:07:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:10.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:10.820 --rc genhtml_branch_coverage=1 00:14:10.820 --rc genhtml_function_coverage=1 00:14:10.820 --rc genhtml_legend=1 00:14:10.820 --rc geninfo_all_blocks=1 00:14:10.820 --rc geninfo_unexecuted_blocks=1 00:14:10.820 00:14:10.820 ' 00:14:10.820 01:07:00 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:10.820 01:07:00 -- nvmf/common.sh@7 -- # uname -s 00:14:10.820 01:07:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:10.820 01:07:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:10.820 01:07:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:10.820 01:07:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:10.820 01:07:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:10.820 01:07:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:10.820 01:07:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:10.820 01:07:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:10.820 01:07:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:10.820 01:07:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:10.820 01:07:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.820 01:07:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:10.820 01:07:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:10.820 01:07:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:10.820 01:07:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:10.820 01:07:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:10.820 01:07:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:10.820 01:07:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:10.820 01:07:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:10.820 01:07:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.820 01:07:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.820 01:07:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.820 01:07:00 -- paths/export.sh@5 -- # export PATH 00:14:10.820 01:07:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:10.820 01:07:00 -- nvmf/common.sh@46 -- # : 0 00:14:10.820 01:07:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:10.820 01:07:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:10.820 01:07:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:10.820 01:07:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:10.820 01:07:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:10.820 01:07:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:10.820 01:07:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:10.820 01:07:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:10.820 01:07:00 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:10.820 01:07:00 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:10.820 01:07:00 -- target/host_management.sh@104 -- # nvmftestinit 00:14:10.820 01:07:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:10.820 01:07:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:10.820 01:07:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:10.820 01:07:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:10.820 01:07:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:10.820 01:07:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:10.820 01:07:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:10.820 01:07:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:10.820 01:07:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:10.820 01:07:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:10.820 01:07:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:10.820 01:07:00 -- common/autotest_common.sh@10 -- # set +x 00:14:12.724 01:07:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:12.724 01:07:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:12.724 01:07:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:12.724 01:07:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:12.724 01:07:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:12.724 01:07:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:12.724 01:07:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:12.724 01:07:03 -- nvmf/common.sh@294 -- # net_devs=() 00:14:12.724 01:07:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:12.724 01:07:03 -- nvmf/common.sh@295 -- # e810=() 00:14:12.724 01:07:03 -- nvmf/common.sh@295 -- # local -ga e810 00:14:12.724 01:07:03 -- nvmf/common.sh@296 -- # x722=() 00:14:12.724 01:07:03 -- nvmf/common.sh@296 -- # local -ga x722 00:14:12.724 01:07:03 -- nvmf/common.sh@297 -- # mlx=() 00:14:12.724 01:07:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:12.724 01:07:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:12.724 01:07:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:12.724 01:07:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:12.724 01:07:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:12.724 01:07:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:12.724 01:07:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:12.724 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:12.724 01:07:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:12.724 01:07:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:12.724 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:12.724 01:07:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:12.724 01:07:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:12.724 01:07:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.724 01:07:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:12.724 01:07:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.724 01:07:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:12.724 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:12.724 01:07:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.724 01:07:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:12.724 01:07:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:12.724 01:07:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:12.724 01:07:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:12.724 01:07:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:12.724 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:12.724 01:07:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:12.724 01:07:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:12.724 01:07:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:12.724 01:07:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:12.724 01:07:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:12.724 01:07:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:12.724 01:07:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:12.724 01:07:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:12.724 01:07:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:12.724 01:07:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:12.724 01:07:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:12.724 01:07:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:12.724 01:07:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:12.724 01:07:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:12.724 01:07:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:12.724 01:07:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:12.724 01:07:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:12.724 01:07:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:12.724 01:07:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:12.724 01:07:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:12.724 01:07:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:12.724 01:07:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:12.724 01:07:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:12.724 01:07:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:12.724 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:12.724 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.207 ms 00:14:12.724 00:14:12.724 --- 10.0.0.2 ping statistics --- 00:14:12.724 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.724 rtt min/avg/max/mdev = 0.207/0.207/0.207/0.000 ms 00:14:12.724 01:07:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:12.724 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:12.724 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:14:12.724 00:14:12.724 --- 10.0.0.1 ping statistics --- 00:14:12.724 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:12.724 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:14:12.724 01:07:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:12.724 01:07:03 -- nvmf/common.sh@410 -- # return 0 00:14:12.724 01:07:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:12.724 01:07:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:12.724 01:07:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:12.724 01:07:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:12.724 01:07:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:12.724 01:07:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:12.724 01:07:03 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:12.724 01:07:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:12.724 01:07:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:12.724 01:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:12.724 ************************************ 00:14:12.724 START TEST nvmf_host_management 00:14:12.724 ************************************ 00:14:12.724 01:07:03 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:12.724 01:07:03 -- target/host_management.sh@69 -- # starttarget 00:14:12.724 01:07:03 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:12.724 01:07:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:12.724 01:07:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:12.724 01:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:12.724 01:07:03 -- nvmf/common.sh@469 -- # nvmfpid=1025584 00:14:12.724 01:07:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:12.724 01:07:03 -- nvmf/common.sh@470 -- # waitforlisten 1025584 00:14:12.724 01:07:03 -- common/autotest_common.sh@829 -- # '[' -z 1025584 ']' 00:14:12.724 01:07:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:12.725 01:07:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:12.725 01:07:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:12.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:12.725 01:07:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:12.725 01:07:03 -- common/autotest_common.sh@10 -- # set +x 00:14:12.725 [2024-11-26 01:07:03.244753] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:12.725 [2024-11-26 01:07:03.244833] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:12.982 EAL: No free 2048 kB hugepages reported on node 1 00:14:12.982 [2024-11-26 01:07:03.307447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:12.982 [2024-11-26 01:07:03.413005] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:12.982 [2024-11-26 01:07:03.413154] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:12.982 [2024-11-26 01:07:03.413172] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:12.982 [2024-11-26 01:07:03.413183] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:12.982 [2024-11-26 01:07:03.413278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:12.982 [2024-11-26 01:07:03.413343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:12.982 [2024-11-26 01:07:03.413394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:12.982 [2024-11-26 01:07:03.413397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:13.916 01:07:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:13.916 01:07:04 -- common/autotest_common.sh@862 -- # return 0 00:14:13.916 01:07:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:13.916 01:07:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:13.916 01:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:13.916 01:07:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:13.916 01:07:04 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:13.916 01:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.916 01:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:13.916 [2024-11-26 01:07:04.221255] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:13.916 01:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.916 01:07:04 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:13.916 01:07:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:13.916 01:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:13.916 01:07:04 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:13.916 01:07:04 -- target/host_management.sh@23 -- # cat 00:14:13.916 01:07:04 -- target/host_management.sh@30 -- # rpc_cmd 00:14:13.916 01:07:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.916 01:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:13.916 Malloc0 00:14:13.916 [2024-11-26 01:07:04.282764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:13.916 01:07:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.917 01:07:04 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:13.917 01:07:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:13.917 01:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:13.917 01:07:04 -- target/host_management.sh@73 -- # perfpid=1025758 00:14:13.917 01:07:04 -- target/host_management.sh@74 -- # waitforlisten 1025758 /var/tmp/bdevperf.sock 00:14:13.917 01:07:04 -- common/autotest_common.sh@829 -- # '[' -z 1025758 ']' 00:14:13.917 01:07:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:13.917 01:07:04 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:13.917 01:07:04 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:13.917 01:07:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:13.917 01:07:04 -- nvmf/common.sh@520 -- # config=() 00:14:13.917 01:07:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:13.917 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:13.917 01:07:04 -- nvmf/common.sh@520 -- # local subsystem config 00:14:13.917 01:07:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:13.917 01:07:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:13.917 01:07:04 -- common/autotest_common.sh@10 -- # set +x 00:14:13.917 01:07:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:13.917 { 00:14:13.917 "params": { 00:14:13.917 "name": "Nvme$subsystem", 00:14:13.917 "trtype": "$TEST_TRANSPORT", 00:14:13.917 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:13.917 "adrfam": "ipv4", 00:14:13.917 "trsvcid": "$NVMF_PORT", 00:14:13.917 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:13.917 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:13.917 "hdgst": ${hdgst:-false}, 00:14:13.917 "ddgst": ${ddgst:-false} 00:14:13.917 }, 00:14:13.917 "method": "bdev_nvme_attach_controller" 00:14:13.917 } 00:14:13.917 EOF 00:14:13.917 )") 00:14:13.917 01:07:04 -- nvmf/common.sh@542 -- # cat 00:14:13.917 01:07:04 -- nvmf/common.sh@544 -- # jq . 00:14:13.917 01:07:04 -- nvmf/common.sh@545 -- # IFS=, 00:14:13.917 01:07:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:13.917 "params": { 00:14:13.917 "name": "Nvme0", 00:14:13.917 "trtype": "tcp", 00:14:13.917 "traddr": "10.0.0.2", 00:14:13.917 "adrfam": "ipv4", 00:14:13.917 "trsvcid": "4420", 00:14:13.917 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:13.917 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:13.917 "hdgst": false, 00:14:13.917 "ddgst": false 00:14:13.917 }, 00:14:13.917 "method": "bdev_nvme_attach_controller" 00:14:13.917 }' 00:14:13.917 [2024-11-26 01:07:04.358650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:13.917 [2024-11-26 01:07:04.358746] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1025758 ] 00:14:13.917 EAL: No free 2048 kB hugepages reported on node 1 00:14:13.917 [2024-11-26 01:07:04.418344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:14.174 [2024-11-26 01:07:04.525982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:14.433 Running I/O for 10 seconds... 00:14:15.000 01:07:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:15.001 01:07:05 -- common/autotest_common.sh@862 -- # return 0 00:14:15.001 01:07:05 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:15.001 01:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.001 01:07:05 -- common/autotest_common.sh@10 -- # set +x 00:14:15.001 01:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.001 01:07:05 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:15.001 01:07:05 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:15.001 01:07:05 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:15.001 01:07:05 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:15.001 01:07:05 -- target/host_management.sh@52 -- # local ret=1 00:14:15.001 01:07:05 -- target/host_management.sh@53 -- # local i 00:14:15.001 01:07:05 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:15.001 01:07:05 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:15.001 01:07:05 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:15.001 01:07:05 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:15.001 01:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.001 01:07:05 -- common/autotest_common.sh@10 -- # set +x 00:14:15.001 01:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.001 01:07:05 -- target/host_management.sh@55 -- # read_io_count=1783 00:14:15.001 01:07:05 -- target/host_management.sh@58 -- # '[' 1783 -ge 100 ']' 00:14:15.001 01:07:05 -- target/host_management.sh@59 -- # ret=0 00:14:15.001 01:07:05 -- target/host_management.sh@60 -- # break 00:14:15.001 01:07:05 -- target/host_management.sh@64 -- # return 0 00:14:15.001 01:07:05 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:15.001 01:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.001 01:07:05 -- common/autotest_common.sh@10 -- # set +x 00:14:15.001 [2024-11-26 01:07:05.378609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.378998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.001 [2024-11-26 01:07:05.379298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379390] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ffae60 is same with the state(5) to be set 00:14:15.002 [2024-11-26 01:07:05.379556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:116352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:116480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:116608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:116864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:116992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:117120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:117248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:111360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:117504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:111488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:117632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.379961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.379976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:117760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:118016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:112128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:118528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:118912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:119040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:119168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.002 [2024-11-26 01:07:05.380382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:119296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.002 [2024-11-26 01:07:05.380396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:112256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:119424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:119552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:119680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:112384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:119808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:119936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:120064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:112768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:120192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:120320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:113024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:120448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:120576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:120704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:120832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:113408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:113792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:114176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.380973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.380989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:114432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:114688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:115072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:115200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:115456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:120960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:121088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:121216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:121344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:121472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:121600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.003 [2024-11-26 01:07:05.381311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.003 [2024-11-26 01:07:05.381326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:121728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:121856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:121984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:122112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:115968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:122240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:122368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:15.004 [2024-11-26 01:07:05.381547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.381562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1672030 is same with the state(5) to be set 00:14:15.004 [2024-11-26 01:07:05.381642] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1672030 was disconnected and freed. reset controller. 00:14:15.004 [2024-11-26 01:07:05.382813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:15.004 01:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.004 01:07:05 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:15.004 01:07:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.004 01:07:05 -- common/autotest_common.sh@10 -- # set +x 00:14:15.004 task offset: 116352 on job bdev=Nvme0n1 fails 00:14:15.004 00:14:15.004 Latency(us) 00:14:15.004 [2024-11-26T00:07:05.539Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:15.004 [2024-11-26T00:07:05.539Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:15.004 [2024-11-26T00:07:05.539Z] Job: Nvme0n1 ended in about 0.51 seconds with error 00:14:15.004 Verification LBA range: start 0x0 length 0x400 00:14:15.004 Nvme0n1 : 0.51 3731.23 233.20 124.57 0.00 16327.60 4247.70 23787.14 00:14:15.004 [2024-11-26T00:07:05.539Z] =================================================================================================================== 00:14:15.004 [2024-11-26T00:07:05.539Z] Total : 3731.23 233.20 124.57 0.00 16327.60 4247.70 23787.14 00:14:15.004 [2024-11-26 01:07:05.384720] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:15.004 [2024-11-26 01:07:05.384759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1674160 (9): Bad file descriptor 00:14:15.004 [2024-11-26 01:07:05.385940] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode0' does not allow host 'nqn.2016-06.io.spdk:host0' 00:14:15.004 [2024-11-26 01:07:05.386063] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:14:15.004 [2024-11-26 01:07:05.386093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND SPECIFIC (01/84) qid:0 cid:3 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:15.004 [2024-11-26 01:07:05.386122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode0 00:14:15.004 [2024-11-26 01:07:05.386139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 132 00:14:15.004 [2024-11-26 01:07:05.386153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:14:15.004 [2024-11-26 01:07:05.386168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1674160 00:14:15.004 [2024-11-26 01:07:05.386202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1674160 (9): Bad file descriptor 00:14:15.004 [2024-11-26 01:07:05.386226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:14:15.004 [2024-11-26 01:07:05.386241] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:14:15.004 [2024-11-26 01:07:05.386256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:14:15.004 [2024-11-26 01:07:05.386277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:14:15.004 01:07:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.004 01:07:05 -- target/host_management.sh@87 -- # sleep 1 00:14:15.995 01:07:06 -- target/host_management.sh@91 -- # kill -9 1025758 00:14:15.995 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (1025758) - No such process 00:14:15.995 01:07:06 -- target/host_management.sh@91 -- # true 00:14:15.995 01:07:06 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:15.996 01:07:06 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:15.996 01:07:06 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:15.996 01:07:06 -- nvmf/common.sh@520 -- # config=() 00:14:15.996 01:07:06 -- nvmf/common.sh@520 -- # local subsystem config 00:14:15.996 01:07:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:15.996 01:07:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:15.996 { 00:14:15.996 "params": { 00:14:15.996 "name": "Nvme$subsystem", 00:14:15.996 "trtype": "$TEST_TRANSPORT", 00:14:15.996 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:15.996 "adrfam": "ipv4", 00:14:15.996 "trsvcid": "$NVMF_PORT", 00:14:15.996 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:15.996 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:15.996 "hdgst": ${hdgst:-false}, 00:14:15.996 "ddgst": ${ddgst:-false} 00:14:15.996 }, 00:14:15.996 "method": "bdev_nvme_attach_controller" 00:14:15.996 } 00:14:15.996 EOF 00:14:15.996 )") 00:14:15.996 01:07:06 -- nvmf/common.sh@542 -- # cat 00:14:15.996 01:07:06 -- nvmf/common.sh@544 -- # jq . 00:14:15.996 01:07:06 -- nvmf/common.sh@545 -- # IFS=, 00:14:15.996 01:07:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:15.996 "params": { 00:14:15.996 "name": "Nvme0", 00:14:15.996 "trtype": "tcp", 00:14:15.996 "traddr": "10.0.0.2", 00:14:15.996 "adrfam": "ipv4", 00:14:15.996 "trsvcid": "4420", 00:14:15.996 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:15.996 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:15.996 "hdgst": false, 00:14:15.996 "ddgst": false 00:14:15.996 }, 00:14:15.996 "method": "bdev_nvme_attach_controller" 00:14:15.996 }' 00:14:15.996 [2024-11-26 01:07:06.431558] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:15.996 [2024-11-26 01:07:06.431630] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1026049 ] 00:14:15.996 EAL: No free 2048 kB hugepages reported on node 1 00:14:15.996 [2024-11-26 01:07:06.492815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:16.253 [2024-11-26 01:07:06.604207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:16.511 Running I/O for 1 seconds... 00:14:17.445 00:14:17.445 Latency(us) 00:14:17.445 [2024-11-26T00:07:07.980Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:17.445 [2024-11-26T00:07:07.980Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:17.445 Verification LBA range: start 0x0 length 0x400 00:14:17.445 Nvme0n1 : 1.01 2978.14 186.13 0.00 0.00 21211.21 1456.36 21845.33 00:14:17.445 [2024-11-26T00:07:07.980Z] =================================================================================================================== 00:14:17.445 [2024-11-26T00:07:07.980Z] Total : 2978.14 186.13 0.00 0.00 21211.21 1456.36 21845.33 00:14:17.703 01:07:08 -- target/host_management.sh@101 -- # stoptarget 00:14:17.703 01:07:08 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:17.703 01:07:08 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:17.703 01:07:08 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:17.703 01:07:08 -- target/host_management.sh@40 -- # nvmftestfini 00:14:17.703 01:07:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:17.703 01:07:08 -- nvmf/common.sh@116 -- # sync 00:14:17.703 01:07:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:17.703 01:07:08 -- nvmf/common.sh@119 -- # set +e 00:14:17.703 01:07:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:17.703 01:07:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:17.703 rmmod nvme_tcp 00:14:17.703 rmmod nvme_fabrics 00:14:17.703 rmmod nvme_keyring 00:14:17.703 01:07:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:17.703 01:07:08 -- nvmf/common.sh@123 -- # set -e 00:14:17.703 01:07:08 -- nvmf/common.sh@124 -- # return 0 00:14:17.703 01:07:08 -- nvmf/common.sh@477 -- # '[' -n 1025584 ']' 00:14:17.703 01:07:08 -- nvmf/common.sh@478 -- # killprocess 1025584 00:14:17.703 01:07:08 -- common/autotest_common.sh@936 -- # '[' -z 1025584 ']' 00:14:17.703 01:07:08 -- common/autotest_common.sh@940 -- # kill -0 1025584 00:14:17.703 01:07:08 -- common/autotest_common.sh@941 -- # uname 00:14:17.703 01:07:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:17.703 01:07:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1025584 00:14:17.703 01:07:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:17.703 01:07:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:17.703 01:07:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1025584' 00:14:17.703 killing process with pid 1025584 00:14:17.703 01:07:08 -- common/autotest_common.sh@955 -- # kill 1025584 00:14:17.703 01:07:08 -- common/autotest_common.sh@960 -- # wait 1025584 00:14:17.962 [2024-11-26 01:07:08.461390] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:17.962 01:07:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:17.962 01:07:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:17.962 01:07:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:17.962 01:07:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:17.962 01:07:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:17.962 01:07:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.962 01:07:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.962 01:07:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:20.496 01:07:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:20.496 00:14:20.496 real 0m7.328s 00:14:20.496 user 0m22.547s 00:14:20.496 sys 0m1.371s 00:14:20.496 01:07:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:20.496 01:07:10 -- common/autotest_common.sh@10 -- # set +x 00:14:20.496 ************************************ 00:14:20.496 END TEST nvmf_host_management 00:14:20.496 ************************************ 00:14:20.496 01:07:10 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:20.496 00:14:20.496 real 0m9.741s 00:14:20.496 user 0m23.448s 00:14:20.496 sys 0m2.909s 00:14:20.496 01:07:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:20.496 01:07:10 -- common/autotest_common.sh@10 -- # set +x 00:14:20.496 ************************************ 00:14:20.496 END TEST nvmf_host_management 00:14:20.496 ************************************ 00:14:20.496 01:07:10 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:20.496 01:07:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:20.496 01:07:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:20.496 01:07:10 -- common/autotest_common.sh@10 -- # set +x 00:14:20.496 ************************************ 00:14:20.496 START TEST nvmf_lvol 00:14:20.496 ************************************ 00:14:20.497 01:07:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:20.497 * Looking for test storage... 00:14:20.497 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:20.497 01:07:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:20.497 01:07:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:20.497 01:07:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:20.497 01:07:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:20.497 01:07:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:20.497 01:07:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:20.497 01:07:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:20.497 01:07:10 -- scripts/common.sh@335 -- # IFS=.-: 00:14:20.497 01:07:10 -- scripts/common.sh@335 -- # read -ra ver1 00:14:20.497 01:07:10 -- scripts/common.sh@336 -- # IFS=.-: 00:14:20.497 01:07:10 -- scripts/common.sh@336 -- # read -ra ver2 00:14:20.497 01:07:10 -- scripts/common.sh@337 -- # local 'op=<' 00:14:20.497 01:07:10 -- scripts/common.sh@339 -- # ver1_l=2 00:14:20.497 01:07:10 -- scripts/common.sh@340 -- # ver2_l=1 00:14:20.497 01:07:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:20.497 01:07:10 -- scripts/common.sh@343 -- # case "$op" in 00:14:20.497 01:07:10 -- scripts/common.sh@344 -- # : 1 00:14:20.497 01:07:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:20.497 01:07:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:20.497 01:07:10 -- scripts/common.sh@364 -- # decimal 1 00:14:20.497 01:07:10 -- scripts/common.sh@352 -- # local d=1 00:14:20.497 01:07:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:20.497 01:07:10 -- scripts/common.sh@354 -- # echo 1 00:14:20.497 01:07:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:20.497 01:07:10 -- scripts/common.sh@365 -- # decimal 2 00:14:20.497 01:07:10 -- scripts/common.sh@352 -- # local d=2 00:14:20.497 01:07:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:20.497 01:07:10 -- scripts/common.sh@354 -- # echo 2 00:14:20.497 01:07:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:20.497 01:07:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:20.497 01:07:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:20.497 01:07:10 -- scripts/common.sh@367 -- # return 0 00:14:20.497 01:07:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:20.497 01:07:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:20.497 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.497 --rc genhtml_branch_coverage=1 00:14:20.497 --rc genhtml_function_coverage=1 00:14:20.497 --rc genhtml_legend=1 00:14:20.497 --rc geninfo_all_blocks=1 00:14:20.497 --rc geninfo_unexecuted_blocks=1 00:14:20.497 00:14:20.497 ' 00:14:20.497 01:07:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:20.497 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.497 --rc genhtml_branch_coverage=1 00:14:20.497 --rc genhtml_function_coverage=1 00:14:20.497 --rc genhtml_legend=1 00:14:20.497 --rc geninfo_all_blocks=1 00:14:20.497 --rc geninfo_unexecuted_blocks=1 00:14:20.497 00:14:20.497 ' 00:14:20.497 01:07:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:20.497 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.497 --rc genhtml_branch_coverage=1 00:14:20.497 --rc genhtml_function_coverage=1 00:14:20.497 --rc genhtml_legend=1 00:14:20.497 --rc geninfo_all_blocks=1 00:14:20.497 --rc geninfo_unexecuted_blocks=1 00:14:20.497 00:14:20.497 ' 00:14:20.497 01:07:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:20.497 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:20.497 --rc genhtml_branch_coverage=1 00:14:20.497 --rc genhtml_function_coverage=1 00:14:20.497 --rc genhtml_legend=1 00:14:20.497 --rc geninfo_all_blocks=1 00:14:20.497 --rc geninfo_unexecuted_blocks=1 00:14:20.497 00:14:20.497 ' 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:20.497 01:07:10 -- nvmf/common.sh@7 -- # uname -s 00:14:20.497 01:07:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:20.497 01:07:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:20.497 01:07:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:20.497 01:07:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:20.497 01:07:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:20.497 01:07:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:20.497 01:07:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:20.497 01:07:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:20.497 01:07:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:20.497 01:07:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:20.497 01:07:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:20.497 01:07:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:20.497 01:07:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:20.497 01:07:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:20.497 01:07:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:20.497 01:07:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:20.497 01:07:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:20.497 01:07:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:20.497 01:07:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:20.497 01:07:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.497 01:07:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.497 01:07:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.497 01:07:10 -- paths/export.sh@5 -- # export PATH 00:14:20.497 01:07:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:20.497 01:07:10 -- nvmf/common.sh@46 -- # : 0 00:14:20.497 01:07:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:20.497 01:07:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:20.497 01:07:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:20.497 01:07:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:20.497 01:07:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:20.497 01:07:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:20.497 01:07:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:20.497 01:07:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:20.497 01:07:10 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:20.497 01:07:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:20.497 01:07:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:20.497 01:07:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:20.497 01:07:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:20.497 01:07:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:20.497 01:07:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:20.497 01:07:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:20.497 01:07:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:20.497 01:07:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:20.497 01:07:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:20.497 01:07:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:20.497 01:07:10 -- common/autotest_common.sh@10 -- # set +x 00:14:22.400 01:07:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:22.400 01:07:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:22.400 01:07:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:22.400 01:07:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:22.400 01:07:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:22.400 01:07:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:22.400 01:07:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:22.400 01:07:12 -- nvmf/common.sh@294 -- # net_devs=() 00:14:22.400 01:07:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:22.400 01:07:12 -- nvmf/common.sh@295 -- # e810=() 00:14:22.400 01:07:12 -- nvmf/common.sh@295 -- # local -ga e810 00:14:22.400 01:07:12 -- nvmf/common.sh@296 -- # x722=() 00:14:22.400 01:07:12 -- nvmf/common.sh@296 -- # local -ga x722 00:14:22.400 01:07:12 -- nvmf/common.sh@297 -- # mlx=() 00:14:22.400 01:07:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:22.400 01:07:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:22.400 01:07:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:22.400 01:07:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:22.400 01:07:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:22.400 01:07:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.400 01:07:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:22.400 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:22.400 01:07:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.400 01:07:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:22.400 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:22.400 01:07:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:22.400 01:07:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.400 01:07:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.400 01:07:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.400 01:07:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.400 01:07:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:22.400 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:22.400 01:07:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.400 01:07:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.400 01:07:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.400 01:07:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.400 01:07:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.400 01:07:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:22.400 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:22.400 01:07:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.400 01:07:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:22.400 01:07:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:22.400 01:07:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:22.400 01:07:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:22.400 01:07:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:22.400 01:07:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:22.400 01:07:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:22.400 01:07:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:22.400 01:07:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:22.400 01:07:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:22.400 01:07:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:22.400 01:07:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:22.400 01:07:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:22.400 01:07:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:22.400 01:07:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:22.400 01:07:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:22.400 01:07:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:22.400 01:07:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:22.400 01:07:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:22.400 01:07:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:22.400 01:07:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:22.400 01:07:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:22.400 01:07:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:22.401 01:07:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:22.401 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:22.401 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:14:22.401 00:14:22.401 --- 10.0.0.2 ping statistics --- 00:14:22.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.401 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:14:22.401 01:07:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:22.401 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:22.401 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:14:22.401 00:14:22.401 --- 10.0.0.1 ping statistics --- 00:14:22.401 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.401 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:14:22.401 01:07:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:22.401 01:07:12 -- nvmf/common.sh@410 -- # return 0 00:14:22.401 01:07:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:22.401 01:07:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:22.401 01:07:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:22.401 01:07:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:22.401 01:07:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:22.401 01:07:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:22.401 01:07:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:22.401 01:07:12 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:22.401 01:07:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:22.401 01:07:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:22.401 01:07:12 -- common/autotest_common.sh@10 -- # set +x 00:14:22.401 01:07:12 -- nvmf/common.sh@469 -- # nvmfpid=1028169 00:14:22.401 01:07:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:22.401 01:07:12 -- nvmf/common.sh@470 -- # waitforlisten 1028169 00:14:22.401 01:07:12 -- common/autotest_common.sh@829 -- # '[' -z 1028169 ']' 00:14:22.401 01:07:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:22.401 01:07:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:22.401 01:07:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:22.401 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:22.401 01:07:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:22.401 01:07:12 -- common/autotest_common.sh@10 -- # set +x 00:14:22.401 [2024-11-26 01:07:12.878253] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.401 [2024-11-26 01:07:12.878342] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:22.401 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.660 [2024-11-26 01:07:12.946799] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:22.660 [2024-11-26 01:07:13.061776] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:22.660 [2024-11-26 01:07:13.061932] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:22.660 [2024-11-26 01:07:13.061951] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:22.660 [2024-11-26 01:07:13.061982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:22.660 [2024-11-26 01:07:13.062038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:22.660 [2024-11-26 01:07:13.062060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:22.660 [2024-11-26 01:07:13.062064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:23.593 01:07:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:23.593 01:07:13 -- common/autotest_common.sh@862 -- # return 0 00:14:23.593 01:07:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:23.593 01:07:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:23.593 01:07:13 -- common/autotest_common.sh@10 -- # set +x 00:14:23.593 01:07:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:23.593 01:07:13 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:23.593 [2024-11-26 01:07:14.106951] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:23.850 01:07:14 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:24.108 01:07:14 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:24.108 01:07:14 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:24.366 01:07:14 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:24.366 01:07:14 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:24.624 01:07:14 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:24.882 01:07:15 -- target/nvmf_lvol.sh@29 -- # lvs=46998fe3-84fb-4cdd-8738-80fa39a756ae 00:14:24.882 01:07:15 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 46998fe3-84fb-4cdd-8738-80fa39a756ae lvol 20 00:14:25.139 01:07:15 -- target/nvmf_lvol.sh@32 -- # lvol=233a8830-8a58-4ad3-8288-db75d5295a0c 00:14:25.139 01:07:15 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:25.396 01:07:15 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 233a8830-8a58-4ad3-8288-db75d5295a0c 00:14:25.654 01:07:15 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:25.912 [2024-11-26 01:07:16.202798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:25.912 01:07:16 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:26.170 01:07:16 -- target/nvmf_lvol.sh@42 -- # perf_pid=1028733 00:14:26.170 01:07:16 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:26.170 01:07:16 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:26.170 EAL: No free 2048 kB hugepages reported on node 1 00:14:27.103 01:07:17 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 233a8830-8a58-4ad3-8288-db75d5295a0c MY_SNAPSHOT 00:14:27.360 01:07:17 -- target/nvmf_lvol.sh@47 -- # snapshot=f5fdc508-42eb-4d41-a777-b83efd4365c6 00:14:27.360 01:07:17 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 233a8830-8a58-4ad3-8288-db75d5295a0c 30 00:14:27.617 01:07:18 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone f5fdc508-42eb-4d41-a777-b83efd4365c6 MY_CLONE 00:14:27.875 01:07:18 -- target/nvmf_lvol.sh@49 -- # clone=f3790494-8e86-4e12-a92f-1a111690a6e3 00:14:27.875 01:07:18 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate f3790494-8e86-4e12-a92f-1a111690a6e3 00:14:28.808 01:07:18 -- target/nvmf_lvol.sh@53 -- # wait 1028733 00:14:36.931 Initializing NVMe Controllers 00:14:36.931 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:36.931 Controller IO queue size 128, less than required. 00:14:36.931 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:36.931 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:36.931 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:36.931 Initialization complete. Launching workers. 00:14:36.931 ======================================================== 00:14:36.931 Latency(us) 00:14:36.931 Device Information : IOPS MiB/s Average min max 00:14:36.931 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10819.10 42.26 11836.73 2219.01 75763.82 00:14:36.931 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10799.30 42.18 11854.74 2161.57 72266.67 00:14:36.931 ======================================================== 00:14:36.931 Total : 21618.40 84.45 11845.73 2161.57 75763.82 00:14:36.931 00:14:36.931 01:07:26 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:36.931 01:07:27 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 233a8830-8a58-4ad3-8288-db75d5295a0c 00:14:37.188 01:07:27 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 46998fe3-84fb-4cdd-8738-80fa39a756ae 00:14:37.445 01:07:27 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:37.445 01:07:27 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:37.445 01:07:27 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:37.445 01:07:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:37.445 01:07:27 -- nvmf/common.sh@116 -- # sync 00:14:37.445 01:07:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:37.445 01:07:27 -- nvmf/common.sh@119 -- # set +e 00:14:37.445 01:07:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:37.445 01:07:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:37.445 rmmod nvme_tcp 00:14:37.445 rmmod nvme_fabrics 00:14:37.445 rmmod nvme_keyring 00:14:37.445 01:07:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:37.445 01:07:27 -- nvmf/common.sh@123 -- # set -e 00:14:37.445 01:07:27 -- nvmf/common.sh@124 -- # return 0 00:14:37.445 01:07:27 -- nvmf/common.sh@477 -- # '[' -n 1028169 ']' 00:14:37.445 01:07:27 -- nvmf/common.sh@478 -- # killprocess 1028169 00:14:37.445 01:07:27 -- common/autotest_common.sh@936 -- # '[' -z 1028169 ']' 00:14:37.445 01:07:27 -- common/autotest_common.sh@940 -- # kill -0 1028169 00:14:37.445 01:07:27 -- common/autotest_common.sh@941 -- # uname 00:14:37.445 01:07:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:37.445 01:07:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1028169 00:14:37.445 01:07:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:37.445 01:07:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:37.445 01:07:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1028169' 00:14:37.445 killing process with pid 1028169 00:14:37.445 01:07:27 -- common/autotest_common.sh@955 -- # kill 1028169 00:14:37.445 01:07:27 -- common/autotest_common.sh@960 -- # wait 1028169 00:14:38.009 01:07:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:38.009 01:07:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:38.009 01:07:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:38.009 01:07:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:38.009 01:07:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:38.009 01:07:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.009 01:07:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.009 01:07:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:39.909 01:07:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:39.909 00:14:39.909 real 0m19.741s 00:14:39.909 user 1m6.600s 00:14:39.909 sys 0m5.704s 00:14:39.909 01:07:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:39.909 01:07:30 -- common/autotest_common.sh@10 -- # set +x 00:14:39.909 ************************************ 00:14:39.909 END TEST nvmf_lvol 00:14:39.909 ************************************ 00:14:39.909 01:07:30 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:39.909 01:07:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:39.909 01:07:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:39.909 01:07:30 -- common/autotest_common.sh@10 -- # set +x 00:14:39.909 ************************************ 00:14:39.909 START TEST nvmf_lvs_grow 00:14:39.909 ************************************ 00:14:39.909 01:07:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:39.909 * Looking for test storage... 00:14:39.909 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:39.909 01:07:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:39.909 01:07:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:39.909 01:07:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:40.168 01:07:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:40.168 01:07:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:40.168 01:07:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:40.168 01:07:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:40.168 01:07:30 -- scripts/common.sh@335 -- # IFS=.-: 00:14:40.168 01:07:30 -- scripts/common.sh@335 -- # read -ra ver1 00:14:40.168 01:07:30 -- scripts/common.sh@336 -- # IFS=.-: 00:14:40.168 01:07:30 -- scripts/common.sh@336 -- # read -ra ver2 00:14:40.168 01:07:30 -- scripts/common.sh@337 -- # local 'op=<' 00:14:40.168 01:07:30 -- scripts/common.sh@339 -- # ver1_l=2 00:14:40.168 01:07:30 -- scripts/common.sh@340 -- # ver2_l=1 00:14:40.168 01:07:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:40.168 01:07:30 -- scripts/common.sh@343 -- # case "$op" in 00:14:40.168 01:07:30 -- scripts/common.sh@344 -- # : 1 00:14:40.168 01:07:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:40.168 01:07:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:40.168 01:07:30 -- scripts/common.sh@364 -- # decimal 1 00:14:40.168 01:07:30 -- scripts/common.sh@352 -- # local d=1 00:14:40.168 01:07:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:40.168 01:07:30 -- scripts/common.sh@354 -- # echo 1 00:14:40.168 01:07:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:40.168 01:07:30 -- scripts/common.sh@365 -- # decimal 2 00:14:40.168 01:07:30 -- scripts/common.sh@352 -- # local d=2 00:14:40.168 01:07:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:40.168 01:07:30 -- scripts/common.sh@354 -- # echo 2 00:14:40.168 01:07:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:40.168 01:07:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:40.168 01:07:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:40.168 01:07:30 -- scripts/common.sh@367 -- # return 0 00:14:40.168 01:07:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:40.168 01:07:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:40.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.168 --rc genhtml_branch_coverage=1 00:14:40.168 --rc genhtml_function_coverage=1 00:14:40.168 --rc genhtml_legend=1 00:14:40.168 --rc geninfo_all_blocks=1 00:14:40.168 --rc geninfo_unexecuted_blocks=1 00:14:40.168 00:14:40.168 ' 00:14:40.168 01:07:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:40.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.168 --rc genhtml_branch_coverage=1 00:14:40.168 --rc genhtml_function_coverage=1 00:14:40.168 --rc genhtml_legend=1 00:14:40.168 --rc geninfo_all_blocks=1 00:14:40.168 --rc geninfo_unexecuted_blocks=1 00:14:40.168 00:14:40.168 ' 00:14:40.168 01:07:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:40.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.168 --rc genhtml_branch_coverage=1 00:14:40.168 --rc genhtml_function_coverage=1 00:14:40.168 --rc genhtml_legend=1 00:14:40.168 --rc geninfo_all_blocks=1 00:14:40.168 --rc geninfo_unexecuted_blocks=1 00:14:40.168 00:14:40.168 ' 00:14:40.168 01:07:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:40.168 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:40.168 --rc genhtml_branch_coverage=1 00:14:40.168 --rc genhtml_function_coverage=1 00:14:40.168 --rc genhtml_legend=1 00:14:40.168 --rc geninfo_all_blocks=1 00:14:40.168 --rc geninfo_unexecuted_blocks=1 00:14:40.168 00:14:40.168 ' 00:14:40.168 01:07:30 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:40.168 01:07:30 -- nvmf/common.sh@7 -- # uname -s 00:14:40.168 01:07:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:40.168 01:07:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:40.168 01:07:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:40.168 01:07:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:40.168 01:07:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:40.168 01:07:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:40.168 01:07:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:40.168 01:07:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:40.168 01:07:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:40.168 01:07:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:40.168 01:07:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:40.168 01:07:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:40.168 01:07:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:40.168 01:07:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:40.168 01:07:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:40.168 01:07:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:40.168 01:07:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:40.168 01:07:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:40.168 01:07:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:40.168 01:07:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.169 01:07:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.169 01:07:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.169 01:07:30 -- paths/export.sh@5 -- # export PATH 00:14:40.169 01:07:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:40.169 01:07:30 -- nvmf/common.sh@46 -- # : 0 00:14:40.169 01:07:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:40.169 01:07:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:40.169 01:07:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:40.169 01:07:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:40.169 01:07:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:40.169 01:07:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:40.169 01:07:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:40.169 01:07:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:40.169 01:07:30 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:40.169 01:07:30 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:40.169 01:07:30 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:40.169 01:07:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:40.169 01:07:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:40.169 01:07:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:40.169 01:07:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:40.169 01:07:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:40.169 01:07:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:40.169 01:07:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:40.169 01:07:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:40.169 01:07:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:40.169 01:07:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:40.169 01:07:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:40.169 01:07:30 -- common/autotest_common.sh@10 -- # set +x 00:14:42.072 01:07:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:42.072 01:07:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:42.072 01:07:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:42.072 01:07:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:42.072 01:07:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:42.072 01:07:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:42.072 01:07:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:42.072 01:07:32 -- nvmf/common.sh@294 -- # net_devs=() 00:14:42.072 01:07:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:42.072 01:07:32 -- nvmf/common.sh@295 -- # e810=() 00:14:42.072 01:07:32 -- nvmf/common.sh@295 -- # local -ga e810 00:14:42.072 01:07:32 -- nvmf/common.sh@296 -- # x722=() 00:14:42.072 01:07:32 -- nvmf/common.sh@296 -- # local -ga x722 00:14:42.072 01:07:32 -- nvmf/common.sh@297 -- # mlx=() 00:14:42.072 01:07:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:42.072 01:07:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:42.072 01:07:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:42.072 01:07:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:42.072 01:07:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:42.072 01:07:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:42.072 01:07:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:42.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:42.072 01:07:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:42.072 01:07:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:42.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:42.072 01:07:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:42.072 01:07:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:42.072 01:07:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.072 01:07:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:42.072 01:07:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.072 01:07:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:42.072 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:42.072 01:07:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.072 01:07:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:42.072 01:07:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:42.072 01:07:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:42.072 01:07:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:42.072 01:07:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:42.072 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:42.072 01:07:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:42.072 01:07:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:42.072 01:07:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:42.072 01:07:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:42.072 01:07:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:42.072 01:07:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:42.072 01:07:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:42.072 01:07:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:42.072 01:07:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:42.072 01:07:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:42.072 01:07:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:42.072 01:07:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:42.072 01:07:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:42.072 01:07:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:42.072 01:07:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:42.072 01:07:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:42.072 01:07:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:42.072 01:07:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:42.330 01:07:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:42.330 01:07:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:42.330 01:07:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:42.330 01:07:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:42.330 01:07:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:42.331 01:07:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:42.331 01:07:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:42.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:42.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:14:42.331 00:14:42.331 --- 10.0.0.2 ping statistics --- 00:14:42.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.331 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:14:42.331 01:07:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:42.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:42.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:14:42.331 00:14:42.331 --- 10.0.0.1 ping statistics --- 00:14:42.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:42.331 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:14:42.331 01:07:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:42.331 01:07:32 -- nvmf/common.sh@410 -- # return 0 00:14:42.331 01:07:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:42.331 01:07:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:42.331 01:07:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:42.331 01:07:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:42.331 01:07:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:42.331 01:07:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:42.331 01:07:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:42.331 01:07:32 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:42.331 01:07:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:42.331 01:07:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:42.331 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.331 01:07:32 -- nvmf/common.sh@469 -- # nvmfpid=1032054 00:14:42.331 01:07:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:42.331 01:07:32 -- nvmf/common.sh@470 -- # waitforlisten 1032054 00:14:42.331 01:07:32 -- common/autotest_common.sh@829 -- # '[' -z 1032054 ']' 00:14:42.331 01:07:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:42.331 01:07:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:42.331 01:07:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:42.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:42.331 01:07:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:42.331 01:07:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.331 [2024-11-26 01:07:32.766075] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:42.331 [2024-11-26 01:07:32.766158] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:42.331 EAL: No free 2048 kB hugepages reported on node 1 00:14:42.331 [2024-11-26 01:07:32.830007] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:42.589 [2024-11-26 01:07:32.939275] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:42.589 [2024-11-26 01:07:32.939469] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:42.589 [2024-11-26 01:07:32.939488] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:42.589 [2024-11-26 01:07:32.939502] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:42.589 [2024-11-26 01:07:32.939533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:43.523 01:07:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:43.523 01:07:33 -- common/autotest_common.sh@862 -- # return 0 00:14:43.523 01:07:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:43.523 01:07:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:43.523 01:07:33 -- common/autotest_common.sh@10 -- # set +x 00:14:43.523 01:07:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:43.523 01:07:33 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:43.523 [2024-11-26 01:07:33.990506] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:43.523 01:07:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:43.523 01:07:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:43.523 01:07:34 -- common/autotest_common.sh@10 -- # set +x 00:14:43.523 ************************************ 00:14:43.523 START TEST lvs_grow_clean 00:14:43.523 ************************************ 00:14:43.523 01:07:34 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:43.523 01:07:34 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:43.781 01:07:34 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:43.781 01:07:34 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:44.039 01:07:34 -- target/nvmf_lvs_grow.sh@28 -- # lvs=ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:44.039 01:07:34 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:44.039 01:07:34 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:44.297 01:07:34 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:44.297 01:07:34 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:44.297 01:07:34 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f lvol 150 00:14:44.555 01:07:35 -- target/nvmf_lvs_grow.sh@33 -- # lvol=09fb10de-b37d-48b9-806e-b458da7f6e41 00:14:44.555 01:07:35 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:44.555 01:07:35 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:45.121 [2024-11-26 01:07:35.349188] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:45.121 [2024-11-26 01:07:35.349284] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:45.121 true 00:14:45.121 01:07:35 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:45.121 01:07:35 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:45.121 01:07:35 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:45.121 01:07:35 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:45.380 01:07:35 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 09fb10de-b37d-48b9-806e-b458da7f6e41 00:14:45.639 01:07:36 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:45.897 [2024-11-26 01:07:36.364387] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:45.897 01:07:36 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:46.155 01:07:36 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1032513 00:14:46.155 01:07:36 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:46.155 01:07:36 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:46.155 01:07:36 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1032513 /var/tmp/bdevperf.sock 00:14:46.155 01:07:36 -- common/autotest_common.sh@829 -- # '[' -z 1032513 ']' 00:14:46.155 01:07:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:46.155 01:07:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:46.155 01:07:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:46.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:46.155 01:07:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:46.155 01:07:36 -- common/autotest_common.sh@10 -- # set +x 00:14:46.155 [2024-11-26 01:07:36.665806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:46.155 [2024-11-26 01:07:36.665887] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1032513 ] 00:14:46.414 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.414 [2024-11-26 01:07:36.730768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:46.414 [2024-11-26 01:07:36.850713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:47.347 01:07:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:47.347 01:07:37 -- common/autotest_common.sh@862 -- # return 0 00:14:47.347 01:07:37 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:47.914 Nvme0n1 00:14:47.914 01:07:38 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:47.914 [ 00:14:47.914 { 00:14:47.914 "name": "Nvme0n1", 00:14:47.914 "aliases": [ 00:14:47.914 "09fb10de-b37d-48b9-806e-b458da7f6e41" 00:14:47.914 ], 00:14:47.914 "product_name": "NVMe disk", 00:14:47.914 "block_size": 4096, 00:14:47.914 "num_blocks": 38912, 00:14:47.914 "uuid": "09fb10de-b37d-48b9-806e-b458da7f6e41", 00:14:47.914 "assigned_rate_limits": { 00:14:47.914 "rw_ios_per_sec": 0, 00:14:47.914 "rw_mbytes_per_sec": 0, 00:14:47.914 "r_mbytes_per_sec": 0, 00:14:47.914 "w_mbytes_per_sec": 0 00:14:47.914 }, 00:14:47.914 "claimed": false, 00:14:47.914 "zoned": false, 00:14:47.914 "supported_io_types": { 00:14:47.914 "read": true, 00:14:47.914 "write": true, 00:14:47.914 "unmap": true, 00:14:47.914 "write_zeroes": true, 00:14:47.914 "flush": true, 00:14:47.914 "reset": true, 00:14:47.914 "compare": true, 00:14:47.914 "compare_and_write": true, 00:14:47.914 "abort": true, 00:14:47.914 "nvme_admin": true, 00:14:47.914 "nvme_io": true 00:14:47.914 }, 00:14:47.914 "driver_specific": { 00:14:47.914 "nvme": [ 00:14:47.914 { 00:14:47.914 "trid": { 00:14:47.914 "trtype": "TCP", 00:14:47.914 "adrfam": "IPv4", 00:14:47.914 "traddr": "10.0.0.2", 00:14:47.914 "trsvcid": "4420", 00:14:47.914 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:47.914 }, 00:14:47.914 "ctrlr_data": { 00:14:47.914 "cntlid": 1, 00:14:47.914 "vendor_id": "0x8086", 00:14:47.914 "model_number": "SPDK bdev Controller", 00:14:47.914 "serial_number": "SPDK0", 00:14:47.914 "firmware_revision": "24.01.1", 00:14:47.914 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:47.914 "oacs": { 00:14:47.914 "security": 0, 00:14:47.914 "format": 0, 00:14:47.914 "firmware": 0, 00:14:47.914 "ns_manage": 0 00:14:47.914 }, 00:14:47.914 "multi_ctrlr": true, 00:14:47.914 "ana_reporting": false 00:14:47.914 }, 00:14:47.914 "vs": { 00:14:47.914 "nvme_version": "1.3" 00:14:47.914 }, 00:14:47.914 "ns_data": { 00:14:47.914 "id": 1, 00:14:47.914 "can_share": true 00:14:47.914 } 00:14:47.914 } 00:14:47.914 ], 00:14:47.914 "mp_policy": "active_passive" 00:14:47.914 } 00:14:47.914 } 00:14:47.914 ] 00:14:47.914 01:07:38 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1032786 00:14:47.914 01:07:38 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:47.914 01:07:38 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:48.172 Running I/O for 10 seconds... 00:14:49.107 Latency(us) 00:14:49.107 [2024-11-26T00:07:39.642Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:49.107 [2024-11-26T00:07:39.642Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:49.107 Nvme0n1 : 1.00 14677.00 57.33 0.00 0.00 0.00 0.00 0.00 00:14:49.107 [2024-11-26T00:07:39.642Z] =================================================================================================================== 00:14:49.107 [2024-11-26T00:07:39.642Z] Total : 14677.00 57.33 0.00 0.00 0.00 0.00 0.00 00:14:49.107 00:14:50.043 01:07:40 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:50.043 [2024-11-26T00:07:40.578Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:50.043 Nvme0n1 : 2.00 14800.50 57.81 0.00 0.00 0.00 0.00 0.00 00:14:50.043 [2024-11-26T00:07:40.578Z] =================================================================================================================== 00:14:50.043 [2024-11-26T00:07:40.578Z] Total : 14800.50 57.81 0.00 0.00 0.00 0.00 0.00 00:14:50.043 00:14:50.301 true 00:14:50.301 01:07:40 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:50.301 01:07:40 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:50.559 01:07:40 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:50.559 01:07:40 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:50.559 01:07:40 -- target/nvmf_lvs_grow.sh@65 -- # wait 1032786 00:14:51.125 [2024-11-26T00:07:41.661Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:51.126 Nvme0n1 : 3.00 14927.33 58.31 0.00 0.00 0.00 0.00 0.00 00:14:51.126 [2024-11-26T00:07:41.661Z] =================================================================================================================== 00:14:51.126 [2024-11-26T00:07:41.661Z] Total : 14927.33 58.31 0.00 0.00 0.00 0.00 0.00 00:14:51.126 00:14:52.065 [2024-11-26T00:07:42.600Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:52.065 Nvme0n1 : 4.00 15088.00 58.94 0.00 0.00 0.00 0.00 0.00 00:14:52.065 [2024-11-26T00:07:42.600Z] =================================================================================================================== 00:14:52.065 [2024-11-26T00:07:42.600Z] Total : 15088.00 58.94 0.00 0.00 0.00 0.00 0.00 00:14:52.065 00:14:53.057 [2024-11-26T00:07:43.592Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.057 Nvme0n1 : 5.00 15145.60 59.16 0.00 0.00 0.00 0.00 0.00 00:14:53.057 [2024-11-26T00:07:43.592Z] =================================================================================================================== 00:14:53.057 [2024-11-26T00:07:43.592Z] Total : 15145.60 59.16 0.00 0.00 0.00 0.00 0.00 00:14:53.057 00:14:53.992 [2024-11-26T00:07:44.527Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:53.992 Nvme0n1 : 6.00 15172.83 59.27 0.00 0.00 0.00 0.00 0.00 00:14:53.992 [2024-11-26T00:07:44.527Z] =================================================================================================================== 00:14:53.992 [2024-11-26T00:07:44.527Z] Total : 15172.83 59.27 0.00 0.00 0.00 0.00 0.00 00:14:53.992 00:14:55.366 [2024-11-26T00:07:45.902Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.367 Nvme0n1 : 7.00 15199.71 59.37 0.00 0.00 0.00 0.00 0.00 00:14:55.367 [2024-11-26T00:07:45.902Z] =================================================================================================================== 00:14:55.367 [2024-11-26T00:07:45.902Z] Total : 15199.71 59.37 0.00 0.00 0.00 0.00 0.00 00:14:55.367 00:14:56.301 [2024-11-26T00:07:46.836Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.301 Nvme0n1 : 8.00 15230.75 59.50 0.00 0.00 0.00 0.00 0.00 00:14:56.301 [2024-11-26T00:07:46.836Z] =================================================================================================================== 00:14:56.301 [2024-11-26T00:07:46.836Z] Total : 15230.75 59.50 0.00 0.00 0.00 0.00 0.00 00:14:56.301 00:14:57.236 [2024-11-26T00:07:47.771Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.236 Nvme0n1 : 9.00 15248.56 59.56 0.00 0.00 0.00 0.00 0.00 00:14:57.236 [2024-11-26T00:07:47.771Z] =================================================================================================================== 00:14:57.236 [2024-11-26T00:07:47.771Z] Total : 15248.56 59.56 0.00 0.00 0.00 0.00 0.00 00:14:57.236 00:14:58.170 [2024-11-26T00:07:48.705Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.170 Nvme0n1 : 10.00 15271.00 59.65 0.00 0.00 0.00 0.00 0.00 00:14:58.170 [2024-11-26T00:07:48.705Z] =================================================================================================================== 00:14:58.170 [2024-11-26T00:07:48.705Z] Total : 15271.00 59.65 0.00 0.00 0.00 0.00 0.00 00:14:58.170 00:14:58.170 00:14:58.170 Latency(us) 00:14:58.170 [2024-11-26T00:07:48.705Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.170 [2024-11-26T00:07:48.705Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.170 Nvme0n1 : 10.01 15273.06 59.66 0.00 0.00 8376.21 2196.67 16602.45 00:14:58.170 [2024-11-26T00:07:48.705Z] =================================================================================================================== 00:14:58.170 [2024-11-26T00:07:48.705Z] Total : 15273.06 59.66 0.00 0.00 8376.21 2196.67 16602.45 00:14:58.170 0 00:14:58.170 01:07:48 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1032513 00:14:58.170 01:07:48 -- common/autotest_common.sh@936 -- # '[' -z 1032513 ']' 00:14:58.170 01:07:48 -- common/autotest_common.sh@940 -- # kill -0 1032513 00:14:58.170 01:07:48 -- common/autotest_common.sh@941 -- # uname 00:14:58.170 01:07:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:58.170 01:07:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1032513 00:14:58.170 01:07:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:58.170 01:07:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:58.170 01:07:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1032513' 00:14:58.170 killing process with pid 1032513 00:14:58.170 01:07:48 -- common/autotest_common.sh@955 -- # kill 1032513 00:14:58.170 Received shutdown signal, test time was about 10.000000 seconds 00:14:58.170 00:14:58.170 Latency(us) 00:14:58.170 [2024-11-26T00:07:48.705Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:58.170 [2024-11-26T00:07:48.705Z] =================================================================================================================== 00:14:58.170 [2024-11-26T00:07:48.705Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:14:58.170 01:07:48 -- common/autotest_common.sh@960 -- # wait 1032513 00:14:58.428 01:07:48 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:58.687 01:07:49 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:58.687 01:07:49 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:14:59.252 01:07:49 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:14:59.252 01:07:49 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:14:59.252 01:07:49 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:14:59.252 [2024-11-26 01:07:49.722694] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:14:59.252 01:07:49 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:59.252 01:07:49 -- common/autotest_common.sh@650 -- # local es=0 00:14:59.252 01:07:49 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:59.252 01:07:49 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:59.252 01:07:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:59.252 01:07:49 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:59.252 01:07:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:59.252 01:07:49 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:59.252 01:07:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:59.252 01:07:49 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:59.252 01:07:49 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:14:59.252 01:07:49 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:14:59.511 request: 00:14:59.511 { 00:14:59.511 "uuid": "ba3b5926-9a3c-4a23-9bd5-e26596dc548f", 00:14:59.511 "method": "bdev_lvol_get_lvstores", 00:14:59.511 "req_id": 1 00:14:59.511 } 00:14:59.511 Got JSON-RPC error response 00:14:59.511 response: 00:14:59.511 { 00:14:59.511 "code": -19, 00:14:59.511 "message": "No such device" 00:14:59.511 } 00:14:59.770 01:07:50 -- common/autotest_common.sh@653 -- # es=1 00:14:59.770 01:07:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:59.770 01:07:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:59.770 01:07:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:59.770 01:07:50 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:00.029 aio_bdev 00:15:00.029 01:07:50 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 09fb10de-b37d-48b9-806e-b458da7f6e41 00:15:00.029 01:07:50 -- common/autotest_common.sh@897 -- # local bdev_name=09fb10de-b37d-48b9-806e-b458da7f6e41 00:15:00.029 01:07:50 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:00.029 01:07:50 -- common/autotest_common.sh@899 -- # local i 00:15:00.029 01:07:50 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:00.029 01:07:50 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:00.029 01:07:50 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:00.287 01:07:50 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 09fb10de-b37d-48b9-806e-b458da7f6e41 -t 2000 00:15:00.287 [ 00:15:00.287 { 00:15:00.287 "name": "09fb10de-b37d-48b9-806e-b458da7f6e41", 00:15:00.287 "aliases": [ 00:15:00.287 "lvs/lvol" 00:15:00.287 ], 00:15:00.287 "product_name": "Logical Volume", 00:15:00.287 "block_size": 4096, 00:15:00.287 "num_blocks": 38912, 00:15:00.287 "uuid": "09fb10de-b37d-48b9-806e-b458da7f6e41", 00:15:00.287 "assigned_rate_limits": { 00:15:00.287 "rw_ios_per_sec": 0, 00:15:00.287 "rw_mbytes_per_sec": 0, 00:15:00.287 "r_mbytes_per_sec": 0, 00:15:00.287 "w_mbytes_per_sec": 0 00:15:00.287 }, 00:15:00.287 "claimed": false, 00:15:00.287 "zoned": false, 00:15:00.287 "supported_io_types": { 00:15:00.287 "read": true, 00:15:00.287 "write": true, 00:15:00.287 "unmap": true, 00:15:00.287 "write_zeroes": true, 00:15:00.287 "flush": false, 00:15:00.287 "reset": true, 00:15:00.287 "compare": false, 00:15:00.287 "compare_and_write": false, 00:15:00.287 "abort": false, 00:15:00.287 "nvme_admin": false, 00:15:00.287 "nvme_io": false 00:15:00.287 }, 00:15:00.287 "driver_specific": { 00:15:00.287 "lvol": { 00:15:00.287 "lvol_store_uuid": "ba3b5926-9a3c-4a23-9bd5-e26596dc548f", 00:15:00.287 "base_bdev": "aio_bdev", 00:15:00.287 "thin_provision": false, 00:15:00.288 "snapshot": false, 00:15:00.288 "clone": false, 00:15:00.288 "esnap_clone": false 00:15:00.288 } 00:15:00.288 } 00:15:00.288 } 00:15:00.288 ] 00:15:00.546 01:07:50 -- common/autotest_common.sh@905 -- # return 0 00:15:00.547 01:07:50 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:15:00.547 01:07:50 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:00.806 01:07:51 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:00.806 01:07:51 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:15:00.806 01:07:51 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:01.064 01:07:51 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:01.064 01:07:51 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 09fb10de-b37d-48b9-806e-b458da7f6e41 00:15:01.323 01:07:51 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u ba3b5926-9a3c-4a23-9bd5-e26596dc548f 00:15:01.581 01:07:51 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:01.581 01:07:52 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:01.839 00:15:01.839 real 0m18.121s 00:15:01.839 user 0m17.842s 00:15:01.839 sys 0m1.902s 00:15:01.839 01:07:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:01.839 01:07:52 -- common/autotest_common.sh@10 -- # set +x 00:15:01.839 ************************************ 00:15:01.839 END TEST lvs_grow_clean 00:15:01.839 ************************************ 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:01.839 01:07:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:01.839 01:07:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:01.839 01:07:52 -- common/autotest_common.sh@10 -- # set +x 00:15:01.839 ************************************ 00:15:01.839 START TEST lvs_grow_dirty 00:15:01.839 ************************************ 00:15:01.839 01:07:52 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:01.839 01:07:52 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:02.097 01:07:52 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:02.097 01:07:52 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:02.355 01:07:52 -- target/nvmf_lvs_grow.sh@28 -- # lvs=7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:02.355 01:07:52 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:02.355 01:07:52 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:02.614 01:07:53 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:02.614 01:07:53 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:02.614 01:07:53 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff lvol 150 00:15:02.873 01:07:53 -- target/nvmf_lvs_grow.sh@33 -- # lvol=c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:02.873 01:07:53 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:02.873 01:07:53 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:03.131 [2024-11-26 01:07:53.613354] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:03.131 [2024-11-26 01:07:53.613452] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:03.131 true 00:15:03.131 01:07:53 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:03.131 01:07:53 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:03.390 01:07:53 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:03.390 01:07:53 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:03.649 01:07:54 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:03.908 01:07:54 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:04.167 01:07:54 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:04.425 01:07:54 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=1034785 00:15:04.425 01:07:54 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:04.425 01:07:54 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:04.425 01:07:54 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 1034785 /var/tmp/bdevperf.sock 00:15:04.425 01:07:54 -- common/autotest_common.sh@829 -- # '[' -z 1034785 ']' 00:15:04.425 01:07:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:04.425 01:07:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:04.425 01:07:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:04.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:04.425 01:07:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:04.425 01:07:54 -- common/autotest_common.sh@10 -- # set +x 00:15:04.425 [2024-11-26 01:07:54.910405] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:04.425 [2024-11-26 01:07:54.910473] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1034785 ] 00:15:04.425 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.684 [2024-11-26 01:07:54.971896] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:04.684 [2024-11-26 01:07:55.085581] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:05.617 01:07:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:05.617 01:07:55 -- common/autotest_common.sh@862 -- # return 0 00:15:05.617 01:07:55 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:05.875 Nvme0n1 00:15:06.133 01:07:56 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:06.392 [ 00:15:06.392 { 00:15:06.392 "name": "Nvme0n1", 00:15:06.392 "aliases": [ 00:15:06.392 "c4ede682-09b2-43f8-b842-da8663ed69e3" 00:15:06.392 ], 00:15:06.392 "product_name": "NVMe disk", 00:15:06.392 "block_size": 4096, 00:15:06.392 "num_blocks": 38912, 00:15:06.392 "uuid": "c4ede682-09b2-43f8-b842-da8663ed69e3", 00:15:06.392 "assigned_rate_limits": { 00:15:06.392 "rw_ios_per_sec": 0, 00:15:06.392 "rw_mbytes_per_sec": 0, 00:15:06.392 "r_mbytes_per_sec": 0, 00:15:06.392 "w_mbytes_per_sec": 0 00:15:06.392 }, 00:15:06.392 "claimed": false, 00:15:06.392 "zoned": false, 00:15:06.392 "supported_io_types": { 00:15:06.392 "read": true, 00:15:06.392 "write": true, 00:15:06.392 "unmap": true, 00:15:06.392 "write_zeroes": true, 00:15:06.392 "flush": true, 00:15:06.392 "reset": true, 00:15:06.392 "compare": true, 00:15:06.392 "compare_and_write": true, 00:15:06.392 "abort": true, 00:15:06.392 "nvme_admin": true, 00:15:06.392 "nvme_io": true 00:15:06.392 }, 00:15:06.392 "driver_specific": { 00:15:06.392 "nvme": [ 00:15:06.392 { 00:15:06.392 "trid": { 00:15:06.392 "trtype": "TCP", 00:15:06.392 "adrfam": "IPv4", 00:15:06.392 "traddr": "10.0.0.2", 00:15:06.392 "trsvcid": "4420", 00:15:06.392 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:06.392 }, 00:15:06.392 "ctrlr_data": { 00:15:06.392 "cntlid": 1, 00:15:06.392 "vendor_id": "0x8086", 00:15:06.392 "model_number": "SPDK bdev Controller", 00:15:06.392 "serial_number": "SPDK0", 00:15:06.392 "firmware_revision": "24.01.1", 00:15:06.392 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:06.392 "oacs": { 00:15:06.392 "security": 0, 00:15:06.392 "format": 0, 00:15:06.392 "firmware": 0, 00:15:06.392 "ns_manage": 0 00:15:06.392 }, 00:15:06.392 "multi_ctrlr": true, 00:15:06.392 "ana_reporting": false 00:15:06.392 }, 00:15:06.392 "vs": { 00:15:06.392 "nvme_version": "1.3" 00:15:06.392 }, 00:15:06.392 "ns_data": { 00:15:06.392 "id": 1, 00:15:06.392 "can_share": true 00:15:06.392 } 00:15:06.392 } 00:15:06.392 ], 00:15:06.392 "mp_policy": "active_passive" 00:15:06.392 } 00:15:06.392 } 00:15:06.392 ] 00:15:06.392 01:07:56 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=1035028 00:15:06.392 01:07:56 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:06.392 01:07:56 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:06.392 Running I/O for 10 seconds... 00:15:07.326 Latency(us) 00:15:07.326 [2024-11-26T00:07:57.861Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:07.326 [2024-11-26T00:07:57.861Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:07.326 Nvme0n1 : 1.00 14460.00 56.48 0.00 0.00 0.00 0.00 0.00 00:15:07.326 [2024-11-26T00:07:57.861Z] =================================================================================================================== 00:15:07.326 [2024-11-26T00:07:57.861Z] Total : 14460.00 56.48 0.00 0.00 0.00 0.00 0.00 00:15:07.326 00:15:08.260 01:07:58 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:08.518 [2024-11-26T00:07:59.053Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:08.518 Nvme0n1 : 2.00 14889.00 58.16 0.00 0.00 0.00 0.00 0.00 00:15:08.518 [2024-11-26T00:07:59.053Z] =================================================================================================================== 00:15:08.518 [2024-11-26T00:07:59.053Z] Total : 14889.00 58.16 0.00 0.00 0.00 0.00 0.00 00:15:08.518 00:15:08.518 true 00:15:08.518 01:07:59 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:08.518 01:07:59 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:08.776 01:07:59 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:08.776 01:07:59 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:08.776 01:07:59 -- target/nvmf_lvs_grow.sh@65 -- # wait 1035028 00:15:09.340 [2024-11-26T00:07:59.875Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:09.340 Nvme0n1 : 3.00 14931.33 58.33 0.00 0.00 0.00 0.00 0.00 00:15:09.340 [2024-11-26T00:07:59.875Z] =================================================================================================================== 00:15:09.340 [2024-11-26T00:07:59.875Z] Total : 14931.33 58.33 0.00 0.00 0.00 0.00 0.00 00:15:09.340 00:15:10.715 [2024-11-26T00:08:01.250Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:10.715 Nvme0n1 : 4.00 14984.75 58.53 0.00 0.00 0.00 0.00 0.00 00:15:10.715 [2024-11-26T00:08:01.250Z] =================================================================================================================== 00:15:10.715 [2024-11-26T00:08:01.250Z] Total : 14984.75 58.53 0.00 0.00 0.00 0.00 0.00 00:15:10.715 00:15:11.650 [2024-11-26T00:08:02.185Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:11.650 Nvme0n1 : 5.00 15139.60 59.14 0.00 0.00 0.00 0.00 0.00 00:15:11.650 [2024-11-26T00:08:02.185Z] =================================================================================================================== 00:15:11.650 [2024-11-26T00:08:02.185Z] Total : 15139.60 59.14 0.00 0.00 0.00 0.00 0.00 00:15:11.650 00:15:12.583 [2024-11-26T00:08:03.118Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:12.583 Nvme0n1 : 6.00 15178.50 59.29 0.00 0.00 0.00 0.00 0.00 00:15:12.583 [2024-11-26T00:08:03.118Z] =================================================================================================================== 00:15:12.583 [2024-11-26T00:08:03.118Z] Total : 15178.50 59.29 0.00 0.00 0.00 0.00 0.00 00:15:12.583 00:15:13.516 [2024-11-26T00:08:04.051Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.516 Nvme0n1 : 7.00 15289.00 59.72 0.00 0.00 0.00 0.00 0.00 00:15:13.516 [2024-11-26T00:08:04.051Z] =================================================================================================================== 00:15:13.516 [2024-11-26T00:08:04.051Z] Total : 15289.00 59.72 0.00 0.00 0.00 0.00 0.00 00:15:13.516 00:15:14.452 [2024-11-26T00:08:04.987Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.452 Nvme0n1 : 8.00 15300.38 59.77 0.00 0.00 0.00 0.00 0.00 00:15:14.452 [2024-11-26T00:08:04.987Z] =================================================================================================================== 00:15:14.452 [2024-11-26T00:08:04.987Z] Total : 15300.38 59.77 0.00 0.00 0.00 0.00 0.00 00:15:14.452 00:15:15.388 [2024-11-26T00:08:05.923Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.388 Nvme0n1 : 9.00 15315.00 59.82 0.00 0.00 0.00 0.00 0.00 00:15:15.388 [2024-11-26T00:08:05.923Z] =================================================================================================================== 00:15:15.388 [2024-11-26T00:08:05.923Z] Total : 15315.00 59.82 0.00 0.00 0.00 0.00 0.00 00:15:15.388 00:15:16.323 [2024-11-26T00:08:06.858Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.323 Nvme0n1 : 10.00 15333.20 59.90 0.00 0.00 0.00 0.00 0.00 00:15:16.323 [2024-11-26T00:08:06.858Z] =================================================================================================================== 00:15:16.323 [2024-11-26T00:08:06.858Z] Total : 15333.20 59.90 0.00 0.00 0.00 0.00 0.00 00:15:16.323 00:15:16.323 00:15:16.323 Latency(us) 00:15:16.323 [2024-11-26T00:08:06.858Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:16.323 [2024-11-26T00:08:06.858Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.323 Nvme0n1 : 10.01 15337.76 59.91 0.00 0.00 8341.08 4102.07 18932.62 00:15:16.323 [2024-11-26T00:08:06.858Z] =================================================================================================================== 00:15:16.323 [2024-11-26T00:08:06.858Z] Total : 15337.76 59.91 0.00 0.00 8341.08 4102.07 18932.62 00:15:16.323 0 00:15:16.582 01:08:06 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 1034785 00:15:16.582 01:08:06 -- common/autotest_common.sh@936 -- # '[' -z 1034785 ']' 00:15:16.582 01:08:06 -- common/autotest_common.sh@940 -- # kill -0 1034785 00:15:16.582 01:08:06 -- common/autotest_common.sh@941 -- # uname 00:15:16.582 01:08:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:16.582 01:08:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1034785 00:15:16.582 01:08:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:16.582 01:08:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:16.582 01:08:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1034785' 00:15:16.582 killing process with pid 1034785 00:15:16.582 01:08:06 -- common/autotest_common.sh@955 -- # kill 1034785 00:15:16.582 Received shutdown signal, test time was about 10.000000 seconds 00:15:16.582 00:15:16.582 Latency(us) 00:15:16.582 [2024-11-26T00:08:07.117Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:16.582 [2024-11-26T00:08:07.117Z] =================================================================================================================== 00:15:16.582 [2024-11-26T00:08:07.117Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:16.582 01:08:06 -- common/autotest_common.sh@960 -- # wait 1034785 00:15:16.840 01:08:07 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:17.098 01:08:07 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:17.098 01:08:07 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:17.357 01:08:07 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:17.357 01:08:07 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:17.357 01:08:07 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 1032054 00:15:17.357 01:08:07 -- target/nvmf_lvs_grow.sh@74 -- # wait 1032054 00:15:17.357 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 1032054 Killed "${NVMF_APP[@]}" "$@" 00:15:17.357 01:08:07 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:17.357 01:08:07 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:17.357 01:08:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:17.357 01:08:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:17.357 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:15:17.357 01:08:07 -- nvmf/common.sh@469 -- # nvmfpid=1036411 00:15:17.357 01:08:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:17.357 01:08:07 -- nvmf/common.sh@470 -- # waitforlisten 1036411 00:15:17.357 01:08:07 -- common/autotest_common.sh@829 -- # '[' -z 1036411 ']' 00:15:17.357 01:08:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:17.357 01:08:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:17.357 01:08:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:17.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:17.357 01:08:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:17.357 01:08:07 -- common/autotest_common.sh@10 -- # set +x 00:15:17.357 [2024-11-26 01:08:07.791565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:17.357 [2024-11-26 01:08:07.791669] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:17.357 EAL: No free 2048 kB hugepages reported on node 1 00:15:17.357 [2024-11-26 01:08:07.856398] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:17.616 [2024-11-26 01:08:07.964211] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:17.616 [2024-11-26 01:08:07.964389] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:17.616 [2024-11-26 01:08:07.964407] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:17.616 [2024-11-26 01:08:07.964419] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:17.616 [2024-11-26 01:08:07.964459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:18.550 01:08:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:18.550 01:08:08 -- common/autotest_common.sh@862 -- # return 0 00:15:18.550 01:08:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:18.550 01:08:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:18.550 01:08:08 -- common/autotest_common.sh@10 -- # set +x 00:15:18.550 01:08:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:18.550 01:08:08 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:18.550 [2024-11-26 01:08:09.013564] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:18.550 [2024-11-26 01:08:09.013723] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:18.550 [2024-11-26 01:08:09.013781] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:18.550 01:08:09 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:18.550 01:08:09 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:18.550 01:08:09 -- common/autotest_common.sh@897 -- # local bdev_name=c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:18.550 01:08:09 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:18.550 01:08:09 -- common/autotest_common.sh@899 -- # local i 00:15:18.550 01:08:09 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:18.550 01:08:09 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:18.550 01:08:09 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:18.808 01:08:09 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c4ede682-09b2-43f8-b842-da8663ed69e3 -t 2000 00:15:19.066 [ 00:15:19.066 { 00:15:19.066 "name": "c4ede682-09b2-43f8-b842-da8663ed69e3", 00:15:19.066 "aliases": [ 00:15:19.066 "lvs/lvol" 00:15:19.066 ], 00:15:19.066 "product_name": "Logical Volume", 00:15:19.066 "block_size": 4096, 00:15:19.066 "num_blocks": 38912, 00:15:19.066 "uuid": "c4ede682-09b2-43f8-b842-da8663ed69e3", 00:15:19.066 "assigned_rate_limits": { 00:15:19.066 "rw_ios_per_sec": 0, 00:15:19.066 "rw_mbytes_per_sec": 0, 00:15:19.066 "r_mbytes_per_sec": 0, 00:15:19.066 "w_mbytes_per_sec": 0 00:15:19.066 }, 00:15:19.066 "claimed": false, 00:15:19.066 "zoned": false, 00:15:19.066 "supported_io_types": { 00:15:19.066 "read": true, 00:15:19.066 "write": true, 00:15:19.066 "unmap": true, 00:15:19.066 "write_zeroes": true, 00:15:19.066 "flush": false, 00:15:19.066 "reset": true, 00:15:19.066 "compare": false, 00:15:19.066 "compare_and_write": false, 00:15:19.066 "abort": false, 00:15:19.066 "nvme_admin": false, 00:15:19.066 "nvme_io": false 00:15:19.066 }, 00:15:19.066 "driver_specific": { 00:15:19.066 "lvol": { 00:15:19.066 "lvol_store_uuid": "7af24c97-5db1-41d2-a6c2-d8bf475774ff", 00:15:19.066 "base_bdev": "aio_bdev", 00:15:19.066 "thin_provision": false, 00:15:19.066 "snapshot": false, 00:15:19.066 "clone": false, 00:15:19.066 "esnap_clone": false 00:15:19.066 } 00:15:19.066 } 00:15:19.066 } 00:15:19.066 ] 00:15:19.066 01:08:09 -- common/autotest_common.sh@905 -- # return 0 00:15:19.066 01:08:09 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:19.066 01:08:09 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:19.324 01:08:09 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:19.324 01:08:09 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:19.324 01:08:09 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:19.582 01:08:10 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:19.582 01:08:10 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:19.840 [2024-11-26 01:08:10.326709] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:19.840 01:08:10 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:19.840 01:08:10 -- common/autotest_common.sh@650 -- # local es=0 00:15:19.840 01:08:10 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:19.840 01:08:10 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:19.840 01:08:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:19.840 01:08:10 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:19.840 01:08:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:19.840 01:08:10 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:19.840 01:08:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:19.840 01:08:10 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:19.840 01:08:10 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:19.840 01:08:10 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:20.099 request: 00:15:20.099 { 00:15:20.099 "uuid": "7af24c97-5db1-41d2-a6c2-d8bf475774ff", 00:15:20.099 "method": "bdev_lvol_get_lvstores", 00:15:20.099 "req_id": 1 00:15:20.099 } 00:15:20.099 Got JSON-RPC error response 00:15:20.099 response: 00:15:20.099 { 00:15:20.099 "code": -19, 00:15:20.099 "message": "No such device" 00:15:20.099 } 00:15:20.099 01:08:10 -- common/autotest_common.sh@653 -- # es=1 00:15:20.099 01:08:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:20.099 01:08:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:20.099 01:08:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:20.099 01:08:10 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:20.356 aio_bdev 00:15:20.356 01:08:10 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:20.357 01:08:10 -- common/autotest_common.sh@897 -- # local bdev_name=c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:20.357 01:08:10 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:20.357 01:08:10 -- common/autotest_common.sh@899 -- # local i 00:15:20.357 01:08:10 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:20.357 01:08:10 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:20.357 01:08:10 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:20.615 01:08:11 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b c4ede682-09b2-43f8-b842-da8663ed69e3 -t 2000 00:15:20.873 [ 00:15:20.873 { 00:15:20.874 "name": "c4ede682-09b2-43f8-b842-da8663ed69e3", 00:15:20.874 "aliases": [ 00:15:20.874 "lvs/lvol" 00:15:20.874 ], 00:15:20.874 "product_name": "Logical Volume", 00:15:20.874 "block_size": 4096, 00:15:20.874 "num_blocks": 38912, 00:15:20.874 "uuid": "c4ede682-09b2-43f8-b842-da8663ed69e3", 00:15:20.874 "assigned_rate_limits": { 00:15:20.874 "rw_ios_per_sec": 0, 00:15:20.874 "rw_mbytes_per_sec": 0, 00:15:20.874 "r_mbytes_per_sec": 0, 00:15:20.874 "w_mbytes_per_sec": 0 00:15:20.874 }, 00:15:20.874 "claimed": false, 00:15:20.874 "zoned": false, 00:15:20.874 "supported_io_types": { 00:15:20.874 "read": true, 00:15:20.874 "write": true, 00:15:20.874 "unmap": true, 00:15:20.874 "write_zeroes": true, 00:15:20.874 "flush": false, 00:15:20.874 "reset": true, 00:15:20.874 "compare": false, 00:15:20.874 "compare_and_write": false, 00:15:20.874 "abort": false, 00:15:20.874 "nvme_admin": false, 00:15:20.874 "nvme_io": false 00:15:20.874 }, 00:15:20.874 "driver_specific": { 00:15:20.874 "lvol": { 00:15:20.874 "lvol_store_uuid": "7af24c97-5db1-41d2-a6c2-d8bf475774ff", 00:15:20.874 "base_bdev": "aio_bdev", 00:15:20.874 "thin_provision": false, 00:15:20.874 "snapshot": false, 00:15:20.874 "clone": false, 00:15:20.874 "esnap_clone": false 00:15:20.874 } 00:15:20.874 } 00:15:20.874 } 00:15:20.874 ] 00:15:20.874 01:08:11 -- common/autotest_common.sh@905 -- # return 0 00:15:20.874 01:08:11 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:20.874 01:08:11 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:21.440 01:08:11 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:21.440 01:08:11 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:21.440 01:08:11 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:21.440 01:08:11 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:21.440 01:08:11 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete c4ede682-09b2-43f8-b842-da8663ed69e3 00:15:21.698 01:08:12 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 7af24c97-5db1-41d2-a6c2-d8bf475774ff 00:15:21.956 01:08:12 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:22.214 01:08:12 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:22.214 00:15:22.214 real 0m20.571s 00:15:22.214 user 0m51.920s 00:15:22.214 sys 0m4.501s 00:15:22.214 01:08:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:22.214 01:08:12 -- common/autotest_common.sh@10 -- # set +x 00:15:22.214 ************************************ 00:15:22.214 END TEST lvs_grow_dirty 00:15:22.214 ************************************ 00:15:22.475 01:08:12 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:22.475 01:08:12 -- common/autotest_common.sh@806 -- # type=--id 00:15:22.475 01:08:12 -- common/autotest_common.sh@807 -- # id=0 00:15:22.475 01:08:12 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:22.475 01:08:12 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:22.475 01:08:12 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:22.475 01:08:12 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:22.475 01:08:12 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:22.475 01:08:12 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:22.475 nvmf_trace.0 00:15:22.475 01:08:12 -- common/autotest_common.sh@821 -- # return 0 00:15:22.475 01:08:12 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:22.475 01:08:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.475 01:08:12 -- nvmf/common.sh@116 -- # sync 00:15:22.475 01:08:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.475 01:08:12 -- nvmf/common.sh@119 -- # set +e 00:15:22.475 01:08:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.475 01:08:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.475 rmmod nvme_tcp 00:15:22.475 rmmod nvme_fabrics 00:15:22.475 rmmod nvme_keyring 00:15:22.475 01:08:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.475 01:08:12 -- nvmf/common.sh@123 -- # set -e 00:15:22.475 01:08:12 -- nvmf/common.sh@124 -- # return 0 00:15:22.475 01:08:12 -- nvmf/common.sh@477 -- # '[' -n 1036411 ']' 00:15:22.475 01:08:12 -- nvmf/common.sh@478 -- # killprocess 1036411 00:15:22.475 01:08:12 -- common/autotest_common.sh@936 -- # '[' -z 1036411 ']' 00:15:22.475 01:08:12 -- common/autotest_common.sh@940 -- # kill -0 1036411 00:15:22.475 01:08:12 -- common/autotest_common.sh@941 -- # uname 00:15:22.475 01:08:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:22.475 01:08:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1036411 00:15:22.475 01:08:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:22.475 01:08:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:22.475 01:08:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1036411' 00:15:22.475 killing process with pid 1036411 00:15:22.475 01:08:12 -- common/autotest_common.sh@955 -- # kill 1036411 00:15:22.475 01:08:12 -- common/autotest_common.sh@960 -- # wait 1036411 00:15:22.798 01:08:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.798 01:08:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.798 01:08:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.798 01:08:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.798 01:08:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.798 01:08:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.798 01:08:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.798 01:08:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.730 01:08:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:24.730 00:15:24.730 real 0m44.871s 00:15:24.730 user 1m16.568s 00:15:24.731 sys 0m8.344s 00:15:24.731 01:08:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:24.731 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:15:24.731 ************************************ 00:15:24.731 END TEST nvmf_lvs_grow 00:15:24.731 ************************************ 00:15:24.731 01:08:15 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:24.731 01:08:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:24.731 01:08:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:24.731 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:15:24.731 ************************************ 00:15:24.731 START TEST nvmf_bdev_io_wait 00:15:24.731 ************************************ 00:15:24.731 01:08:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:24.989 * Looking for test storage... 00:15:24.989 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:24.989 01:08:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:24.989 01:08:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:24.989 01:08:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:24.989 01:08:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:24.989 01:08:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:24.989 01:08:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:24.989 01:08:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:24.989 01:08:15 -- scripts/common.sh@335 -- # IFS=.-: 00:15:24.989 01:08:15 -- scripts/common.sh@335 -- # read -ra ver1 00:15:24.989 01:08:15 -- scripts/common.sh@336 -- # IFS=.-: 00:15:24.989 01:08:15 -- scripts/common.sh@336 -- # read -ra ver2 00:15:24.989 01:08:15 -- scripts/common.sh@337 -- # local 'op=<' 00:15:24.989 01:08:15 -- scripts/common.sh@339 -- # ver1_l=2 00:15:24.989 01:08:15 -- scripts/common.sh@340 -- # ver2_l=1 00:15:24.989 01:08:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:24.989 01:08:15 -- scripts/common.sh@343 -- # case "$op" in 00:15:24.989 01:08:15 -- scripts/common.sh@344 -- # : 1 00:15:24.989 01:08:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:24.989 01:08:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:24.989 01:08:15 -- scripts/common.sh@364 -- # decimal 1 00:15:24.989 01:08:15 -- scripts/common.sh@352 -- # local d=1 00:15:24.989 01:08:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:24.989 01:08:15 -- scripts/common.sh@354 -- # echo 1 00:15:24.989 01:08:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:24.989 01:08:15 -- scripts/common.sh@365 -- # decimal 2 00:15:24.989 01:08:15 -- scripts/common.sh@352 -- # local d=2 00:15:24.989 01:08:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:24.989 01:08:15 -- scripts/common.sh@354 -- # echo 2 00:15:24.989 01:08:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:24.989 01:08:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:24.989 01:08:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:24.989 01:08:15 -- scripts/common.sh@367 -- # return 0 00:15:24.989 01:08:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:24.989 01:08:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:24.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.989 --rc genhtml_branch_coverage=1 00:15:24.989 --rc genhtml_function_coverage=1 00:15:24.989 --rc genhtml_legend=1 00:15:24.989 --rc geninfo_all_blocks=1 00:15:24.989 --rc geninfo_unexecuted_blocks=1 00:15:24.989 00:15:24.989 ' 00:15:24.989 01:08:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:24.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.989 --rc genhtml_branch_coverage=1 00:15:24.989 --rc genhtml_function_coverage=1 00:15:24.989 --rc genhtml_legend=1 00:15:24.989 --rc geninfo_all_blocks=1 00:15:24.989 --rc geninfo_unexecuted_blocks=1 00:15:24.989 00:15:24.989 ' 00:15:24.989 01:08:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:24.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.989 --rc genhtml_branch_coverage=1 00:15:24.989 --rc genhtml_function_coverage=1 00:15:24.989 --rc genhtml_legend=1 00:15:24.989 --rc geninfo_all_blocks=1 00:15:24.989 --rc geninfo_unexecuted_blocks=1 00:15:24.989 00:15:24.989 ' 00:15:24.989 01:08:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:24.989 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.989 --rc genhtml_branch_coverage=1 00:15:24.989 --rc genhtml_function_coverage=1 00:15:24.989 --rc genhtml_legend=1 00:15:24.989 --rc geninfo_all_blocks=1 00:15:24.989 --rc geninfo_unexecuted_blocks=1 00:15:24.989 00:15:24.989 ' 00:15:24.989 01:08:15 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:24.989 01:08:15 -- nvmf/common.sh@7 -- # uname -s 00:15:24.989 01:08:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:24.989 01:08:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:24.989 01:08:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:24.989 01:08:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:24.990 01:08:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:24.990 01:08:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:24.990 01:08:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:24.990 01:08:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:24.990 01:08:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:24.990 01:08:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:24.990 01:08:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.990 01:08:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:24.990 01:08:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:24.990 01:08:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:24.990 01:08:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:24.990 01:08:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:24.990 01:08:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:24.990 01:08:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:24.990 01:08:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:24.990 01:08:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.990 01:08:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.990 01:08:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.990 01:08:15 -- paths/export.sh@5 -- # export PATH 00:15:24.990 01:08:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.990 01:08:15 -- nvmf/common.sh@46 -- # : 0 00:15:24.990 01:08:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:24.990 01:08:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:24.990 01:08:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:24.990 01:08:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:24.990 01:08:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:24.990 01:08:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:24.990 01:08:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:24.990 01:08:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:24.990 01:08:15 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:24.990 01:08:15 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:24.990 01:08:15 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:24.990 01:08:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:24.990 01:08:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:24.990 01:08:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:24.990 01:08:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:24.990 01:08:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:24.990 01:08:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.990 01:08:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:24.990 01:08:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.990 01:08:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:24.990 01:08:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:24.990 01:08:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:24.990 01:08:15 -- common/autotest_common.sh@10 -- # set +x 00:15:26.892 01:08:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:26.892 01:08:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:26.892 01:08:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:26.892 01:08:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:26.892 01:08:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:26.892 01:08:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:26.892 01:08:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:26.892 01:08:17 -- nvmf/common.sh@294 -- # net_devs=() 00:15:26.892 01:08:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:26.892 01:08:17 -- nvmf/common.sh@295 -- # e810=() 00:15:26.892 01:08:17 -- nvmf/common.sh@295 -- # local -ga e810 00:15:27.151 01:08:17 -- nvmf/common.sh@296 -- # x722=() 00:15:27.151 01:08:17 -- nvmf/common.sh@296 -- # local -ga x722 00:15:27.151 01:08:17 -- nvmf/common.sh@297 -- # mlx=() 00:15:27.151 01:08:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:27.151 01:08:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:27.151 01:08:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:27.151 01:08:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:27.151 01:08:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:27.151 01:08:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:27.151 01:08:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:27.151 01:08:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:27.151 01:08:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:27.151 01:08:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:27.152 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:27.152 01:08:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:27.152 01:08:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:27.152 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:27.152 01:08:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:27.152 01:08:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:27.152 01:08:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:27.152 01:08:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:27.152 01:08:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:27.152 01:08:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:27.152 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:27.152 01:08:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:27.152 01:08:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:27.152 01:08:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:27.152 01:08:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:27.152 01:08:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:27.152 01:08:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:27.152 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:27.152 01:08:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:27.152 01:08:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:27.152 01:08:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:27.152 01:08:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:27.152 01:08:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:27.152 01:08:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:27.152 01:08:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:27.152 01:08:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:27.152 01:08:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:27.152 01:08:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:27.152 01:08:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:27.152 01:08:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:27.152 01:08:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:27.152 01:08:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:27.152 01:08:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:27.152 01:08:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:27.152 01:08:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:27.152 01:08:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:27.152 01:08:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:27.152 01:08:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:27.152 01:08:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:27.152 01:08:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:27.152 01:08:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:27.152 01:08:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:27.152 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:27.152 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:15:27.152 00:15:27.152 --- 10.0.0.2 ping statistics --- 00:15:27.152 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:27.152 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:15:27.152 01:08:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:27.152 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:27.152 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:15:27.152 00:15:27.152 --- 10.0.0.1 ping statistics --- 00:15:27.152 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:27.152 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:15:27.152 01:08:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:27.152 01:08:17 -- nvmf/common.sh@410 -- # return 0 00:15:27.152 01:08:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:27.152 01:08:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:27.152 01:08:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:27.152 01:08:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:27.152 01:08:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:27.152 01:08:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:27.152 01:08:17 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:27.152 01:08:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:27.152 01:08:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:27.152 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:15:27.152 01:08:17 -- nvmf/common.sh@469 -- # nvmfpid=1039036 00:15:27.152 01:08:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:27.152 01:08:17 -- nvmf/common.sh@470 -- # waitforlisten 1039036 00:15:27.152 01:08:17 -- common/autotest_common.sh@829 -- # '[' -z 1039036 ']' 00:15:27.152 01:08:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:27.152 01:08:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:27.152 01:08:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:27.152 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:27.152 01:08:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:27.152 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:15:27.152 [2024-11-26 01:08:17.660332] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.152 [2024-11-26 01:08:17.660413] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:27.411 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.411 [2024-11-26 01:08:17.728461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:27.411 [2024-11-26 01:08:17.842190] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:27.411 [2024-11-26 01:08:17.842332] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:27.411 [2024-11-26 01:08:17.842349] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:27.411 [2024-11-26 01:08:17.842362] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:27.411 [2024-11-26 01:08:17.842429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:27.411 [2024-11-26 01:08:17.842461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:27.411 [2024-11-26 01:08:17.842519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:27.411 [2024-11-26 01:08:17.842521] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:27.411 01:08:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:27.411 01:08:17 -- common/autotest_common.sh@862 -- # return 0 00:15:27.411 01:08:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:27.411 01:08:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:27.411 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:15:27.411 01:08:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:27.411 01:08:17 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:27.411 01:08:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.411 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:15:27.411 01:08:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.411 01:08:17 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:27.411 01:08:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.411 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:15:27.669 01:08:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.669 01:08:17 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:27.669 01:08:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.669 01:08:17 -- common/autotest_common.sh@10 -- # set +x 00:15:27.669 [2024-11-26 01:08:18.000252] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:27.669 01:08:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:27.669 01:08:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.669 01:08:18 -- common/autotest_common.sh@10 -- # set +x 00:15:27.669 Malloc0 00:15:27.669 01:08:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:27.669 01:08:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.669 01:08:18 -- common/autotest_common.sh@10 -- # set +x 00:15:27.669 01:08:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:27.669 01:08:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.669 01:08:18 -- common/autotest_common.sh@10 -- # set +x 00:15:27.669 01:08:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:27.669 01:08:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.669 01:08:18 -- common/autotest_common.sh@10 -- # set +x 00:15:27.669 [2024-11-26 01:08:18.064358] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:27.669 01:08:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=1039128 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@30 -- # READ_PID=1039129 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:27.669 01:08:18 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # config=() 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # local subsystem config 00:15:27.670 01:08:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=1039132 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:27.670 { 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme$subsystem", 00:15:27.670 "trtype": "$TEST_TRANSPORT", 00:15:27.670 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "$NVMF_PORT", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:27.670 "hdgst": ${hdgst:-false}, 00:15:27.670 "ddgst": ${ddgst:-false} 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 } 00:15:27.670 EOF 00:15:27.670 )") 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # config=() 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # local subsystem config 00:15:27.670 01:08:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=1039134 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:27.670 { 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme$subsystem", 00:15:27.670 "trtype": "$TEST_TRANSPORT", 00:15:27.670 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "$NVMF_PORT", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:27.670 "hdgst": ${hdgst:-false}, 00:15:27.670 "ddgst": ${ddgst:-false} 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 } 00:15:27.670 EOF 00:15:27.670 )") 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@35 -- # sync 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # config=() 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # local subsystem config 00:15:27.670 01:08:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # cat 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:27.670 { 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme$subsystem", 00:15:27.670 "trtype": "$TEST_TRANSPORT", 00:15:27.670 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "$NVMF_PORT", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:27.670 "hdgst": ${hdgst:-false}, 00:15:27.670 "ddgst": ${ddgst:-false} 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 } 00:15:27.670 EOF 00:15:27.670 )") 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # config=() 00:15:27.670 01:08:18 -- nvmf/common.sh@520 -- # local subsystem config 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # cat 00:15:27.670 01:08:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:27.670 { 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme$subsystem", 00:15:27.670 "trtype": "$TEST_TRANSPORT", 00:15:27.670 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "$NVMF_PORT", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:27.670 "hdgst": ${hdgst:-false}, 00:15:27.670 "ddgst": ${ddgst:-false} 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 } 00:15:27.670 EOF 00:15:27.670 )") 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # cat 00:15:27.670 01:08:18 -- target/bdev_io_wait.sh@37 -- # wait 1039128 00:15:27.670 01:08:18 -- nvmf/common.sh@542 -- # cat 00:15:27.670 01:08:18 -- nvmf/common.sh@544 -- # jq . 00:15:27.670 01:08:18 -- nvmf/common.sh@544 -- # jq . 00:15:27.670 01:08:18 -- nvmf/common.sh@544 -- # jq . 00:15:27.670 01:08:18 -- nvmf/common.sh@545 -- # IFS=, 00:15:27.670 01:08:18 -- nvmf/common.sh@544 -- # jq . 00:15:27.670 01:08:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme1", 00:15:27.670 "trtype": "tcp", 00:15:27.670 "traddr": "10.0.0.2", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "4420", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:27.670 "hdgst": false, 00:15:27.670 "ddgst": false 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 }' 00:15:27.670 01:08:18 -- nvmf/common.sh@545 -- # IFS=, 00:15:27.670 01:08:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme1", 00:15:27.670 "trtype": "tcp", 00:15:27.670 "traddr": "10.0.0.2", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "4420", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:27.670 "hdgst": false, 00:15:27.670 "ddgst": false 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 }' 00:15:27.670 01:08:18 -- nvmf/common.sh@545 -- # IFS=, 00:15:27.670 01:08:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme1", 00:15:27.670 "trtype": "tcp", 00:15:27.670 "traddr": "10.0.0.2", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "4420", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:27.670 "hdgst": false, 00:15:27.670 "ddgst": false 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 }' 00:15:27.670 01:08:18 -- nvmf/common.sh@545 -- # IFS=, 00:15:27.670 01:08:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:27.670 "params": { 00:15:27.670 "name": "Nvme1", 00:15:27.670 "trtype": "tcp", 00:15:27.670 "traddr": "10.0.0.2", 00:15:27.670 "adrfam": "ipv4", 00:15:27.670 "trsvcid": "4420", 00:15:27.670 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:27.670 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:27.670 "hdgst": false, 00:15:27.670 "ddgst": false 00:15:27.670 }, 00:15:27.670 "method": "bdev_nvme_attach_controller" 00:15:27.670 }' 00:15:27.670 [2024-11-26 01:08:18.107792] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.670 [2024-11-26 01:08:18.107808] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.670 [2024-11-26 01:08:18.107886] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:27.670 [2024-11-26 01:08:18.107889] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:27.670 [2024-11-26 01:08:18.108602] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.670 [2024-11-26 01:08:18.108671] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:27.670 [2024-11-26 01:08:18.111660] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:27.670 [2024-11-26 01:08:18.111733] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:27.670 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.929 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.929 [2024-11-26 01:08:18.279855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:27.929 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.929 [2024-11-26 01:08:18.374146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:27.929 [2024-11-26 01:08:18.380246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:27.929 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.187 [2024-11-26 01:08:18.475681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:28.187 [2024-11-26 01:08:18.478331] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:28.187 [2024-11-26 01:08:18.548931] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:28.187 [2024-11-26 01:08:18.574374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:28.187 [2024-11-26 01:08:18.640888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:28.187 Running I/O for 1 seconds... 00:15:28.444 Running I/O for 1 seconds... 00:15:28.444 Running I/O for 1 seconds... 00:15:28.444 Running I/O for 1 seconds... 00:15:29.377 00:15:29.377 Latency(us) 00:15:29.377 [2024-11-26T00:08:19.912Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:29.377 [2024-11-26T00:08:19.912Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:29.378 Nvme1n1 : 1.02 6796.16 26.55 0.00 0.00 18681.62 8592.50 30680.56 00:15:29.378 [2024-11-26T00:08:19.913Z] =================================================================================================================== 00:15:29.378 [2024-11-26T00:08:19.913Z] Total : 6796.16 26.55 0.00 0.00 18681.62 8592.50 30680.56 00:15:29.378 00:15:29.378 Latency(us) 00:15:29.378 [2024-11-26T00:08:19.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:29.378 [2024-11-26T00:08:19.913Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:29.378 Nvme1n1 : 1.01 6657.70 26.01 0.00 0.00 19163.50 5582.70 35729.26 00:15:29.378 [2024-11-26T00:08:19.913Z] =================================================================================================================== 00:15:29.378 [2024-11-26T00:08:19.913Z] Total : 6657.70 26.01 0.00 0.00 19163.50 5582.70 35729.26 00:15:29.378 00:15:29.378 Latency(us) 00:15:29.378 [2024-11-26T00:08:19.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:29.378 [2024-11-26T00:08:19.913Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:29.378 Nvme1n1 : 1.00 194908.36 761.36 0.00 0.00 654.18 260.93 849.54 00:15:29.378 [2024-11-26T00:08:19.913Z] =================================================================================================================== 00:15:29.378 [2024-11-26T00:08:19.913Z] Total : 194908.36 761.36 0.00 0.00 654.18 260.93 849.54 00:15:29.378 00:15:29.378 Latency(us) 00:15:29.378 [2024-11-26T00:08:19.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:29.378 [2024-11-26T00:08:19.913Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:29.378 Nvme1n1 : 1.01 10626.44 41.51 0.00 0.00 11996.92 6262.33 23301.69 00:15:29.378 [2024-11-26T00:08:19.913Z] =================================================================================================================== 00:15:29.378 [2024-11-26T00:08:19.913Z] Total : 10626.44 41.51 0.00 0.00 11996.92 6262.33 23301.69 00:15:29.636 01:08:20 -- target/bdev_io_wait.sh@38 -- # wait 1039129 00:15:29.636 01:08:20 -- target/bdev_io_wait.sh@39 -- # wait 1039132 00:15:29.636 01:08:20 -- target/bdev_io_wait.sh@40 -- # wait 1039134 00:15:29.636 01:08:20 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:29.636 01:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:29.636 01:08:20 -- common/autotest_common.sh@10 -- # set +x 00:15:29.894 01:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:29.894 01:08:20 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:29.894 01:08:20 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:29.894 01:08:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:29.894 01:08:20 -- nvmf/common.sh@116 -- # sync 00:15:29.894 01:08:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:29.894 01:08:20 -- nvmf/common.sh@119 -- # set +e 00:15:29.894 01:08:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:29.894 01:08:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:29.894 rmmod nvme_tcp 00:15:29.894 rmmod nvme_fabrics 00:15:29.894 rmmod nvme_keyring 00:15:29.894 01:08:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:29.894 01:08:20 -- nvmf/common.sh@123 -- # set -e 00:15:29.894 01:08:20 -- nvmf/common.sh@124 -- # return 0 00:15:29.894 01:08:20 -- nvmf/common.sh@477 -- # '[' -n 1039036 ']' 00:15:29.894 01:08:20 -- nvmf/common.sh@478 -- # killprocess 1039036 00:15:29.894 01:08:20 -- common/autotest_common.sh@936 -- # '[' -z 1039036 ']' 00:15:29.894 01:08:20 -- common/autotest_common.sh@940 -- # kill -0 1039036 00:15:29.894 01:08:20 -- common/autotest_common.sh@941 -- # uname 00:15:29.894 01:08:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:29.894 01:08:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1039036 00:15:29.894 01:08:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:29.894 01:08:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:29.894 01:08:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1039036' 00:15:29.894 killing process with pid 1039036 00:15:29.894 01:08:20 -- common/autotest_common.sh@955 -- # kill 1039036 00:15:29.894 01:08:20 -- common/autotest_common.sh@960 -- # wait 1039036 00:15:30.153 01:08:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:30.153 01:08:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:30.153 01:08:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:30.153 01:08:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:30.153 01:08:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:30.153 01:08:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:30.153 01:08:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:30.153 01:08:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:32.056 01:08:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:32.056 00:15:32.056 real 0m7.332s 00:15:32.056 user 0m16.274s 00:15:32.056 sys 0m3.629s 00:15:32.056 01:08:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:32.056 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:15:32.056 ************************************ 00:15:32.056 END TEST nvmf_bdev_io_wait 00:15:32.056 ************************************ 00:15:32.315 01:08:22 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:32.315 01:08:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:32.315 01:08:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:32.315 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:15:32.315 ************************************ 00:15:32.315 START TEST nvmf_queue_depth 00:15:32.315 ************************************ 00:15:32.315 01:08:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:32.315 * Looking for test storage... 00:15:32.315 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:32.315 01:08:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:32.315 01:08:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:32.315 01:08:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:32.315 01:08:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:32.315 01:08:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:32.315 01:08:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:32.315 01:08:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:32.315 01:08:22 -- scripts/common.sh@335 -- # IFS=.-: 00:15:32.315 01:08:22 -- scripts/common.sh@335 -- # read -ra ver1 00:15:32.315 01:08:22 -- scripts/common.sh@336 -- # IFS=.-: 00:15:32.315 01:08:22 -- scripts/common.sh@336 -- # read -ra ver2 00:15:32.315 01:08:22 -- scripts/common.sh@337 -- # local 'op=<' 00:15:32.315 01:08:22 -- scripts/common.sh@339 -- # ver1_l=2 00:15:32.315 01:08:22 -- scripts/common.sh@340 -- # ver2_l=1 00:15:32.315 01:08:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:32.315 01:08:22 -- scripts/common.sh@343 -- # case "$op" in 00:15:32.315 01:08:22 -- scripts/common.sh@344 -- # : 1 00:15:32.315 01:08:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:32.315 01:08:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:32.315 01:08:22 -- scripts/common.sh@364 -- # decimal 1 00:15:32.315 01:08:22 -- scripts/common.sh@352 -- # local d=1 00:15:32.315 01:08:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:32.315 01:08:22 -- scripts/common.sh@354 -- # echo 1 00:15:32.315 01:08:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:32.315 01:08:22 -- scripts/common.sh@365 -- # decimal 2 00:15:32.315 01:08:22 -- scripts/common.sh@352 -- # local d=2 00:15:32.315 01:08:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:32.315 01:08:22 -- scripts/common.sh@354 -- # echo 2 00:15:32.315 01:08:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:32.315 01:08:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:32.315 01:08:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:32.315 01:08:22 -- scripts/common.sh@367 -- # return 0 00:15:32.315 01:08:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:32.315 01:08:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:32.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.315 --rc genhtml_branch_coverage=1 00:15:32.315 --rc genhtml_function_coverage=1 00:15:32.315 --rc genhtml_legend=1 00:15:32.315 --rc geninfo_all_blocks=1 00:15:32.315 --rc geninfo_unexecuted_blocks=1 00:15:32.315 00:15:32.315 ' 00:15:32.315 01:08:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:32.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.315 --rc genhtml_branch_coverage=1 00:15:32.315 --rc genhtml_function_coverage=1 00:15:32.315 --rc genhtml_legend=1 00:15:32.315 --rc geninfo_all_blocks=1 00:15:32.315 --rc geninfo_unexecuted_blocks=1 00:15:32.315 00:15:32.315 ' 00:15:32.315 01:08:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:32.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.315 --rc genhtml_branch_coverage=1 00:15:32.315 --rc genhtml_function_coverage=1 00:15:32.315 --rc genhtml_legend=1 00:15:32.315 --rc geninfo_all_blocks=1 00:15:32.315 --rc geninfo_unexecuted_blocks=1 00:15:32.315 00:15:32.315 ' 00:15:32.315 01:08:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:32.315 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:32.315 --rc genhtml_branch_coverage=1 00:15:32.315 --rc genhtml_function_coverage=1 00:15:32.315 --rc genhtml_legend=1 00:15:32.315 --rc geninfo_all_blocks=1 00:15:32.315 --rc geninfo_unexecuted_blocks=1 00:15:32.315 00:15:32.315 ' 00:15:32.315 01:08:22 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:32.315 01:08:22 -- nvmf/common.sh@7 -- # uname -s 00:15:32.315 01:08:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:32.315 01:08:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:32.315 01:08:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:32.315 01:08:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:32.315 01:08:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:32.315 01:08:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:32.315 01:08:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:32.315 01:08:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:32.315 01:08:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:32.315 01:08:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:32.315 01:08:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:32.315 01:08:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:32.315 01:08:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:32.315 01:08:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:32.315 01:08:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:32.315 01:08:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:32.315 01:08:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:32.315 01:08:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:32.315 01:08:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:32.315 01:08:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.315 01:08:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.315 01:08:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.315 01:08:22 -- paths/export.sh@5 -- # export PATH 00:15:32.315 01:08:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:32.315 01:08:22 -- nvmf/common.sh@46 -- # : 0 00:15:32.315 01:08:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:32.315 01:08:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:32.315 01:08:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:32.315 01:08:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:32.315 01:08:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:32.315 01:08:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:32.315 01:08:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:32.315 01:08:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:32.315 01:08:22 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:32.315 01:08:22 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:32.315 01:08:22 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:32.315 01:08:22 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:32.315 01:08:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:32.315 01:08:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:32.315 01:08:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:32.315 01:08:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:32.315 01:08:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:32.315 01:08:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:32.315 01:08:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:32.315 01:08:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:32.315 01:08:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:32.315 01:08:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:32.315 01:08:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:32.315 01:08:22 -- common/autotest_common.sh@10 -- # set +x 00:15:34.847 01:08:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:34.847 01:08:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:34.847 01:08:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:34.847 01:08:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:34.847 01:08:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:34.847 01:08:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:34.847 01:08:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:34.847 01:08:24 -- nvmf/common.sh@294 -- # net_devs=() 00:15:34.847 01:08:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:34.847 01:08:24 -- nvmf/common.sh@295 -- # e810=() 00:15:34.847 01:08:24 -- nvmf/common.sh@295 -- # local -ga e810 00:15:34.847 01:08:24 -- nvmf/common.sh@296 -- # x722=() 00:15:34.847 01:08:24 -- nvmf/common.sh@296 -- # local -ga x722 00:15:34.847 01:08:24 -- nvmf/common.sh@297 -- # mlx=() 00:15:34.847 01:08:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:34.847 01:08:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:34.847 01:08:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:34.847 01:08:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:34.847 01:08:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:34.847 01:08:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:34.847 01:08:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:34.847 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:34.847 01:08:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:34.847 01:08:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:34.847 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:34.847 01:08:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:34.847 01:08:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:34.847 01:08:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:34.847 01:08:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:34.848 01:08:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:34.848 01:08:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:34.848 01:08:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:34.848 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:34.848 01:08:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:34.848 01:08:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:34.848 01:08:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:34.848 01:08:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:34.848 01:08:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:34.848 01:08:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:34.848 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:34.848 01:08:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:34.848 01:08:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:34.848 01:08:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:34.848 01:08:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:34.848 01:08:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:34.848 01:08:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:34.848 01:08:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:34.848 01:08:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:34.848 01:08:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:34.848 01:08:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:34.848 01:08:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:34.848 01:08:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:34.848 01:08:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:34.848 01:08:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:34.848 01:08:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:34.848 01:08:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:34.848 01:08:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:34.848 01:08:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:34.848 01:08:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:34.848 01:08:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:34.848 01:08:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:34.848 01:08:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:34.848 01:08:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:34.848 01:08:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:34.848 01:08:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:34.848 01:08:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:34.848 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:34.848 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:15:34.848 00:15:34.848 --- 10.0.0.2 ping statistics --- 00:15:34.848 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:34.848 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:15:34.848 01:08:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:34.848 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:34.848 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:15:34.848 00:15:34.848 --- 10.0.0.1 ping statistics --- 00:15:34.848 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:34.848 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:15:34.848 01:08:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:34.848 01:08:25 -- nvmf/common.sh@410 -- # return 0 00:15:34.848 01:08:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:34.848 01:08:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:34.848 01:08:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:34.848 01:08:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:34.848 01:08:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:34.848 01:08:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:34.848 01:08:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:34.848 01:08:25 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:34.848 01:08:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:34.848 01:08:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:34.848 01:08:25 -- common/autotest_common.sh@10 -- # set +x 00:15:34.848 01:08:25 -- nvmf/common.sh@469 -- # nvmfpid=1041374 00:15:34.848 01:08:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:34.848 01:08:25 -- nvmf/common.sh@470 -- # waitforlisten 1041374 00:15:34.848 01:08:25 -- common/autotest_common.sh@829 -- # '[' -z 1041374 ']' 00:15:34.848 01:08:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:34.848 01:08:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:34.848 01:08:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:34.848 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:34.848 01:08:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:34.848 01:08:25 -- common/autotest_common.sh@10 -- # set +x 00:15:34.848 [2024-11-26 01:08:25.175000] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:34.848 [2024-11-26 01:08:25.175098] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:34.848 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.848 [2024-11-26 01:08:25.239075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.848 [2024-11-26 01:08:25.342875] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:34.848 [2024-11-26 01:08:25.343038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:34.848 [2024-11-26 01:08:25.343055] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:34.848 [2024-11-26 01:08:25.343067] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:34.848 [2024-11-26 01:08:25.343105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:35.783 01:08:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:35.783 01:08:26 -- common/autotest_common.sh@862 -- # return 0 00:15:35.783 01:08:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:35.783 01:08:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 01:08:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:35.783 01:08:26 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:35.783 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 [2024-11-26 01:08:26.158906] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:35.783 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.783 01:08:26 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:35.783 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 Malloc0 00:15:35.783 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.783 01:08:26 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:35.783 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.783 01:08:26 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:35.783 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.783 01:08:26 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:35.783 01:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 [2024-11-26 01:08:26.219407] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:35.783 01:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.783 01:08:26 -- target/queue_depth.sh@30 -- # bdevperf_pid=1041530 00:15:35.783 01:08:26 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:35.783 01:08:26 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:35.783 01:08:26 -- target/queue_depth.sh@33 -- # waitforlisten 1041530 /var/tmp/bdevperf.sock 00:15:35.783 01:08:26 -- common/autotest_common.sh@829 -- # '[' -z 1041530 ']' 00:15:35.783 01:08:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:35.783 01:08:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:35.783 01:08:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:35.783 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:35.783 01:08:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:35.783 01:08:26 -- common/autotest_common.sh@10 -- # set +x 00:15:35.783 [2024-11-26 01:08:26.261719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:35.783 [2024-11-26 01:08:26.261781] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1041530 ] 00:15:35.783 EAL: No free 2048 kB hugepages reported on node 1 00:15:36.041 [2024-11-26 01:08:26.322120] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:36.041 [2024-11-26 01:08:26.435653] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:36.975 01:08:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:36.975 01:08:27 -- common/autotest_common.sh@862 -- # return 0 00:15:36.975 01:08:27 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:36.975 01:08:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:36.975 01:08:27 -- common/autotest_common.sh@10 -- # set +x 00:15:36.975 NVMe0n1 00:15:36.975 01:08:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:36.975 01:08:27 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:37.234 Running I/O for 10 seconds... 00:15:47.206 00:15:47.206 Latency(us) 00:15:47.206 [2024-11-26T00:08:37.741Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:47.206 [2024-11-26T00:08:37.741Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:47.206 Verification LBA range: start 0x0 length 0x4000 00:15:47.206 NVMe0n1 : 10.07 11541.37 45.08 0.00 0.00 88373.22 14951.92 67574.90 00:15:47.206 [2024-11-26T00:08:37.741Z] =================================================================================================================== 00:15:47.206 [2024-11-26T00:08:37.741Z] Total : 11541.37 45.08 0.00 0.00 88373.22 14951.92 67574.90 00:15:47.206 0 00:15:47.206 01:08:37 -- target/queue_depth.sh@39 -- # killprocess 1041530 00:15:47.206 01:08:37 -- common/autotest_common.sh@936 -- # '[' -z 1041530 ']' 00:15:47.206 01:08:37 -- common/autotest_common.sh@940 -- # kill -0 1041530 00:15:47.206 01:08:37 -- common/autotest_common.sh@941 -- # uname 00:15:47.206 01:08:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:47.206 01:08:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1041530 00:15:47.206 01:08:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:47.206 01:08:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:47.206 01:08:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1041530' 00:15:47.206 killing process with pid 1041530 00:15:47.206 01:08:37 -- common/autotest_common.sh@955 -- # kill 1041530 00:15:47.206 Received shutdown signal, test time was about 10.000000 seconds 00:15:47.206 00:15:47.206 Latency(us) 00:15:47.206 [2024-11-26T00:08:37.741Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:47.206 [2024-11-26T00:08:37.741Z] =================================================================================================================== 00:15:47.206 [2024-11-26T00:08:37.741Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:47.206 01:08:37 -- common/autotest_common.sh@960 -- # wait 1041530 00:15:47.773 01:08:38 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:47.773 01:08:38 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:47.773 01:08:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:47.773 01:08:38 -- nvmf/common.sh@116 -- # sync 00:15:47.773 01:08:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:47.773 01:08:38 -- nvmf/common.sh@119 -- # set +e 00:15:47.773 01:08:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:47.773 01:08:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:47.773 rmmod nvme_tcp 00:15:47.773 rmmod nvme_fabrics 00:15:47.773 rmmod nvme_keyring 00:15:47.773 01:08:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:47.773 01:08:38 -- nvmf/common.sh@123 -- # set -e 00:15:47.773 01:08:38 -- nvmf/common.sh@124 -- # return 0 00:15:47.773 01:08:38 -- nvmf/common.sh@477 -- # '[' -n 1041374 ']' 00:15:47.773 01:08:38 -- nvmf/common.sh@478 -- # killprocess 1041374 00:15:47.773 01:08:38 -- common/autotest_common.sh@936 -- # '[' -z 1041374 ']' 00:15:47.773 01:08:38 -- common/autotest_common.sh@940 -- # kill -0 1041374 00:15:47.773 01:08:38 -- common/autotest_common.sh@941 -- # uname 00:15:47.773 01:08:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:47.773 01:08:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1041374 00:15:47.773 01:08:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:47.773 01:08:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:47.773 01:08:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1041374' 00:15:47.773 killing process with pid 1041374 00:15:47.773 01:08:38 -- common/autotest_common.sh@955 -- # kill 1041374 00:15:47.773 01:08:38 -- common/autotest_common.sh@960 -- # wait 1041374 00:15:48.031 01:08:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:48.031 01:08:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:48.031 01:08:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:48.031 01:08:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:48.031 01:08:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:48.031 01:08:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:48.031 01:08:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:48.031 01:08:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:49.934 01:08:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:49.934 00:15:49.934 real 0m17.840s 00:15:49.934 user 0m24.393s 00:15:49.934 sys 0m3.713s 00:15:49.934 01:08:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:49.934 01:08:40 -- common/autotest_common.sh@10 -- # set +x 00:15:49.934 ************************************ 00:15:49.934 END TEST nvmf_queue_depth 00:15:49.934 ************************************ 00:15:50.193 01:08:40 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:50.193 01:08:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:50.193 01:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:50.193 01:08:40 -- common/autotest_common.sh@10 -- # set +x 00:15:50.193 ************************************ 00:15:50.193 START TEST nvmf_multipath 00:15:50.193 ************************************ 00:15:50.193 01:08:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:50.193 * Looking for test storage... 00:15:50.193 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:50.193 01:08:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:50.193 01:08:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:50.193 01:08:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:50.193 01:08:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:50.193 01:08:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:50.193 01:08:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:50.193 01:08:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:50.193 01:08:40 -- scripts/common.sh@335 -- # IFS=.-: 00:15:50.193 01:08:40 -- scripts/common.sh@335 -- # read -ra ver1 00:15:50.193 01:08:40 -- scripts/common.sh@336 -- # IFS=.-: 00:15:50.193 01:08:40 -- scripts/common.sh@336 -- # read -ra ver2 00:15:50.193 01:08:40 -- scripts/common.sh@337 -- # local 'op=<' 00:15:50.193 01:08:40 -- scripts/common.sh@339 -- # ver1_l=2 00:15:50.193 01:08:40 -- scripts/common.sh@340 -- # ver2_l=1 00:15:50.193 01:08:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:50.193 01:08:40 -- scripts/common.sh@343 -- # case "$op" in 00:15:50.193 01:08:40 -- scripts/common.sh@344 -- # : 1 00:15:50.193 01:08:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:50.193 01:08:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:50.193 01:08:40 -- scripts/common.sh@364 -- # decimal 1 00:15:50.193 01:08:40 -- scripts/common.sh@352 -- # local d=1 00:15:50.193 01:08:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:50.193 01:08:40 -- scripts/common.sh@354 -- # echo 1 00:15:50.193 01:08:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:50.193 01:08:40 -- scripts/common.sh@365 -- # decimal 2 00:15:50.193 01:08:40 -- scripts/common.sh@352 -- # local d=2 00:15:50.193 01:08:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:50.193 01:08:40 -- scripts/common.sh@354 -- # echo 2 00:15:50.193 01:08:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:50.193 01:08:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:50.193 01:08:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:50.193 01:08:40 -- scripts/common.sh@367 -- # return 0 00:15:50.193 01:08:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:50.193 01:08:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.193 --rc genhtml_branch_coverage=1 00:15:50.193 --rc genhtml_function_coverage=1 00:15:50.193 --rc genhtml_legend=1 00:15:50.193 --rc geninfo_all_blocks=1 00:15:50.193 --rc geninfo_unexecuted_blocks=1 00:15:50.193 00:15:50.193 ' 00:15:50.193 01:08:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.193 --rc genhtml_branch_coverage=1 00:15:50.193 --rc genhtml_function_coverage=1 00:15:50.193 --rc genhtml_legend=1 00:15:50.193 --rc geninfo_all_blocks=1 00:15:50.193 --rc geninfo_unexecuted_blocks=1 00:15:50.193 00:15:50.193 ' 00:15:50.193 01:08:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.193 --rc genhtml_branch_coverage=1 00:15:50.193 --rc genhtml_function_coverage=1 00:15:50.193 --rc genhtml_legend=1 00:15:50.193 --rc geninfo_all_blocks=1 00:15:50.193 --rc geninfo_unexecuted_blocks=1 00:15:50.193 00:15:50.193 ' 00:15:50.193 01:08:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:50.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:50.193 --rc genhtml_branch_coverage=1 00:15:50.193 --rc genhtml_function_coverage=1 00:15:50.193 --rc genhtml_legend=1 00:15:50.193 --rc geninfo_all_blocks=1 00:15:50.193 --rc geninfo_unexecuted_blocks=1 00:15:50.193 00:15:50.193 ' 00:15:50.193 01:08:40 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:50.193 01:08:40 -- nvmf/common.sh@7 -- # uname -s 00:15:50.193 01:08:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:50.193 01:08:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:50.193 01:08:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:50.193 01:08:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:50.193 01:08:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:50.193 01:08:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:50.193 01:08:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:50.193 01:08:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:50.193 01:08:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:50.193 01:08:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:50.193 01:08:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:50.193 01:08:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:50.193 01:08:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:50.193 01:08:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:50.193 01:08:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:50.193 01:08:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:50.193 01:08:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:50.193 01:08:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:50.193 01:08:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:50.193 01:08:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.193 01:08:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.193 01:08:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.193 01:08:40 -- paths/export.sh@5 -- # export PATH 00:15:50.193 01:08:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:50.193 01:08:40 -- nvmf/common.sh@46 -- # : 0 00:15:50.193 01:08:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:50.193 01:08:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:50.193 01:08:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:50.193 01:08:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:50.193 01:08:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:50.193 01:08:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:50.193 01:08:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:50.193 01:08:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:50.193 01:08:40 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:50.193 01:08:40 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:50.193 01:08:40 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:50.193 01:08:40 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:50.193 01:08:40 -- target/multipath.sh@43 -- # nvmftestinit 00:15:50.193 01:08:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:50.193 01:08:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:50.193 01:08:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:50.193 01:08:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:50.193 01:08:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:50.193 01:08:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:50.193 01:08:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:50.193 01:08:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:50.193 01:08:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:50.193 01:08:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:50.193 01:08:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:50.193 01:08:40 -- common/autotest_common.sh@10 -- # set +x 00:15:52.096 01:08:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:52.096 01:08:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:52.096 01:08:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:52.096 01:08:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:52.096 01:08:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:52.096 01:08:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:52.096 01:08:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:52.096 01:08:42 -- nvmf/common.sh@294 -- # net_devs=() 00:15:52.096 01:08:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:52.096 01:08:42 -- nvmf/common.sh@295 -- # e810=() 00:15:52.096 01:08:42 -- nvmf/common.sh@295 -- # local -ga e810 00:15:52.096 01:08:42 -- nvmf/common.sh@296 -- # x722=() 00:15:52.096 01:08:42 -- nvmf/common.sh@296 -- # local -ga x722 00:15:52.096 01:08:42 -- nvmf/common.sh@297 -- # mlx=() 00:15:52.096 01:08:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:52.096 01:08:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:52.096 01:08:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:52.096 01:08:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:52.096 01:08:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:52.096 01:08:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:52.096 01:08:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:52.096 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:52.096 01:08:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:52.096 01:08:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:52.096 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:52.096 01:08:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:52.096 01:08:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:52.096 01:08:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:52.096 01:08:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:52.096 01:08:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:52.096 01:08:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:52.096 01:08:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:52.096 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:52.096 01:08:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:52.096 01:08:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:52.096 01:08:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:52.096 01:08:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:52.096 01:08:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:52.096 01:08:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:52.096 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:52.096 01:08:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:52.096 01:08:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:52.096 01:08:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:52.096 01:08:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:52.097 01:08:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:52.097 01:08:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:52.097 01:08:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:52.097 01:08:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:52.097 01:08:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:52.097 01:08:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:52.097 01:08:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:52.097 01:08:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:52.097 01:08:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:52.097 01:08:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:52.097 01:08:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:52.097 01:08:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:52.097 01:08:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:52.097 01:08:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:52.097 01:08:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:52.097 01:08:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:52.097 01:08:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:52.097 01:08:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:52.097 01:08:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:52.356 01:08:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:52.356 01:08:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:52.356 01:08:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:52.356 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:52.356 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.221 ms 00:15:52.356 00:15:52.356 --- 10.0.0.2 ping statistics --- 00:15:52.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:52.356 rtt min/avg/max/mdev = 0.221/0.221/0.221/0.000 ms 00:15:52.356 01:08:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:52.356 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:52.356 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:15:52.356 00:15:52.356 --- 10.0.0.1 ping statistics --- 00:15:52.356 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:52.356 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:15:52.356 01:08:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:52.356 01:08:42 -- nvmf/common.sh@410 -- # return 0 00:15:52.356 01:08:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:52.356 01:08:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:52.356 01:08:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:52.356 01:08:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:52.356 01:08:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:52.356 01:08:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:52.356 01:08:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:52.356 01:08:42 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:52.356 01:08:42 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:52.356 only one NIC for nvmf test 00:15:52.356 01:08:42 -- target/multipath.sh@47 -- # nvmftestfini 00:15:52.356 01:08:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:52.356 01:08:42 -- nvmf/common.sh@116 -- # sync 00:15:52.356 01:08:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:52.356 01:08:42 -- nvmf/common.sh@119 -- # set +e 00:15:52.356 01:08:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:52.356 01:08:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:52.356 rmmod nvme_tcp 00:15:52.356 rmmod nvme_fabrics 00:15:52.356 rmmod nvme_keyring 00:15:52.356 01:08:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:52.356 01:08:42 -- nvmf/common.sh@123 -- # set -e 00:15:52.356 01:08:42 -- nvmf/common.sh@124 -- # return 0 00:15:52.356 01:08:42 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:52.356 01:08:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:52.356 01:08:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:52.356 01:08:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:52.356 01:08:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:52.356 01:08:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:52.356 01:08:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:52.356 01:08:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:52.356 01:08:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:54.261 01:08:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:54.261 01:08:44 -- target/multipath.sh@48 -- # exit 0 00:15:54.261 01:08:44 -- target/multipath.sh@1 -- # nvmftestfini 00:15:54.261 01:08:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:54.261 01:08:44 -- nvmf/common.sh@116 -- # sync 00:15:54.261 01:08:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:54.261 01:08:44 -- nvmf/common.sh@119 -- # set +e 00:15:54.261 01:08:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:54.261 01:08:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:54.261 01:08:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:54.261 01:08:44 -- nvmf/common.sh@123 -- # set -e 00:15:54.261 01:08:44 -- nvmf/common.sh@124 -- # return 0 00:15:54.261 01:08:44 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:54.261 01:08:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:54.261 01:08:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:54.261 01:08:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:54.261 01:08:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:54.261 01:08:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:54.261 01:08:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:54.261 01:08:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:54.261 01:08:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:54.261 01:08:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:54.261 00:15:54.261 real 0m4.318s 00:15:54.261 user 0m0.856s 00:15:54.261 sys 0m1.448s 00:15:54.519 01:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:54.519 01:08:44 -- common/autotest_common.sh@10 -- # set +x 00:15:54.519 ************************************ 00:15:54.519 END TEST nvmf_multipath 00:15:54.519 ************************************ 00:15:54.520 01:08:44 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:54.520 01:08:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:54.520 01:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:54.520 01:08:44 -- common/autotest_common.sh@10 -- # set +x 00:15:54.520 ************************************ 00:15:54.520 START TEST nvmf_zcopy 00:15:54.520 ************************************ 00:15:54.520 01:08:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:15:54.520 * Looking for test storage... 00:15:54.520 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:54.520 01:08:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:54.520 01:08:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:54.520 01:08:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:54.520 01:08:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:54.520 01:08:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:54.520 01:08:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:54.520 01:08:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:54.520 01:08:44 -- scripts/common.sh@335 -- # IFS=.-: 00:15:54.520 01:08:44 -- scripts/common.sh@335 -- # read -ra ver1 00:15:54.520 01:08:44 -- scripts/common.sh@336 -- # IFS=.-: 00:15:54.520 01:08:44 -- scripts/common.sh@336 -- # read -ra ver2 00:15:54.520 01:08:44 -- scripts/common.sh@337 -- # local 'op=<' 00:15:54.520 01:08:44 -- scripts/common.sh@339 -- # ver1_l=2 00:15:54.520 01:08:44 -- scripts/common.sh@340 -- # ver2_l=1 00:15:54.520 01:08:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:54.520 01:08:44 -- scripts/common.sh@343 -- # case "$op" in 00:15:54.520 01:08:44 -- scripts/common.sh@344 -- # : 1 00:15:54.520 01:08:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:54.520 01:08:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:54.520 01:08:44 -- scripts/common.sh@364 -- # decimal 1 00:15:54.520 01:08:44 -- scripts/common.sh@352 -- # local d=1 00:15:54.520 01:08:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:54.520 01:08:44 -- scripts/common.sh@354 -- # echo 1 00:15:54.520 01:08:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:54.520 01:08:44 -- scripts/common.sh@365 -- # decimal 2 00:15:54.520 01:08:44 -- scripts/common.sh@352 -- # local d=2 00:15:54.520 01:08:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:54.520 01:08:44 -- scripts/common.sh@354 -- # echo 2 00:15:54.520 01:08:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:54.520 01:08:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:54.520 01:08:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:54.520 01:08:44 -- scripts/common.sh@367 -- # return 0 00:15:54.520 01:08:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:54.520 01:08:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:54.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.520 --rc genhtml_branch_coverage=1 00:15:54.520 --rc genhtml_function_coverage=1 00:15:54.520 --rc genhtml_legend=1 00:15:54.520 --rc geninfo_all_blocks=1 00:15:54.520 --rc geninfo_unexecuted_blocks=1 00:15:54.520 00:15:54.520 ' 00:15:54.520 01:08:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:54.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.520 --rc genhtml_branch_coverage=1 00:15:54.520 --rc genhtml_function_coverage=1 00:15:54.520 --rc genhtml_legend=1 00:15:54.520 --rc geninfo_all_blocks=1 00:15:54.520 --rc geninfo_unexecuted_blocks=1 00:15:54.520 00:15:54.520 ' 00:15:54.520 01:08:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:54.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.520 --rc genhtml_branch_coverage=1 00:15:54.520 --rc genhtml_function_coverage=1 00:15:54.520 --rc genhtml_legend=1 00:15:54.520 --rc geninfo_all_blocks=1 00:15:54.520 --rc geninfo_unexecuted_blocks=1 00:15:54.520 00:15:54.520 ' 00:15:54.520 01:08:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:54.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:54.520 --rc genhtml_branch_coverage=1 00:15:54.520 --rc genhtml_function_coverage=1 00:15:54.520 --rc genhtml_legend=1 00:15:54.520 --rc geninfo_all_blocks=1 00:15:54.520 --rc geninfo_unexecuted_blocks=1 00:15:54.520 00:15:54.520 ' 00:15:54.520 01:08:44 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:54.520 01:08:44 -- nvmf/common.sh@7 -- # uname -s 00:15:54.520 01:08:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:54.520 01:08:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:54.520 01:08:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:54.520 01:08:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:54.520 01:08:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:54.520 01:08:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:54.520 01:08:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:54.520 01:08:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:54.520 01:08:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:54.520 01:08:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:54.520 01:08:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:54.520 01:08:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:54.520 01:08:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:54.520 01:08:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:54.520 01:08:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:54.520 01:08:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:54.520 01:08:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:54.520 01:08:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:54.520 01:08:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:54.520 01:08:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.520 01:08:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.520 01:08:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.520 01:08:44 -- paths/export.sh@5 -- # export PATH 00:15:54.521 01:08:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:54.521 01:08:44 -- nvmf/common.sh@46 -- # : 0 00:15:54.521 01:08:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:54.521 01:08:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:54.521 01:08:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:54.521 01:08:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:54.521 01:08:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:54.521 01:08:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:54.521 01:08:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:54.521 01:08:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:54.521 01:08:44 -- target/zcopy.sh@12 -- # nvmftestinit 00:15:54.521 01:08:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:54.521 01:08:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:54.521 01:08:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:54.521 01:08:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:54.521 01:08:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:54.521 01:08:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:54.521 01:08:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:54.521 01:08:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:54.521 01:08:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:54.521 01:08:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:54.521 01:08:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:54.521 01:08:44 -- common/autotest_common.sh@10 -- # set +x 00:15:57.053 01:08:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:57.053 01:08:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:57.053 01:08:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:57.053 01:08:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:57.053 01:08:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:57.053 01:08:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:57.053 01:08:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:57.053 01:08:47 -- nvmf/common.sh@294 -- # net_devs=() 00:15:57.053 01:08:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:57.054 01:08:47 -- nvmf/common.sh@295 -- # e810=() 00:15:57.054 01:08:47 -- nvmf/common.sh@295 -- # local -ga e810 00:15:57.054 01:08:47 -- nvmf/common.sh@296 -- # x722=() 00:15:57.054 01:08:47 -- nvmf/common.sh@296 -- # local -ga x722 00:15:57.054 01:08:47 -- nvmf/common.sh@297 -- # mlx=() 00:15:57.054 01:08:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:57.054 01:08:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:57.054 01:08:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:57.054 01:08:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:57.054 01:08:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:57.054 01:08:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:57.054 01:08:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:57.054 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:57.054 01:08:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:57.054 01:08:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:57.054 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:57.054 01:08:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:57.054 01:08:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:57.054 01:08:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:57.054 01:08:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:57.054 01:08:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:57.054 01:08:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:57.054 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:57.054 01:08:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:57.054 01:08:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:57.054 01:08:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:57.054 01:08:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:57.054 01:08:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:57.054 01:08:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:57.054 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:57.054 01:08:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:57.054 01:08:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:57.054 01:08:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:57.054 01:08:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:57.054 01:08:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:57.054 01:08:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:57.054 01:08:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:57.054 01:08:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:57.054 01:08:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:57.054 01:08:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:57.054 01:08:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:57.054 01:08:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:57.054 01:08:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:57.054 01:08:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:57.054 01:08:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:57.054 01:08:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:57.054 01:08:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:57.054 01:08:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:57.054 01:08:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:57.054 01:08:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:57.054 01:08:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:57.054 01:08:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:57.054 01:08:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:57.054 01:08:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:57.054 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:57.054 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.365 ms 00:15:57.054 00:15:57.054 --- 10.0.0.2 ping statistics --- 00:15:57.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:57.054 rtt min/avg/max/mdev = 0.365/0.365/0.365/0.000 ms 00:15:57.054 01:08:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:57.054 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:57.054 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:15:57.054 00:15:57.054 --- 10.0.0.1 ping statistics --- 00:15:57.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:57.054 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:15:57.054 01:08:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:57.054 01:08:47 -- nvmf/common.sh@410 -- # return 0 00:15:57.054 01:08:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:57.054 01:08:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:57.054 01:08:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:57.054 01:08:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:57.054 01:08:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:57.054 01:08:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:57.054 01:08:47 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:15:57.054 01:08:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:57.054 01:08:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:57.054 01:08:47 -- common/autotest_common.sh@10 -- # set +x 00:15:57.054 01:08:47 -- nvmf/common.sh@469 -- # nvmfpid=1046889 00:15:57.054 01:08:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:57.054 01:08:47 -- nvmf/common.sh@470 -- # waitforlisten 1046889 00:15:57.054 01:08:47 -- common/autotest_common.sh@829 -- # '[' -z 1046889 ']' 00:15:57.054 01:08:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:57.054 01:08:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:57.054 01:08:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:57.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:57.054 01:08:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:57.054 01:08:47 -- common/autotest_common.sh@10 -- # set +x 00:15:57.054 [2024-11-26 01:08:47.279293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:57.054 [2024-11-26 01:08:47.279375] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:57.054 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.054 [2024-11-26 01:08:47.346525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:57.054 [2024-11-26 01:08:47.463354] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:57.054 [2024-11-26 01:08:47.463551] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:57.054 [2024-11-26 01:08:47.463572] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:57.054 [2024-11-26 01:08:47.463588] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:57.054 [2024-11-26 01:08:47.463620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:57.990 01:08:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:57.990 01:08:48 -- common/autotest_common.sh@862 -- # return 0 00:15:57.990 01:08:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:57.990 01:08:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 01:08:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:57.990 01:08:48 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:15:57.990 01:08:48 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:15:57.990 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 [2024-11-26 01:08:48.262915] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:57.990 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.990 01:08:48 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:57.990 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.990 01:08:48 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:57.990 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 [2024-11-26 01:08:48.279168] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:57.990 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.990 01:08:48 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:57.990 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.990 01:08:48 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:15:57.990 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 malloc0 00:15:57.990 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.990 01:08:48 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:57.990 01:08:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:57.990 01:08:48 -- common/autotest_common.sh@10 -- # set +x 00:15:57.990 01:08:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:57.990 01:08:48 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:15:57.990 01:08:48 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:15:57.990 01:08:48 -- nvmf/common.sh@520 -- # config=() 00:15:57.990 01:08:48 -- nvmf/common.sh@520 -- # local subsystem config 00:15:57.990 01:08:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:57.990 01:08:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:57.990 { 00:15:57.990 "params": { 00:15:57.990 "name": "Nvme$subsystem", 00:15:57.990 "trtype": "$TEST_TRANSPORT", 00:15:57.990 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:57.990 "adrfam": "ipv4", 00:15:57.990 "trsvcid": "$NVMF_PORT", 00:15:57.990 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:57.990 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:57.990 "hdgst": ${hdgst:-false}, 00:15:57.990 "ddgst": ${ddgst:-false} 00:15:57.990 }, 00:15:57.990 "method": "bdev_nvme_attach_controller" 00:15:57.990 } 00:15:57.990 EOF 00:15:57.990 )") 00:15:57.990 01:08:48 -- nvmf/common.sh@542 -- # cat 00:15:57.990 01:08:48 -- nvmf/common.sh@544 -- # jq . 00:15:57.990 01:08:48 -- nvmf/common.sh@545 -- # IFS=, 00:15:57.990 01:08:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:57.990 "params": { 00:15:57.990 "name": "Nvme1", 00:15:57.990 "trtype": "tcp", 00:15:57.990 "traddr": "10.0.0.2", 00:15:57.990 "adrfam": "ipv4", 00:15:57.990 "trsvcid": "4420", 00:15:57.990 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:57.990 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:57.990 "hdgst": false, 00:15:57.990 "ddgst": false 00:15:57.990 }, 00:15:57.990 "method": "bdev_nvme_attach_controller" 00:15:57.990 }' 00:15:57.990 [2024-11-26 01:08:48.357895] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:57.990 [2024-11-26 01:08:48.357974] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1047005 ] 00:15:57.990 EAL: No free 2048 kB hugepages reported on node 1 00:15:57.990 [2024-11-26 01:08:48.421215] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:58.249 [2024-11-26 01:08:48.536274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:58.507 Running I/O for 10 seconds... 00:16:08.475 00:16:08.475 Latency(us) 00:16:08.475 [2024-11-26T00:08:59.010Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:08.475 [2024-11-26T00:08:59.010Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:08.475 Verification LBA range: start 0x0 length 0x1000 00:16:08.475 Nvme1n1 : 10.01 7830.27 61.17 0.00 0.00 16303.71 1510.97 25437.68 00:16:08.475 [2024-11-26T00:08:59.010Z] =================================================================================================================== 00:16:08.475 [2024-11-26T00:08:59.010Z] Total : 7830.27 61.17 0.00 0.00 16303.71 1510.97 25437.68 00:16:08.733 01:08:59 -- target/zcopy.sh@39 -- # perfpid=1048304 00:16:08.733 01:08:59 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:08.733 01:08:59 -- common/autotest_common.sh@10 -- # set +x 00:16:08.733 01:08:59 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:08.733 01:08:59 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:08.733 01:08:59 -- nvmf/common.sh@520 -- # config=() 00:16:08.733 01:08:59 -- nvmf/common.sh@520 -- # local subsystem config 00:16:08.733 01:08:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:08.733 01:08:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:08.733 { 00:16:08.733 "params": { 00:16:08.733 "name": "Nvme$subsystem", 00:16:08.733 "trtype": "$TEST_TRANSPORT", 00:16:08.733 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:08.733 "adrfam": "ipv4", 00:16:08.733 "trsvcid": "$NVMF_PORT", 00:16:08.733 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:08.733 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:08.733 "hdgst": ${hdgst:-false}, 00:16:08.733 "ddgst": ${ddgst:-false} 00:16:08.733 }, 00:16:08.733 "method": "bdev_nvme_attach_controller" 00:16:08.733 } 00:16:08.733 EOF 00:16:08.733 )") 00:16:08.733 01:08:59 -- nvmf/common.sh@542 -- # cat 00:16:08.733 [2024-11-26 01:08:59.217872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.733 [2024-11-26 01:08:59.217922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.733 01:08:59 -- nvmf/common.sh@544 -- # jq . 00:16:08.733 01:08:59 -- nvmf/common.sh@545 -- # IFS=, 00:16:08.733 01:08:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:08.733 "params": { 00:16:08.733 "name": "Nvme1", 00:16:08.733 "trtype": "tcp", 00:16:08.733 "traddr": "10.0.0.2", 00:16:08.733 "adrfam": "ipv4", 00:16:08.733 "trsvcid": "4420", 00:16:08.733 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:08.733 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:08.733 "hdgst": false, 00:16:08.733 "ddgst": false 00:16:08.733 }, 00:16:08.733 "method": "bdev_nvme_attach_controller" 00:16:08.733 }' 00:16:08.733 [2024-11-26 01:08:59.225824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.733 [2024-11-26 01:08:59.225851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.733 [2024-11-26 01:08:59.233843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.733 [2024-11-26 01:08:59.233869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.733 [2024-11-26 01:08:59.241864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.734 [2024-11-26 01:08:59.241889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.734 [2024-11-26 01:08:59.249886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.734 [2024-11-26 01:08:59.249910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.734 [2024-11-26 01:08:59.252533] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:08.734 [2024-11-26 01:08:59.252597] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1048304 ] 00:16:08.734 [2024-11-26 01:08:59.257906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.734 [2024-11-26 01:08:59.257931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.265933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.265959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.273951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.273975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 EAL: No free 2048 kB hugepages reported on node 1 00:16:08.993 [2024-11-26 01:08:59.281973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.281998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.289995] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.290020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.298016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.298040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.306038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.306062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.314061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.314086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.314250] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:08.993 [2024-11-26 01:08:59.322122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.322160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.330134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.330173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.338130] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.338154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.346153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.346177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.354175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.354199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.362199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.362223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.370221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.370245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.378250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.378276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.386298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.386335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.394286] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.394311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.402307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.402332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.410331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.410355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.418352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.418376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.426373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.993 [2024-11-26 01:08:59.426397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.993 [2024-11-26 01:08:59.434138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:08.994 [2024-11-26 01:08:59.434395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.434419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.442417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.442441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.450463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.450496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.458496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.458532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.466516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.466567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.474542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.474581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.482564] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.482603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.490591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.490631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.498606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.498647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.506598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.506623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.514649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.514693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:08.994 [2024-11-26 01:08:59.522680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:08.994 [2024-11-26 01:08:59.522731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.530694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.530726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.538696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.538721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.546715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.546739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.554761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.554790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.562800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.562829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.570789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.570815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.578813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.578840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.586868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.586895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.594861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.594889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.602879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.602907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.610904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.610929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.618929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.618966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 Running I/O for 5 seconds... 00:16:09.253 [2024-11-26 01:08:59.626946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.626972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.641413] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.641445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.652516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.652547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.664064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.664095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.675508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.675539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.686543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.686573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.697515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.697550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.710366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.710396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.720237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.720269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.731482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.731514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.742317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.742347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.753659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.753698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.766273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.766303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.253 [2024-11-26 01:08:59.777250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.253 [2024-11-26 01:08:59.777280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.788710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.788741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.801895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.801926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.812674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.812713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.823573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.823603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.834813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.834853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.845815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.845845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.856746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.856776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.867590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.867621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.880072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.880103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.889902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.889933] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.901502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.901533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.914138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.914168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.924832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.924862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.935444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.935474] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.946027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.946059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.956907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.956938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.969468] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.969498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.979394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.979425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:08:59.990168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:08:59.990199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:09:00.001320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:09:00.001358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:09:00.013649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:09:00.013683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:09:00.027085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:09:00.027118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.512 [2024-11-26 01:09:00.036765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.512 [2024-11-26 01:09:00.036796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.771 [2024-11-26 01:09:00.047769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.771 [2024-11-26 01:09:00.047801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.771 [2024-11-26 01:09:00.060545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.771 [2024-11-26 01:09:00.060576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.771 [2024-11-26 01:09:00.070427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.771 [2024-11-26 01:09:00.070458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.771 [2024-11-26 01:09:00.081831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.771 [2024-11-26 01:09:00.081861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.771 [2024-11-26 01:09:00.092930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.771 [2024-11-26 01:09:00.092961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.771 [2024-11-26 01:09:00.103649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.103698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.114754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.114785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.127772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.127824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.138081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.138112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.149630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.149662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.160716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.160746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.172253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.172283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.183270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.183300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.195896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.195927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.205678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.205717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.216936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.216966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.227864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.227894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.238826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.238856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.249681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.249721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.260719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.260749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.273806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.273836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.284184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.284214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:09.772 [2024-11-26 01:09:00.295178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:09.772 [2024-11-26 01:09:00.295208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.308070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.308101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.318504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.318534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.329608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.329639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.342774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.342804] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.353309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.353339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.364519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.364550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.377292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.377322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.387649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.387679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.398474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.398504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.410974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.411004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.419892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.419922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.433278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.433308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.443950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.443986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.454861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.454891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.465987] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.466017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.476566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.476600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.489859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.489889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.499927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.499956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.510840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.510871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.523414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.523444] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.533677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.533721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.544778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.544808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.033 [2024-11-26 01:09:00.557537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.033 [2024-11-26 01:09:00.557578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.568325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.568358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.580307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.580342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.591367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.591397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.602456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.602486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.613331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.613361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.626104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.626134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.635702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.635732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.646870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.646900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.657776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.657806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.668150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.668179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.339 [2024-11-26 01:09:00.678747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.339 [2024-11-26 01:09:00.678777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.690092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.690123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.701171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.701201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.711950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.711979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.724602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.724632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.734974] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.735005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.746188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.746219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.758948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.758979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.768904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.768935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.780437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.780467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.791315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.791346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.802212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.802242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.814997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.815027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.824707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.824740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.340 [2024-11-26 01:09:00.837058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.340 [2024-11-26 01:09:00.837090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.848996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.849027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.859981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.860022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.870042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.870067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.881719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.881766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.893492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.893534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.904695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.904740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.915480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.915510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.928271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.928301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.938405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.938435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.949958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.950003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.963139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.963170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.973105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.973135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.984199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.984230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:00.997208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:00.997238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.007582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.007613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.018907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.018934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.029704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.029747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.040633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.040663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.053533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.053563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.063810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.063850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.074746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.074772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.085630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.085660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.096840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.096868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.109702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.109756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.119888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.119915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.131055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.131086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.621 [2024-11-26 01:09:01.143834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.621 [2024-11-26 01:09:01.143860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.154628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.154660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.165641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.165672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.178780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.178806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.189311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.189341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.199941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.199984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.211239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.211269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.222528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.222558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.235864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.235892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.246268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.246298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.257437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.257468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.270436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.270467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.279866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.279892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.291525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.291554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.304375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.304406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.314510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.314541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.325848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.325888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.336866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.336893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.347465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.347495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.881 [2024-11-26 01:09:01.358939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.881 [2024-11-26 01:09:01.358982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-26 01:09:01.369499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-26 01:09:01.369529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-26 01:09:01.380245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-26 01:09:01.380275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-26 01:09:01.390916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-26 01:09:01.390942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:10.882 [2024-11-26 01:09:01.403531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:10.882 [2024-11-26 01:09:01.403562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.414003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.414030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.424881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.424908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.435886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.435914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.446797] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.446824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.459787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.459830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.470322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.470353] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.481596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.481625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.493271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.140 [2024-11-26 01:09:01.493302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.140 [2024-11-26 01:09:01.504328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.504359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.515762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.515790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.526596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.526626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.538022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.538076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.551433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.551464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.561981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.562007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.572823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.572849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.583822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.583863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.594996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.595022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.607886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.607912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.617887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.617929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.628823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.628851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.641675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.641731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.651803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.651829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.141 [2024-11-26 01:09:01.663132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.141 [2024-11-26 01:09:01.663162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.674487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.674528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.685436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.685465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.698789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.698817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.709002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.709027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.719840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.719868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.732844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.732872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.742930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.742957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.754086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.754117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.764678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.764714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.775634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.775664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.788100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.788130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.798207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.798237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.810755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.810782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.821588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.821617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.833003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.833030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.844196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.844226] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.855116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.855146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.866039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.866069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.877409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.877439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.888558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.888589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.901313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.901343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.911573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.911602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.399 [2024-11-26 01:09:01.922231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.399 [2024-11-26 01:09:01.922270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:01.933746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:01.933778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:01.944661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:01.944712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:01.955841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:01.955871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:01.966744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:01.966774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:01.979978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:01.980020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:01.990065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:01.990095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.000918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.000947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.013733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.013762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.024264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.024294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.035269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.035299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.046184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.046214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.056886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.056916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.069639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.069670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.079805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.079835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.091555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.091585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.101924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.101954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.112871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.112901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.125183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.125213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.134491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.134521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.146114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.146144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.157279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.157309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.167997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.168027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.180596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.180627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.659 [2024-11-26 01:09:02.190419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.659 [2024-11-26 01:09:02.190449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.200960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.200992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.211661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.211701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.224460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.224490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.234517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.234547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.245566] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.245597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.258661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.258699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.268991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.269021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.279868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.279897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.292472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.292502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.302853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.302883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.313637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.313667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.326504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.326534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.336827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.336857] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.347376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.347406] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.360074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.360104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.370070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.370100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.381519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.919 [2024-11-26 01:09:02.381549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.919 [2024-11-26 01:09:02.392401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-26 01:09:02.392431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-26 01:09:02.403241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-26 01:09:02.403271] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-26 01:09:02.416680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-26 01:09:02.416728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-26 01:09:02.427046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-26 01:09:02.427077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:11.920 [2024-11-26 01:09:02.438366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:11.920 [2024-11-26 01:09:02.438397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.451416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.451448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.462071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.462101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.473297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.473327] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.485231] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.485260] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.496470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.496500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.507633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.507663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.518395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.518425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.529016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.529047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.541762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.541791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.551883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.551913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.562728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.562758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.575778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.575808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.585959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.585988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.596721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.596760] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.607913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.607944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.618812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.618842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.631478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.631508] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.641776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.641806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.652659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.652698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.665404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.665434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.675754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.675783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.687152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.687182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.697593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.697623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.180 [2024-11-26 01:09:02.708552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.180 [2024-11-26 01:09:02.708583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.721311] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.721342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.731678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.731718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.742642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.742672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.755632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.755662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.765858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.765888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.776649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.776678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.787281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.787310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.798334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.798363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.811414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.811453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.821194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.821223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.832724] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.832754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.843463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.843492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.854342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.854372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.867270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.867300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.877191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.877222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.888513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.888543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.901720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.901750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.912317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.912347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.923377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.923407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.934771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.934801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.945777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.945807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.957975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.958005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.440 [2024-11-26 01:09:02.966976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.440 [2024-11-26 01:09:02.967007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:02.978548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:02.978580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:02.989440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:02.989470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.000615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.000645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.011409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.011440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.021952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.021990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.032775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.032805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.043909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.043940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.056340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.056370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.066404] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.066435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.078003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.078033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.090677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.090721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.100819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.100850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.112046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.112077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.125254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.125284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.135743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.135773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.146673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.146714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.157747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.157777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.169087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.169117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.180450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.180480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.191514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.191547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.204056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.204087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.214453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.214483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.699 [2024-11-26 01:09:03.225343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.699 [2024-11-26 01:09:03.225373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.238196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.238235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.248039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.248069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.259653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.259682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.270295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.270325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.281647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.281677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.293930] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.293960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.304113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.304143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.315366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.315396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.328335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.328367] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.339006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.339036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.349942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.349973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.362937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.362967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.373190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.373221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.384068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.384098] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.397116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.397146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.407437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.407467] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.418354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.418384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.429682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.429724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.440362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.440391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.453165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.453195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.462582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.462612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.474129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.474159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:12.957 [2024-11-26 01:09:03.486812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:12.957 [2024-11-26 01:09:03.486842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.497129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.497159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.508301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.508330] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.520879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.520910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.530868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.530898] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.541919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.541949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.554434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.554464] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.564772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.564802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.575830] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.575861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.586491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.586521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.597184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.597214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.610502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.610533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.620957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.620987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.631983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.632013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.642931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.642961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.653546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.653576] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.666358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.666388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.216 [2024-11-26 01:09:03.676785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.216 [2024-11-26 01:09:03.676815] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.217 [2024-11-26 01:09:03.687269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.217 [2024-11-26 01:09:03.687299] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.217 [2024-11-26 01:09:03.698107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.217 [2024-11-26 01:09:03.698137] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.217 [2024-11-26 01:09:03.709243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.217 [2024-11-26 01:09:03.709273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.217 [2024-11-26 01:09:03.720595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.217 [2024-11-26 01:09:03.720624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.217 [2024-11-26 01:09:03.733073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.217 [2024-11-26 01:09:03.733103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.217 [2024-11-26 01:09:03.742600] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.217 [2024-11-26 01:09:03.742630] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.753961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.753992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.764965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.764994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.776227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.776256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.787154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.787184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.798496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.798526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.810007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.810037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.821302] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.821332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.832143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.832174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.845111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.845142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.855323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.855352] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.866447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.866477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.879157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.879187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.889807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.889837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.900593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.900623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.911657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.911694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.922631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.922661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.935174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.935204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.945713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.945743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.956898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.956929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.967318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.967348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.978425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.978455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:03.991104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:03.991133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:04.001135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:04.001165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:04.011491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:04.011521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:04.022414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:04.022443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:04.032959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:04.032989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:04.045577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:04.045606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.528 [2024-11-26 01:09:04.055805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.528 [2024-11-26 01:09:04.055836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.067709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.067740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.079128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.079159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.092169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.092200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.101978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.102007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.112878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.112908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.125785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.125816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.136088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.136119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.147194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.147225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.160058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.160089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.170069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.170100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.181087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.181118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.194241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.194272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.204779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.204810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.215613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.215644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.228648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.228680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.238969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.239010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.249809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.249840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.260513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.260543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.270990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.271019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.281963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.281993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.294986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.295028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.305459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.305489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:13.788 [2024-11-26 01:09:04.316179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:13.788 [2024-11-26 01:09:04.316209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.328758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.328789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.339236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.339265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.350126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.350156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.361484] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.361514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.372565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.372595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.385543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.385573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.395221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.395250] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.406290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.406320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.419178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.419209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.429476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.429507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.440583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.440612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.451456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.451486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.462360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.462390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.475365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.475396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.485410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.485440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.496152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.496182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.508972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.509017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.519372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.519402] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.530105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.530135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.540788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.540818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.551641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.551672] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.562660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.562700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.047 [2024-11-26 01:09:04.573283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.047 [2024-11-26 01:09:04.573313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.585447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.585479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.595136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.595166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.606441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.606472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.617407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.617439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.628452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.628482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.641082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.641111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.648715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.648748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 00:16:14.306 Latency(us) 00:16:14.306 [2024-11-26T00:09:04.841Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.306 [2024-11-26T00:09:04.841Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:14.306 Nvme1n1 : 5.01 11591.73 90.56 0.00 0.00 11028.07 4733.16 22913.33 00:16:14.306 [2024-11-26T00:09:04.841Z] =================================================================================================================== 00:16:14.306 [2024-11-26T00:09:04.841Z] Total : 11591.73 90.56 0.00 0.00 11028.07 4733.16 22913.33 00:16:14.306 [2024-11-26 01:09:04.656743] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.656771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.668777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.668809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.676843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.676914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.684865] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.684916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.692876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.692927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.700909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.700956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.708909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.708949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.716956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.717004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.724975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.725018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.732996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.733047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.741017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.741062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.749041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.749089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.757077] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.757131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.765095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.765143] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.773100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.773150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.781124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.781170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.789146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.789197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.797115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.797141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.805136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.805160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.813157] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.813182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.821177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.821201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.829206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.829233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.306 [2024-11-26 01:09:04.837293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.306 [2024-11-26 01:09:04.837345] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.845303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.845350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.853299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.853342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.861289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.861314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.869312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.869336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.877333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.877357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.885357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.885381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.893416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.893460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.901456] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.901502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.909479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.909530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.917449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.917473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.925470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.925495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 [2024-11-26 01:09:04.933499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:14.566 [2024-11-26 01:09:04.933526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:14.566 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (1048304) - No such process 00:16:14.566 01:09:04 -- target/zcopy.sh@49 -- # wait 1048304 00:16:14.566 01:09:04 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:14.566 01:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.566 01:09:04 -- common/autotest_common.sh@10 -- # set +x 00:16:14.566 01:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.566 01:09:04 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:14.566 01:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.566 01:09:04 -- common/autotest_common.sh@10 -- # set +x 00:16:14.566 delay0 00:16:14.566 01:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.566 01:09:04 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:14.566 01:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:14.566 01:09:04 -- common/autotest_common.sh@10 -- # set +x 00:16:14.566 01:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:14.566 01:09:04 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:14.566 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.566 [2024-11-26 01:09:05.055119] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:21.141 Initializing NVMe Controllers 00:16:21.141 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:21.141 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:21.141 Initialization complete. Launching workers. 00:16:21.141 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 775 00:16:21.141 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1062, failed to submit 33 00:16:21.141 success 879, unsuccess 183, failed 0 00:16:21.141 01:09:11 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:21.141 01:09:11 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:21.141 01:09:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:21.141 01:09:11 -- nvmf/common.sh@116 -- # sync 00:16:21.141 01:09:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:21.141 01:09:11 -- nvmf/common.sh@119 -- # set +e 00:16:21.141 01:09:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:21.141 01:09:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:21.141 rmmod nvme_tcp 00:16:21.141 rmmod nvme_fabrics 00:16:21.141 rmmod nvme_keyring 00:16:21.141 01:09:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:21.141 01:09:11 -- nvmf/common.sh@123 -- # set -e 00:16:21.141 01:09:11 -- nvmf/common.sh@124 -- # return 0 00:16:21.141 01:09:11 -- nvmf/common.sh@477 -- # '[' -n 1046889 ']' 00:16:21.141 01:09:11 -- nvmf/common.sh@478 -- # killprocess 1046889 00:16:21.141 01:09:11 -- common/autotest_common.sh@936 -- # '[' -z 1046889 ']' 00:16:21.141 01:09:11 -- common/autotest_common.sh@940 -- # kill -0 1046889 00:16:21.141 01:09:11 -- common/autotest_common.sh@941 -- # uname 00:16:21.141 01:09:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:21.141 01:09:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1046889 00:16:21.141 01:09:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:21.141 01:09:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:21.141 01:09:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1046889' 00:16:21.141 killing process with pid 1046889 00:16:21.141 01:09:11 -- common/autotest_common.sh@955 -- # kill 1046889 00:16:21.141 01:09:11 -- common/autotest_common.sh@960 -- # wait 1046889 00:16:21.141 01:09:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:21.141 01:09:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:21.141 01:09:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:21.141 01:09:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:21.141 01:09:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:21.141 01:09:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:21.141 01:09:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:21.141 01:09:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:23.672 01:09:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:23.672 00:16:23.672 real 0m28.866s 00:16:23.672 user 0m41.326s 00:16:23.672 sys 0m8.733s 00:16:23.672 01:09:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:23.672 01:09:13 -- common/autotest_common.sh@10 -- # set +x 00:16:23.672 ************************************ 00:16:23.672 END TEST nvmf_zcopy 00:16:23.672 ************************************ 00:16:23.672 01:09:13 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:23.672 01:09:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:23.672 01:09:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:23.672 01:09:13 -- common/autotest_common.sh@10 -- # set +x 00:16:23.672 ************************************ 00:16:23.672 START TEST nvmf_nmic 00:16:23.672 ************************************ 00:16:23.672 01:09:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:23.672 * Looking for test storage... 00:16:23.672 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:23.672 01:09:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:23.672 01:09:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:23.672 01:09:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:23.672 01:09:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:23.672 01:09:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:23.672 01:09:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:23.672 01:09:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:23.672 01:09:13 -- scripts/common.sh@335 -- # IFS=.-: 00:16:23.672 01:09:13 -- scripts/common.sh@335 -- # read -ra ver1 00:16:23.672 01:09:13 -- scripts/common.sh@336 -- # IFS=.-: 00:16:23.672 01:09:13 -- scripts/common.sh@336 -- # read -ra ver2 00:16:23.672 01:09:13 -- scripts/common.sh@337 -- # local 'op=<' 00:16:23.672 01:09:13 -- scripts/common.sh@339 -- # ver1_l=2 00:16:23.672 01:09:13 -- scripts/common.sh@340 -- # ver2_l=1 00:16:23.672 01:09:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:23.672 01:09:13 -- scripts/common.sh@343 -- # case "$op" in 00:16:23.672 01:09:13 -- scripts/common.sh@344 -- # : 1 00:16:23.672 01:09:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:23.672 01:09:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:23.672 01:09:13 -- scripts/common.sh@364 -- # decimal 1 00:16:23.672 01:09:13 -- scripts/common.sh@352 -- # local d=1 00:16:23.672 01:09:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:23.672 01:09:13 -- scripts/common.sh@354 -- # echo 1 00:16:23.672 01:09:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:23.672 01:09:13 -- scripts/common.sh@365 -- # decimal 2 00:16:23.672 01:09:13 -- scripts/common.sh@352 -- # local d=2 00:16:23.672 01:09:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:23.672 01:09:13 -- scripts/common.sh@354 -- # echo 2 00:16:23.672 01:09:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:23.672 01:09:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:23.672 01:09:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:23.672 01:09:13 -- scripts/common.sh@367 -- # return 0 00:16:23.672 01:09:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:23.672 01:09:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:23.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.672 --rc genhtml_branch_coverage=1 00:16:23.672 --rc genhtml_function_coverage=1 00:16:23.672 --rc genhtml_legend=1 00:16:23.672 --rc geninfo_all_blocks=1 00:16:23.672 --rc geninfo_unexecuted_blocks=1 00:16:23.672 00:16:23.672 ' 00:16:23.672 01:09:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:23.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.672 --rc genhtml_branch_coverage=1 00:16:23.672 --rc genhtml_function_coverage=1 00:16:23.672 --rc genhtml_legend=1 00:16:23.672 --rc geninfo_all_blocks=1 00:16:23.672 --rc geninfo_unexecuted_blocks=1 00:16:23.672 00:16:23.672 ' 00:16:23.672 01:09:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:23.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.672 --rc genhtml_branch_coverage=1 00:16:23.672 --rc genhtml_function_coverage=1 00:16:23.672 --rc genhtml_legend=1 00:16:23.672 --rc geninfo_all_blocks=1 00:16:23.672 --rc geninfo_unexecuted_blocks=1 00:16:23.672 00:16:23.672 ' 00:16:23.672 01:09:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:23.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:23.672 --rc genhtml_branch_coverage=1 00:16:23.672 --rc genhtml_function_coverage=1 00:16:23.672 --rc genhtml_legend=1 00:16:23.672 --rc geninfo_all_blocks=1 00:16:23.672 --rc geninfo_unexecuted_blocks=1 00:16:23.672 00:16:23.672 ' 00:16:23.672 01:09:13 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:23.672 01:09:13 -- nvmf/common.sh@7 -- # uname -s 00:16:23.672 01:09:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:23.672 01:09:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:23.672 01:09:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:23.672 01:09:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:23.672 01:09:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:23.672 01:09:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:23.672 01:09:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:23.672 01:09:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:23.672 01:09:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:23.672 01:09:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:23.672 01:09:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:23.672 01:09:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:23.672 01:09:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:23.672 01:09:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:23.672 01:09:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:23.672 01:09:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:23.672 01:09:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:23.672 01:09:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:23.672 01:09:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:23.672 01:09:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.673 01:09:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.673 01:09:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.673 01:09:13 -- paths/export.sh@5 -- # export PATH 00:16:23.673 01:09:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:23.673 01:09:13 -- nvmf/common.sh@46 -- # : 0 00:16:23.673 01:09:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:23.673 01:09:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:23.673 01:09:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:23.673 01:09:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:23.673 01:09:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:23.673 01:09:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:23.673 01:09:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:23.673 01:09:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:23.673 01:09:13 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:23.673 01:09:13 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:23.673 01:09:13 -- target/nmic.sh@14 -- # nvmftestinit 00:16:23.673 01:09:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:23.673 01:09:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:23.673 01:09:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:23.673 01:09:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:23.673 01:09:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:23.673 01:09:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:23.673 01:09:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:23.673 01:09:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:23.673 01:09:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:23.673 01:09:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:23.673 01:09:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:23.673 01:09:13 -- common/autotest_common.sh@10 -- # set +x 00:16:25.575 01:09:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:25.575 01:09:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:25.575 01:09:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:25.575 01:09:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:25.575 01:09:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:25.575 01:09:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:25.575 01:09:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:25.575 01:09:15 -- nvmf/common.sh@294 -- # net_devs=() 00:16:25.575 01:09:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:25.575 01:09:15 -- nvmf/common.sh@295 -- # e810=() 00:16:25.575 01:09:15 -- nvmf/common.sh@295 -- # local -ga e810 00:16:25.575 01:09:15 -- nvmf/common.sh@296 -- # x722=() 00:16:25.575 01:09:15 -- nvmf/common.sh@296 -- # local -ga x722 00:16:25.575 01:09:15 -- nvmf/common.sh@297 -- # mlx=() 00:16:25.575 01:09:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:25.575 01:09:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:25.575 01:09:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:25.575 01:09:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:25.575 01:09:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:25.575 01:09:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:25.575 01:09:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:25.575 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:25.575 01:09:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:25.575 01:09:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:25.575 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:25.575 01:09:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:25.575 01:09:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:25.575 01:09:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:25.575 01:09:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:25.575 01:09:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:25.575 01:09:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:25.575 01:09:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:25.575 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:25.575 01:09:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:25.575 01:09:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:25.576 01:09:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:25.576 01:09:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:25.576 01:09:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:25.576 01:09:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:25.576 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:25.576 01:09:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:25.576 01:09:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:25.576 01:09:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:25.576 01:09:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:25.576 01:09:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:25.576 01:09:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:25.576 01:09:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:25.576 01:09:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:25.576 01:09:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:25.576 01:09:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:25.576 01:09:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:25.576 01:09:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:25.576 01:09:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:25.576 01:09:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:25.576 01:09:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:25.576 01:09:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:25.576 01:09:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:25.576 01:09:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:25.576 01:09:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:25.576 01:09:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:25.576 01:09:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:25.576 01:09:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:25.576 01:09:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:25.834 01:09:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:25.834 01:09:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:25.834 01:09:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:25.834 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:25.834 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:16:25.834 00:16:25.834 --- 10.0.0.2 ping statistics --- 00:16:25.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:25.834 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:16:25.834 01:09:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:25.834 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:25.834 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:16:25.834 00:16:25.834 --- 10.0.0.1 ping statistics --- 00:16:25.834 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:25.834 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:16:25.834 01:09:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:25.834 01:09:16 -- nvmf/common.sh@410 -- # return 0 00:16:25.834 01:09:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:25.834 01:09:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:25.834 01:09:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:25.834 01:09:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:25.834 01:09:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:25.834 01:09:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:25.834 01:09:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:25.834 01:09:16 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:25.834 01:09:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:25.834 01:09:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:25.834 01:09:16 -- common/autotest_common.sh@10 -- # set +x 00:16:25.835 01:09:16 -- nvmf/common.sh@469 -- # nvmfpid=1052362 00:16:25.835 01:09:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:25.835 01:09:16 -- nvmf/common.sh@470 -- # waitforlisten 1052362 00:16:25.835 01:09:16 -- common/autotest_common.sh@829 -- # '[' -z 1052362 ']' 00:16:25.835 01:09:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:25.835 01:09:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:25.835 01:09:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:25.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:25.835 01:09:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:25.835 01:09:16 -- common/autotest_common.sh@10 -- # set +x 00:16:25.835 [2024-11-26 01:09:16.199452] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:25.835 [2024-11-26 01:09:16.199529] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:25.835 EAL: No free 2048 kB hugepages reported on node 1 00:16:25.835 [2024-11-26 01:09:16.268974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:26.093 [2024-11-26 01:09:16.390393] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:26.093 [2024-11-26 01:09:16.390547] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:26.093 [2024-11-26 01:09:16.390566] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:26.093 [2024-11-26 01:09:16.390581] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:26.093 [2024-11-26 01:09:16.390642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:26.093 [2024-11-26 01:09:16.390828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:26.093 [2024-11-26 01:09:16.390855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:26.093 [2024-11-26 01:09:16.390858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:26.658 01:09:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:26.658 01:09:17 -- common/autotest_common.sh@862 -- # return 0 00:16:26.658 01:09:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:26.658 01:09:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:26.658 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.658 01:09:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:26.658 01:09:17 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:26.658 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.658 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.658 [2024-11-26 01:09:17.183184] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 Malloc0 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 [2024-11-26 01:09:17.234245] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:26.917 test case1: single bdev can't be used in multiple subsystems 00:16:26.917 01:09:17 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@28 -- # nmic_status=0 00:16:26.917 01:09:17 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 [2024-11-26 01:09:17.258070] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:26.917 [2024-11-26 01:09:17.258099] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:26.917 [2024-11-26 01:09:17.258129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:26.917 request: 00:16:26.917 { 00:16:26.917 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:26.917 "namespace": { 00:16:26.917 "bdev_name": "Malloc0" 00:16:26.917 }, 00:16:26.917 "method": "nvmf_subsystem_add_ns", 00:16:26.917 "req_id": 1 00:16:26.917 } 00:16:26.917 Got JSON-RPC error response 00:16:26.917 response: 00:16:26.917 { 00:16:26.917 "code": -32602, 00:16:26.917 "message": "Invalid parameters" 00:16:26.917 } 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@29 -- # nmic_status=1 00:16:26.917 01:09:17 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:26.917 01:09:17 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:26.917 Adding namespace failed - expected result. 00:16:26.917 01:09:17 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:26.917 test case2: host connect to nvmf target in multiple paths 00:16:26.917 01:09:17 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:26.917 01:09:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:26.917 01:09:17 -- common/autotest_common.sh@10 -- # set +x 00:16:26.917 [2024-11-26 01:09:17.266206] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:26.917 01:09:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:26.917 01:09:17 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:27.483 01:09:17 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:28.050 01:09:18 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:28.050 01:09:18 -- common/autotest_common.sh@1187 -- # local i=0 00:16:28.050 01:09:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:28.050 01:09:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:28.050 01:09:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:30.576 01:09:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:30.576 01:09:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:30.576 01:09:20 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:30.576 01:09:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:30.576 01:09:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:30.576 01:09:20 -- common/autotest_common.sh@1197 -- # return 0 00:16:30.576 01:09:20 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:30.576 [global] 00:16:30.576 thread=1 00:16:30.576 invalidate=1 00:16:30.576 rw=write 00:16:30.576 time_based=1 00:16:30.576 runtime=1 00:16:30.576 ioengine=libaio 00:16:30.576 direct=1 00:16:30.576 bs=4096 00:16:30.576 iodepth=1 00:16:30.576 norandommap=0 00:16:30.576 numjobs=1 00:16:30.576 00:16:30.576 verify_dump=1 00:16:30.576 verify_backlog=512 00:16:30.576 verify_state_save=0 00:16:30.576 do_verify=1 00:16:30.576 verify=crc32c-intel 00:16:30.576 [job0] 00:16:30.576 filename=/dev/nvme0n1 00:16:30.576 Could not set queue depth (nvme0n1) 00:16:30.576 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:30.576 fio-3.35 00:16:30.576 Starting 1 thread 00:16:31.511 00:16:31.511 job0: (groupid=0, jobs=1): err= 0: pid=1053022: Tue Nov 26 01:09:21 2024 00:16:31.511 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:16:31.511 slat (nsec): min=6900, max=67564, avg=10776.51, stdev=5020.18 00:16:31.511 clat (usec): min=196, max=600, avg=254.70, stdev=41.99 00:16:31.511 lat (usec): min=203, max=620, avg=265.48, stdev=43.78 00:16:31.511 clat percentiles (usec): 00:16:31.511 | 1.00th=[ 210], 5.00th=[ 221], 10.00th=[ 225], 20.00th=[ 231], 00:16:31.511 | 30.00th=[ 237], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 253], 00:16:31.511 | 70.00th=[ 260], 80.00th=[ 269], 90.00th=[ 281], 95.00th=[ 302], 00:16:31.511 | 99.00th=[ 469], 99.50th=[ 510], 99.90th=[ 570], 99.95th=[ 594], 00:16:31.511 | 99.99th=[ 603] 00:16:31.511 write: IOPS=2167, BW=8671KiB/s (8879kB/s)(8680KiB/1001msec); 0 zone resets 00:16:31.511 slat (usec): min=8, max=30991, avg=26.90, stdev=665.04 00:16:31.511 clat (usec): min=137, max=431, avg=176.66, stdev=37.83 00:16:31.511 lat (usec): min=146, max=31237, avg=203.56, stdev=667.77 00:16:31.511 clat percentiles (usec): 00:16:31.511 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 149], 20.00th=[ 153], 00:16:31.511 | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 169], 00:16:31.511 | 70.00th=[ 178], 80.00th=[ 190], 90.00th=[ 237], 95.00th=[ 255], 00:16:31.511 | 99.00th=[ 310], 99.50th=[ 334], 99.90th=[ 388], 99.95th=[ 404], 00:16:31.511 | 99.99th=[ 433] 00:16:31.511 bw ( KiB/s): min= 8192, max= 8192, per=94.47%, avg=8192.00, stdev= 0.00, samples=1 00:16:31.511 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:31.511 lat (usec) : 250=75.53%, 500=24.21%, 750=0.26% 00:16:31.511 cpu : usr=3.50%, sys=7.00%, ctx=4221, majf=0, minf=1 00:16:31.511 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:31.511 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:31.511 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:31.511 issued rwts: total=2048,2170,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:31.511 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:31.511 00:16:31.511 Run status group 0 (all jobs): 00:16:31.511 READ: bw=8184KiB/s (8380kB/s), 8184KiB/s-8184KiB/s (8380kB/s-8380kB/s), io=8192KiB (8389kB), run=1001-1001msec 00:16:31.511 WRITE: bw=8671KiB/s (8879kB/s), 8671KiB/s-8671KiB/s (8879kB/s-8879kB/s), io=8680KiB (8888kB), run=1001-1001msec 00:16:31.511 00:16:31.511 Disk stats (read/write): 00:16:31.511 nvme0n1: ios=1768/2048, merge=0/0, ticks=980/353, in_queue=1333, util=98.90% 00:16:31.511 01:09:21 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:31.511 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:31.511 01:09:22 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:31.511 01:09:22 -- common/autotest_common.sh@1208 -- # local i=0 00:16:31.511 01:09:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:31.511 01:09:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:31.511 01:09:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:31.511 01:09:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:31.770 01:09:22 -- common/autotest_common.sh@1220 -- # return 0 00:16:31.770 01:09:22 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:31.770 01:09:22 -- target/nmic.sh@53 -- # nvmftestfini 00:16:31.770 01:09:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:31.770 01:09:22 -- nvmf/common.sh@116 -- # sync 00:16:31.770 01:09:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:31.770 01:09:22 -- nvmf/common.sh@119 -- # set +e 00:16:31.770 01:09:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:31.770 01:09:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:31.770 rmmod nvme_tcp 00:16:31.770 rmmod nvme_fabrics 00:16:31.770 rmmod nvme_keyring 00:16:31.770 01:09:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:31.770 01:09:22 -- nvmf/common.sh@123 -- # set -e 00:16:31.770 01:09:22 -- nvmf/common.sh@124 -- # return 0 00:16:31.770 01:09:22 -- nvmf/common.sh@477 -- # '[' -n 1052362 ']' 00:16:31.770 01:09:22 -- nvmf/common.sh@478 -- # killprocess 1052362 00:16:31.770 01:09:22 -- common/autotest_common.sh@936 -- # '[' -z 1052362 ']' 00:16:31.770 01:09:22 -- common/autotest_common.sh@940 -- # kill -0 1052362 00:16:31.770 01:09:22 -- common/autotest_common.sh@941 -- # uname 00:16:31.770 01:09:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:31.770 01:09:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1052362 00:16:31.770 01:09:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:31.770 01:09:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:31.770 01:09:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1052362' 00:16:31.770 killing process with pid 1052362 00:16:31.770 01:09:22 -- common/autotest_common.sh@955 -- # kill 1052362 00:16:31.770 01:09:22 -- common/autotest_common.sh@960 -- # wait 1052362 00:16:32.028 01:09:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:32.028 01:09:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:32.028 01:09:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:32.028 01:09:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:32.028 01:09:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:32.028 01:09:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:32.028 01:09:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:32.028 01:09:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:34.566 01:09:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:34.566 00:16:34.566 real 0m10.760s 00:16:34.566 user 0m25.003s 00:16:34.566 sys 0m2.531s 00:16:34.566 01:09:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:34.566 01:09:24 -- common/autotest_common.sh@10 -- # set +x 00:16:34.566 ************************************ 00:16:34.566 END TEST nvmf_nmic 00:16:34.566 ************************************ 00:16:34.566 01:09:24 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:34.566 01:09:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:34.566 01:09:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:34.566 01:09:24 -- common/autotest_common.sh@10 -- # set +x 00:16:34.566 ************************************ 00:16:34.566 START TEST nvmf_fio_target 00:16:34.566 ************************************ 00:16:34.566 01:09:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:34.566 * Looking for test storage... 00:16:34.566 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:34.566 01:09:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:34.566 01:09:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:34.566 01:09:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:34.566 01:09:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:34.566 01:09:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:34.566 01:09:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:34.566 01:09:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:34.566 01:09:24 -- scripts/common.sh@335 -- # IFS=.-: 00:16:34.566 01:09:24 -- scripts/common.sh@335 -- # read -ra ver1 00:16:34.566 01:09:24 -- scripts/common.sh@336 -- # IFS=.-: 00:16:34.566 01:09:24 -- scripts/common.sh@336 -- # read -ra ver2 00:16:34.566 01:09:24 -- scripts/common.sh@337 -- # local 'op=<' 00:16:34.566 01:09:24 -- scripts/common.sh@339 -- # ver1_l=2 00:16:34.566 01:09:24 -- scripts/common.sh@340 -- # ver2_l=1 00:16:34.566 01:09:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:34.566 01:09:24 -- scripts/common.sh@343 -- # case "$op" in 00:16:34.566 01:09:24 -- scripts/common.sh@344 -- # : 1 00:16:34.566 01:09:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:34.566 01:09:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:34.566 01:09:24 -- scripts/common.sh@364 -- # decimal 1 00:16:34.566 01:09:24 -- scripts/common.sh@352 -- # local d=1 00:16:34.566 01:09:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:34.566 01:09:24 -- scripts/common.sh@354 -- # echo 1 00:16:34.566 01:09:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:34.566 01:09:24 -- scripts/common.sh@365 -- # decimal 2 00:16:34.566 01:09:24 -- scripts/common.sh@352 -- # local d=2 00:16:34.566 01:09:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:34.566 01:09:24 -- scripts/common.sh@354 -- # echo 2 00:16:34.566 01:09:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:34.566 01:09:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:34.566 01:09:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:34.566 01:09:24 -- scripts/common.sh@367 -- # return 0 00:16:34.566 01:09:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:34.566 01:09:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:34.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:34.566 --rc genhtml_branch_coverage=1 00:16:34.566 --rc genhtml_function_coverage=1 00:16:34.566 --rc genhtml_legend=1 00:16:34.566 --rc geninfo_all_blocks=1 00:16:34.566 --rc geninfo_unexecuted_blocks=1 00:16:34.566 00:16:34.566 ' 00:16:34.566 01:09:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:34.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:34.566 --rc genhtml_branch_coverage=1 00:16:34.566 --rc genhtml_function_coverage=1 00:16:34.566 --rc genhtml_legend=1 00:16:34.566 --rc geninfo_all_blocks=1 00:16:34.566 --rc geninfo_unexecuted_blocks=1 00:16:34.566 00:16:34.566 ' 00:16:34.566 01:09:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:34.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:34.566 --rc genhtml_branch_coverage=1 00:16:34.566 --rc genhtml_function_coverage=1 00:16:34.566 --rc genhtml_legend=1 00:16:34.566 --rc geninfo_all_blocks=1 00:16:34.566 --rc geninfo_unexecuted_blocks=1 00:16:34.566 00:16:34.566 ' 00:16:34.566 01:09:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:34.566 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:34.566 --rc genhtml_branch_coverage=1 00:16:34.566 --rc genhtml_function_coverage=1 00:16:34.566 --rc genhtml_legend=1 00:16:34.566 --rc geninfo_all_blocks=1 00:16:34.566 --rc geninfo_unexecuted_blocks=1 00:16:34.566 00:16:34.566 ' 00:16:34.566 01:09:24 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:34.566 01:09:24 -- nvmf/common.sh@7 -- # uname -s 00:16:34.566 01:09:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:34.566 01:09:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:34.566 01:09:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:34.566 01:09:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:34.566 01:09:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:34.566 01:09:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:34.566 01:09:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:34.566 01:09:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:34.566 01:09:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:34.566 01:09:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:34.566 01:09:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:34.566 01:09:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:34.566 01:09:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:34.566 01:09:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:34.566 01:09:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:34.566 01:09:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:34.566 01:09:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:34.566 01:09:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:34.566 01:09:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:34.566 01:09:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.566 01:09:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.567 01:09:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.567 01:09:24 -- paths/export.sh@5 -- # export PATH 00:16:34.567 01:09:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:34.567 01:09:24 -- nvmf/common.sh@46 -- # : 0 00:16:34.567 01:09:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:34.567 01:09:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:34.567 01:09:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:34.567 01:09:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:34.567 01:09:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:34.567 01:09:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:34.567 01:09:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:34.567 01:09:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:34.567 01:09:24 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:34.567 01:09:24 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:34.567 01:09:24 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:34.567 01:09:24 -- target/fio.sh@16 -- # nvmftestinit 00:16:34.567 01:09:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:34.567 01:09:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:34.567 01:09:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:34.567 01:09:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:34.567 01:09:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:34.567 01:09:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:34.567 01:09:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:34.567 01:09:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:34.567 01:09:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:34.567 01:09:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:34.567 01:09:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:34.567 01:09:24 -- common/autotest_common.sh@10 -- # set +x 00:16:36.472 01:09:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:36.472 01:09:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:36.472 01:09:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:36.472 01:09:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:36.472 01:09:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:36.472 01:09:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:36.472 01:09:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:36.472 01:09:26 -- nvmf/common.sh@294 -- # net_devs=() 00:16:36.472 01:09:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:36.472 01:09:26 -- nvmf/common.sh@295 -- # e810=() 00:16:36.472 01:09:26 -- nvmf/common.sh@295 -- # local -ga e810 00:16:36.472 01:09:26 -- nvmf/common.sh@296 -- # x722=() 00:16:36.472 01:09:26 -- nvmf/common.sh@296 -- # local -ga x722 00:16:36.472 01:09:26 -- nvmf/common.sh@297 -- # mlx=() 00:16:36.472 01:09:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:36.472 01:09:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:36.472 01:09:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:36.472 01:09:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:36.472 01:09:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:36.472 01:09:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.472 01:09:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:36.472 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:36.472 01:09:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:36.472 01:09:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:36.472 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:36.472 01:09:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:36.472 01:09:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.472 01:09:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.472 01:09:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.472 01:09:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.472 01:09:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:36.472 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:36.472 01:09:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.472 01:09:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:36.472 01:09:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:36.472 01:09:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:36.472 01:09:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:36.472 01:09:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:36.472 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:36.472 01:09:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:36.472 01:09:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:36.472 01:09:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:36.472 01:09:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:36.472 01:09:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:36.472 01:09:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:36.472 01:09:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:36.472 01:09:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:36.472 01:09:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:36.473 01:09:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:36.473 01:09:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:36.473 01:09:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:36.473 01:09:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:36.473 01:09:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:36.473 01:09:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:36.473 01:09:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:36.473 01:09:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:36.473 01:09:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:36.473 01:09:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:36.473 01:09:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:36.473 01:09:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:36.473 01:09:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:36.473 01:09:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:36.473 01:09:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:36.473 01:09:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:36.473 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:36.473 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:16:36.473 00:16:36.473 --- 10.0.0.2 ping statistics --- 00:16:36.473 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.473 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:16:36.473 01:09:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:36.473 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:36.473 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.079 ms 00:16:36.473 00:16:36.473 --- 10.0.0.1 ping statistics --- 00:16:36.473 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:36.473 rtt min/avg/max/mdev = 0.079/0.079/0.079/0.000 ms 00:16:36.473 01:09:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:36.473 01:09:26 -- nvmf/common.sh@410 -- # return 0 00:16:36.473 01:09:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:36.473 01:09:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:36.473 01:09:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:36.473 01:09:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:36.473 01:09:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:36.473 01:09:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:36.473 01:09:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:36.473 01:09:26 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:36.473 01:09:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:36.473 01:09:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:36.473 01:09:26 -- common/autotest_common.sh@10 -- # set +x 00:16:36.473 01:09:26 -- nvmf/common.sh@469 -- # nvmfpid=1055120 00:16:36.473 01:09:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:36.473 01:09:26 -- nvmf/common.sh@470 -- # waitforlisten 1055120 00:16:36.473 01:09:26 -- common/autotest_common.sh@829 -- # '[' -z 1055120 ']' 00:16:36.473 01:09:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:36.473 01:09:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:36.473 01:09:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:36.473 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:36.473 01:09:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:36.473 01:09:26 -- common/autotest_common.sh@10 -- # set +x 00:16:36.473 [2024-11-26 01:09:26.860084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:36.473 [2024-11-26 01:09:26.860176] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:36.473 EAL: No free 2048 kB hugepages reported on node 1 00:16:36.473 [2024-11-26 01:09:26.930466] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:36.731 [2024-11-26 01:09:27.052459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:36.731 [2024-11-26 01:09:27.052639] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:36.732 [2024-11-26 01:09:27.052659] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:36.732 [2024-11-26 01:09:27.052681] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:36.732 [2024-11-26 01:09:27.052763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:36.732 [2024-11-26 01:09:27.052818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:36.732 [2024-11-26 01:09:27.052871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:36.732 [2024-11-26 01:09:27.052875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:37.297 01:09:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:37.297 01:09:27 -- common/autotest_common.sh@862 -- # return 0 00:16:37.297 01:09:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:37.297 01:09:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:37.297 01:09:27 -- common/autotest_common.sh@10 -- # set +x 00:16:37.555 01:09:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:37.555 01:09:27 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:37.812 [2024-11-26 01:09:28.093174] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:37.812 01:09:28 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:38.070 01:09:28 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:38.070 01:09:28 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:38.328 01:09:28 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:38.328 01:09:28 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:38.586 01:09:28 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:38.586 01:09:28 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:38.850 01:09:29 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:38.850 01:09:29 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:39.110 01:09:29 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:39.404 01:09:29 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:39.404 01:09:29 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:39.686 01:09:29 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:39.686 01:09:29 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:39.944 01:09:30 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:39.944 01:09:30 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:40.201 01:09:30 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:40.458 01:09:30 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:40.458 01:09:30 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:40.716 01:09:31 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:40.716 01:09:31 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:40.974 01:09:31 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:41.232 [2024-11-26 01:09:31.607127] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:41.232 01:09:31 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:41.490 01:09:31 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:41.748 01:09:32 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:42.314 01:09:32 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:42.314 01:09:32 -- common/autotest_common.sh@1187 -- # local i=0 00:16:42.314 01:09:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:42.314 01:09:32 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:42.314 01:09:32 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:42.314 01:09:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:44.214 01:09:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:44.214 01:09:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:44.214 01:09:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:44.214 01:09:34 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:44.214 01:09:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:44.214 01:09:34 -- common/autotest_common.sh@1197 -- # return 0 00:16:44.214 01:09:34 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:44.214 [global] 00:16:44.214 thread=1 00:16:44.214 invalidate=1 00:16:44.214 rw=write 00:16:44.214 time_based=1 00:16:44.214 runtime=1 00:16:44.214 ioengine=libaio 00:16:44.214 direct=1 00:16:44.214 bs=4096 00:16:44.214 iodepth=1 00:16:44.214 norandommap=0 00:16:44.214 numjobs=1 00:16:44.214 00:16:44.214 verify_dump=1 00:16:44.214 verify_backlog=512 00:16:44.214 verify_state_save=0 00:16:44.214 do_verify=1 00:16:44.214 verify=crc32c-intel 00:16:44.472 [job0] 00:16:44.472 filename=/dev/nvme0n1 00:16:44.472 [job1] 00:16:44.472 filename=/dev/nvme0n2 00:16:44.472 [job2] 00:16:44.472 filename=/dev/nvme0n3 00:16:44.472 [job3] 00:16:44.472 filename=/dev/nvme0n4 00:16:44.472 Could not set queue depth (nvme0n1) 00:16:44.472 Could not set queue depth (nvme0n2) 00:16:44.472 Could not set queue depth (nvme0n3) 00:16:44.472 Could not set queue depth (nvme0n4) 00:16:44.472 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.472 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.472 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.472 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:44.472 fio-3.35 00:16:44.472 Starting 4 threads 00:16:45.846 00:16:45.846 job0: (groupid=0, jobs=1): err= 0: pid=1056354: Tue Nov 26 01:09:36 2024 00:16:45.846 read: IOPS=538, BW=2154KiB/s (2206kB/s)(2156KiB/1001msec) 00:16:45.846 slat (nsec): min=5688, max=48353, avg=13282.20, stdev=7462.75 00:16:45.846 clat (usec): min=213, max=42002, avg=1403.24, stdev=6730.50 00:16:45.846 lat (usec): min=219, max=42036, avg=1416.53, stdev=6733.19 00:16:45.846 clat percentiles (usec): 00:16:45.846 | 1.00th=[ 221], 5.00th=[ 227], 10.00th=[ 233], 20.00th=[ 237], 00:16:45.846 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 265], 00:16:45.846 | 70.00th=[ 285], 80.00th=[ 293], 90.00th=[ 314], 95.00th=[ 343], 00:16:45.846 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:16:45.846 | 99.99th=[42206] 00:16:45.846 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:16:45.846 slat (nsec): min=8377, max=47391, avg=17758.00, stdev=4141.69 00:16:45.846 clat (usec): min=169, max=378, avg=207.06, stdev=28.50 00:16:45.846 lat (usec): min=186, max=394, avg=224.81, stdev=29.05 00:16:45.846 clat percentiles (usec): 00:16:45.846 | 1.00th=[ 172], 5.00th=[ 176], 10.00th=[ 178], 20.00th=[ 182], 00:16:45.846 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 202], 60.00th=[ 212], 00:16:45.846 | 70.00th=[ 221], 80.00th=[ 229], 90.00th=[ 243], 95.00th=[ 260], 00:16:45.846 | 99.00th=[ 289], 99.50th=[ 334], 99.90th=[ 347], 99.95th=[ 379], 00:16:45.846 | 99.99th=[ 379] 00:16:45.846 bw ( KiB/s): min= 4087, max= 4087, per=40.83%, avg=4087.00, stdev= 0.00, samples=1 00:16:45.846 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:16:45.846 lat (usec) : 250=75.56%, 500=23.42%, 750=0.06% 00:16:45.846 lat (msec) : 50=0.96% 00:16:45.846 cpu : usr=1.90%, sys=2.00%, ctx=1563, majf=0, minf=1 00:16:45.846 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.846 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 issued rwts: total=539,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.847 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.847 job1: (groupid=0, jobs=1): err= 0: pid=1056355: Tue Nov 26 01:09:36 2024 00:16:45.847 read: IOPS=19, BW=78.6KiB/s (80.5kB/s)(80.0KiB/1018msec) 00:16:45.847 slat (nsec): min=15381, max=34558, avg=26880.65, stdev=8277.66 00:16:45.847 clat (usec): min=40869, max=42267, avg=41129.86, stdev=405.67 00:16:45.847 lat (usec): min=40902, max=42283, avg=41156.74, stdev=403.42 00:16:45.847 clat percentiles (usec): 00:16:45.847 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:45.847 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:45.847 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:16:45.847 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:45.847 | 99.99th=[42206] 00:16:45.847 write: IOPS=502, BW=2012KiB/s (2060kB/s)(2048KiB/1018msec); 0 zone resets 00:16:45.847 slat (usec): min=15, max=40666, avg=148.28, stdev=2089.85 00:16:45.847 clat (usec): min=168, max=406, avg=226.42, stdev=45.40 00:16:45.847 lat (usec): min=185, max=41073, avg=374.71, stdev=2098.51 00:16:45.847 clat percentiles (usec): 00:16:45.847 | 1.00th=[ 174], 5.00th=[ 180], 10.00th=[ 182], 20.00th=[ 188], 00:16:45.847 | 30.00th=[ 194], 40.00th=[ 202], 50.00th=[ 217], 60.00th=[ 233], 00:16:45.847 | 70.00th=[ 241], 80.00th=[ 251], 90.00th=[ 285], 95.00th=[ 334], 00:16:45.847 | 99.00th=[ 363], 99.50th=[ 375], 99.90th=[ 408], 99.95th=[ 408], 00:16:45.847 | 99.99th=[ 408] 00:16:45.847 bw ( KiB/s): min= 4096, max= 4096, per=40.92%, avg=4096.00, stdev= 0.00, samples=1 00:16:45.847 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:45.847 lat (usec) : 250=75.56%, 500=20.68% 00:16:45.847 lat (msec) : 50=3.76% 00:16:45.847 cpu : usr=0.49%, sys=1.18%, ctx=535, majf=0, minf=1 00:16:45.847 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.847 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 issued rwts: total=20,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.847 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.847 job2: (groupid=0, jobs=1): err= 0: pid=1056356: Tue Nov 26 01:09:36 2024 00:16:45.847 read: IOPS=67, BW=271KiB/s (278kB/s)(276KiB/1017msec) 00:16:45.847 slat (nsec): min=12835, max=55816, avg=27989.29, stdev=9541.24 00:16:45.847 clat (usec): min=291, max=42026, avg=12871.37, stdev=18926.43 00:16:45.847 lat (usec): min=305, max=42043, avg=12899.36, stdev=18925.90 00:16:45.847 clat percentiles (usec): 00:16:45.847 | 1.00th=[ 293], 5.00th=[ 379], 10.00th=[ 396], 20.00th=[ 416], 00:16:45.847 | 30.00th=[ 429], 40.00th=[ 445], 50.00th=[ 465], 60.00th=[ 506], 00:16:45.847 | 70.00th=[40633], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:16:45.847 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:45.847 | 99.99th=[42206] 00:16:45.847 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:16:45.847 slat (nsec): min=9191, max=77895, avg=19767.05, stdev=6602.64 00:16:45.847 clat (usec): min=162, max=405, avg=221.74, stdev=42.70 00:16:45.847 lat (usec): min=178, max=423, avg=241.51, stdev=43.30 00:16:45.847 clat percentiles (usec): 00:16:45.847 | 1.00th=[ 167], 5.00th=[ 178], 10.00th=[ 182], 20.00th=[ 190], 00:16:45.847 | 30.00th=[ 196], 40.00th=[ 204], 50.00th=[ 210], 60.00th=[ 221], 00:16:45.847 | 70.00th=[ 235], 80.00th=[ 247], 90.00th=[ 265], 95.00th=[ 314], 00:16:45.847 | 99.00th=[ 388], 99.50th=[ 400], 99.90th=[ 408], 99.95th=[ 408], 00:16:45.847 | 99.99th=[ 408] 00:16:45.847 bw ( KiB/s): min= 4087, max= 4087, per=40.83%, avg=4087.00, stdev= 0.00, samples=1 00:16:45.847 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:16:45.847 lat (usec) : 250=72.29%, 500=22.89%, 750=1.20% 00:16:45.847 lat (msec) : 50=3.61% 00:16:45.847 cpu : usr=0.30%, sys=1.48%, ctx=581, majf=0, minf=1 00:16:45.847 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.847 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 issued rwts: total=69,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.847 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.847 job3: (groupid=0, jobs=1): err= 0: pid=1056357: Tue Nov 26 01:09:36 2024 00:16:45.847 read: IOPS=219, BW=880KiB/s (901kB/s)(900KiB/1023msec) 00:16:45.847 slat (nsec): min=6762, max=86400, avg=19367.63, stdev=11844.46 00:16:45.847 clat (usec): min=217, max=41984, avg=3717.42, stdev=11225.72 00:16:45.847 lat (usec): min=225, max=42004, avg=3736.79, stdev=11228.92 00:16:45.847 clat percentiles (usec): 00:16:45.847 | 1.00th=[ 219], 5.00th=[ 223], 10.00th=[ 227], 20.00th=[ 235], 00:16:45.847 | 30.00th=[ 241], 40.00th=[ 249], 50.00th=[ 265], 60.00th=[ 297], 00:16:45.847 | 70.00th=[ 343], 80.00th=[ 367], 90.00th=[ 502], 95.00th=[41157], 00:16:45.847 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:45.847 | 99.99th=[42206] 00:16:45.847 write: IOPS=500, BW=2002KiB/s (2050kB/s)(2048KiB/1023msec); 0 zone resets 00:16:45.847 slat (usec): min=16, max=40869, avg=148.21, stdev=2119.12 00:16:45.847 clat (usec): min=149, max=1762, avg=200.15, stdev=73.96 00:16:45.847 lat (usec): min=167, max=41130, avg=348.35, stdev=2123.53 00:16:45.847 clat percentiles (usec): 00:16:45.847 | 1.00th=[ 155], 5.00th=[ 163], 10.00th=[ 165], 20.00th=[ 174], 00:16:45.847 | 30.00th=[ 180], 40.00th=[ 186], 50.00th=[ 196], 60.00th=[ 204], 00:16:45.847 | 70.00th=[ 210], 80.00th=[ 219], 90.00th=[ 231], 95.00th=[ 239], 00:16:45.847 | 99.00th=[ 277], 99.50th=[ 310], 99.90th=[ 1762], 99.95th=[ 1762], 00:16:45.847 | 99.99th=[ 1762] 00:16:45.847 bw ( KiB/s): min= 4087, max= 4087, per=40.83%, avg=4087.00, stdev= 0.00, samples=1 00:16:45.847 iops : min= 1021, max= 1021, avg=1021.00, stdev= 0.00, samples=1 00:16:45.847 lat (usec) : 250=79.92%, 500=16.82%, 750=0.41% 00:16:45.847 lat (msec) : 2=0.14%, 10=0.14%, 50=2.58% 00:16:45.847 cpu : usr=0.78%, sys=1.37%, ctx=742, majf=0, minf=1 00:16:45.847 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:45.847 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:45.847 issued rwts: total=225,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:45.847 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:45.847 00:16:45.847 Run status group 0 (all jobs): 00:16:45.847 READ: bw=3335KiB/s (3415kB/s), 78.6KiB/s-2154KiB/s (80.5kB/s-2206kB/s), io=3412KiB (3494kB), run=1001-1023msec 00:16:45.847 WRITE: bw=9.77MiB/s (10.2MB/s), 2002KiB/s-4092KiB/s (2050kB/s-4190kB/s), io=10.0MiB (10.5MB), run=1001-1023msec 00:16:45.847 00:16:45.847 Disk stats (read/write): 00:16:45.847 nvme0n1: ios=302/512, merge=0/0, ticks=706/103, in_queue=809, util=82.67% 00:16:45.847 nvme0n2: ios=37/512, merge=0/0, ticks=1482/109, in_queue=1591, util=91.04% 00:16:45.847 nvme0n3: ios=121/512, merge=0/0, ticks=754/112, in_queue=866, util=90.46% 00:16:45.847 nvme0n4: ios=41/512, merge=0/0, ticks=1490/102, in_queue=1592, util=99.89% 00:16:45.847 01:09:36 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:45.847 [global] 00:16:45.847 thread=1 00:16:45.847 invalidate=1 00:16:45.847 rw=randwrite 00:16:45.847 time_based=1 00:16:45.847 runtime=1 00:16:45.847 ioengine=libaio 00:16:45.847 direct=1 00:16:45.847 bs=4096 00:16:45.847 iodepth=1 00:16:45.847 norandommap=0 00:16:45.847 numjobs=1 00:16:45.847 00:16:45.847 verify_dump=1 00:16:45.847 verify_backlog=512 00:16:45.847 verify_state_save=0 00:16:45.847 do_verify=1 00:16:45.847 verify=crc32c-intel 00:16:45.847 [job0] 00:16:45.847 filename=/dev/nvme0n1 00:16:45.847 [job1] 00:16:45.847 filename=/dev/nvme0n2 00:16:45.847 [job2] 00:16:45.847 filename=/dev/nvme0n3 00:16:45.847 [job3] 00:16:45.847 filename=/dev/nvme0n4 00:16:45.847 Could not set queue depth (nvme0n1) 00:16:45.847 Could not set queue depth (nvme0n2) 00:16:45.847 Could not set queue depth (nvme0n3) 00:16:45.847 Could not set queue depth (nvme0n4) 00:16:46.106 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.106 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.106 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.106 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:46.106 fio-3.35 00:16:46.106 Starting 4 threads 00:16:47.481 00:16:47.481 job0: (groupid=0, jobs=1): err= 0: pid=1056587: Tue Nov 26 01:09:37 2024 00:16:47.481 read: IOPS=20, BW=83.0KiB/s (85.0kB/s)(84.0KiB/1012msec) 00:16:47.481 slat (nsec): min=8340, max=37919, avg=24322.48, stdev=11010.45 00:16:47.481 clat (usec): min=40339, max=42008, avg=41381.05, stdev=529.01 00:16:47.481 lat (usec): min=40352, max=42023, avg=41405.37, stdev=530.32 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[40109], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:16:47.481 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41681], 00:16:47.481 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:16:47.481 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:47.481 | 99.99th=[42206] 00:16:47.481 write: IOPS=505, BW=2024KiB/s (2072kB/s)(2048KiB/1012msec); 0 zone resets 00:16:47.481 slat (nsec): min=9275, max=71657, avg=20233.17, stdev=9089.79 00:16:47.481 clat (usec): min=172, max=430, avg=248.60, stdev=49.29 00:16:47.481 lat (usec): min=182, max=465, avg=268.84, stdev=51.59 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 184], 5.00th=[ 198], 10.00th=[ 206], 20.00th=[ 215], 00:16:47.481 | 30.00th=[ 221], 40.00th=[ 227], 50.00th=[ 235], 60.00th=[ 243], 00:16:47.481 | 70.00th=[ 255], 80.00th=[ 273], 90.00th=[ 326], 95.00th=[ 363], 00:16:47.481 | 99.00th=[ 412], 99.50th=[ 424], 99.90th=[ 433], 99.95th=[ 433], 00:16:47.481 | 99.99th=[ 433] 00:16:47.481 bw ( KiB/s): min= 4096, max= 4096, per=28.83%, avg=4096.00, stdev= 0.00, samples=1 00:16:47.481 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:47.481 lat (usec) : 250=63.41%, 500=32.65% 00:16:47.481 lat (msec) : 50=3.94% 00:16:47.481 cpu : usr=0.69%, sys=1.38%, ctx=535, majf=0, minf=1 00:16:47.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 issued rwts: total=21,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.481 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.481 job1: (groupid=0, jobs=1): err= 0: pid=1056588: Tue Nov 26 01:09:37 2024 00:16:47.481 read: IOPS=507, BW=2029KiB/s (2078kB/s)(2112KiB/1041msec) 00:16:47.481 slat (nsec): min=4046, max=51522, avg=13696.54, stdev=7089.55 00:16:47.481 clat (usec): min=178, max=42017, avg=1491.44, stdev=7000.22 00:16:47.481 lat (usec): min=183, max=42034, avg=1505.14, stdev=7002.57 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 215], 20.00th=[ 225], 00:16:47.481 | 30.00th=[ 231], 40.00th=[ 235], 50.00th=[ 237], 60.00th=[ 241], 00:16:47.481 | 70.00th=[ 247], 80.00th=[ 260], 90.00th=[ 322], 95.00th=[ 420], 00:16:47.481 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:47.481 | 99.99th=[42206] 00:16:47.481 write: IOPS=983, BW=3935KiB/s (4029kB/s)(4096KiB/1041msec); 0 zone resets 00:16:47.481 slat (nsec): min=5427, max=54063, avg=12429.12, stdev=6536.73 00:16:47.481 clat (usec): min=133, max=423, avg=220.93, stdev=38.34 00:16:47.481 lat (usec): min=138, max=431, avg=233.36, stdev=40.08 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 161], 5.00th=[ 167], 10.00th=[ 174], 20.00th=[ 182], 00:16:47.481 | 30.00th=[ 194], 40.00th=[ 210], 50.00th=[ 225], 60.00th=[ 235], 00:16:47.481 | 70.00th=[ 243], 80.00th=[ 249], 90.00th=[ 262], 95.00th=[ 277], 00:16:47.481 | 99.00th=[ 326], 99.50th=[ 388], 99.90th=[ 404], 99.95th=[ 424], 00:16:47.481 | 99.99th=[ 424] 00:16:47.481 bw ( KiB/s): min= 8192, max= 8192, per=57.67%, avg=8192.00, stdev= 0.00, samples=1 00:16:47.481 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:47.481 lat (usec) : 250=77.84%, 500=20.88%, 750=0.19% 00:16:47.481 lat (msec) : 10=0.06%, 50=1.03% 00:16:47.481 cpu : usr=1.25%, sys=2.79%, ctx=1552, majf=0, minf=2 00:16:47.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 issued rwts: total=528,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.481 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.481 job2: (groupid=0, jobs=1): err= 0: pid=1056589: Tue Nov 26 01:09:37 2024 00:16:47.481 read: IOPS=182, BW=731KiB/s (749kB/s)(760KiB/1039msec) 00:16:47.481 slat (nsec): min=5452, max=35581, avg=9169.98, stdev=6915.93 00:16:47.481 clat (usec): min=202, max=42171, avg=4788.79, stdev=12969.37 00:16:47.481 lat (usec): min=208, max=42189, avg=4797.96, stdev=12974.47 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 204], 5.00th=[ 210], 10.00th=[ 215], 20.00th=[ 219], 00:16:47.481 | 30.00th=[ 221], 40.00th=[ 225], 50.00th=[ 229], 60.00th=[ 233], 00:16:47.481 | 70.00th=[ 237], 80.00th=[ 249], 90.00th=[40633], 95.00th=[41681], 00:16:47.481 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:47.481 | 99.99th=[42206] 00:16:47.481 write: IOPS=492, BW=1971KiB/s (2018kB/s)(2048KiB/1039msec); 0 zone resets 00:16:47.481 slat (nsec): min=9166, max=43710, avg=18187.93, stdev=6567.66 00:16:47.481 clat (usec): min=181, max=273, avg=221.48, stdev=15.83 00:16:47.481 lat (usec): min=191, max=309, avg=239.67, stdev=17.50 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 190], 5.00th=[ 198], 10.00th=[ 202], 20.00th=[ 208], 00:16:47.481 | 30.00th=[ 212], 40.00th=[ 217], 50.00th=[ 221], 60.00th=[ 225], 00:16:47.481 | 70.00th=[ 229], 80.00th=[ 235], 90.00th=[ 243], 95.00th=[ 249], 00:16:47.481 | 99.00th=[ 265], 99.50th=[ 265], 99.90th=[ 273], 99.95th=[ 273], 00:16:47.481 | 99.99th=[ 273] 00:16:47.481 bw ( KiB/s): min= 4096, max= 4096, per=28.83%, avg=4096.00, stdev= 0.00, samples=1 00:16:47.481 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:47.481 lat (usec) : 250=91.88%, 500=5.13% 00:16:47.481 lat (msec) : 50=2.99% 00:16:47.481 cpu : usr=0.48%, sys=1.45%, ctx=704, majf=0, minf=1 00:16:47.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 issued rwts: total=190,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.481 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.481 job3: (groupid=0, jobs=1): err= 0: pid=1056590: Tue Nov 26 01:09:37 2024 00:16:47.481 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:47.481 slat (nsec): min=5553, max=56979, avg=15079.64, stdev=5815.77 00:16:47.481 clat (usec): min=223, max=41821, avg=388.07, stdev=1481.07 00:16:47.481 lat (usec): min=229, max=41838, avg=403.15, stdev=1481.13 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 233], 5.00th=[ 243], 10.00th=[ 255], 20.00th=[ 269], 00:16:47.481 | 30.00th=[ 273], 40.00th=[ 277], 50.00th=[ 285], 60.00th=[ 289], 00:16:47.481 | 70.00th=[ 383], 80.00th=[ 433], 90.00th=[ 482], 95.00th=[ 515], 00:16:47.481 | 99.00th=[ 660], 99.50th=[ 668], 99.90th=[40633], 99.95th=[41681], 00:16:47.481 | 99.99th=[41681] 00:16:47.481 write: IOPS=1647, BW=6589KiB/s (6748kB/s)(6596KiB/1001msec); 0 zone resets 00:16:47.481 slat (nsec): min=8516, max=54290, avg=16777.69, stdev=6692.86 00:16:47.481 clat (usec): min=145, max=889, avg=204.52, stdev=40.19 00:16:47.481 lat (usec): min=155, max=911, avg=221.30, stdev=42.63 00:16:47.481 clat percentiles (usec): 00:16:47.481 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 165], 20.00th=[ 178], 00:16:47.481 | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 198], 60.00th=[ 208], 00:16:47.481 | 70.00th=[ 219], 80.00th=[ 229], 90.00th=[ 243], 95.00th=[ 262], 00:16:47.481 | 99.00th=[ 306], 99.50th=[ 359], 99.90th=[ 668], 99.95th=[ 889], 00:16:47.481 | 99.99th=[ 889] 00:16:47.481 bw ( KiB/s): min= 7776, max= 7776, per=54.74%, avg=7776.00, stdev= 0.00, samples=1 00:16:47.481 iops : min= 1944, max= 1944, avg=1944.00, stdev= 0.00, samples=1 00:16:47.481 lat (usec) : 250=51.87%, 500=44.68%, 750=3.30%, 1000=0.06% 00:16:47.481 lat (msec) : 2=0.03%, 50=0.06% 00:16:47.481 cpu : usr=4.10%, sys=6.80%, ctx=3185, majf=0, minf=2 00:16:47.481 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:47.481 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.481 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:47.482 issued rwts: total=1536,1649,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:47.482 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:47.482 00:16:47.482 Run status group 0 (all jobs): 00:16:47.482 READ: bw=8742KiB/s (8951kB/s), 83.0KiB/s-6138KiB/s (85.0kB/s-6285kB/s), io=9100KiB (9318kB), run=1001-1041msec 00:16:47.482 WRITE: bw=13.9MiB/s (14.5MB/s), 1971KiB/s-6589KiB/s (2018kB/s-6748kB/s), io=14.4MiB (15.1MB), run=1001-1041msec 00:16:47.482 00:16:47.482 Disk stats (read/write): 00:16:47.482 nvme0n1: ios=57/512, merge=0/0, ticks=1711/102, in_queue=1813, util=99.10% 00:16:47.482 nvme0n2: ios=538/1024, merge=0/0, ticks=749/224, in_queue=973, util=91.27% 00:16:47.482 nvme0n3: ios=234/512, merge=0/0, ticks=1763/118, in_queue=1881, util=96.77% 00:16:47.482 nvme0n4: ios=1155/1536, merge=0/0, ticks=822/310, in_queue=1132, util=95.70% 00:16:47.482 01:09:37 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:47.482 [global] 00:16:47.482 thread=1 00:16:47.482 invalidate=1 00:16:47.482 rw=write 00:16:47.482 time_based=1 00:16:47.482 runtime=1 00:16:47.482 ioengine=libaio 00:16:47.482 direct=1 00:16:47.482 bs=4096 00:16:47.482 iodepth=128 00:16:47.482 norandommap=0 00:16:47.482 numjobs=1 00:16:47.482 00:16:47.482 verify_dump=1 00:16:47.482 verify_backlog=512 00:16:47.482 verify_state_save=0 00:16:47.482 do_verify=1 00:16:47.482 verify=crc32c-intel 00:16:47.482 [job0] 00:16:47.482 filename=/dev/nvme0n1 00:16:47.482 [job1] 00:16:47.482 filename=/dev/nvme0n2 00:16:47.482 [job2] 00:16:47.482 filename=/dev/nvme0n3 00:16:47.482 [job3] 00:16:47.482 filename=/dev/nvme0n4 00:16:47.482 Could not set queue depth (nvme0n1) 00:16:47.482 Could not set queue depth (nvme0n2) 00:16:47.482 Could not set queue depth (nvme0n3) 00:16:47.482 Could not set queue depth (nvme0n4) 00:16:47.482 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:47.482 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:47.482 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:47.482 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:47.482 fio-3.35 00:16:47.482 Starting 4 threads 00:16:48.864 00:16:48.864 job0: (groupid=0, jobs=1): err= 0: pid=1056820: Tue Nov 26 01:09:39 2024 00:16:48.864 read: IOPS=3548, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1010msec) 00:16:48.864 slat (usec): min=2, max=48361, avg=155.75, stdev=1366.69 00:16:48.864 clat (usec): min=1996, max=100147, avg=18247.63, stdev=17273.76 00:16:48.864 lat (msec): min=2, max=100, avg=18.40, stdev=17.41 00:16:48.864 clat percentiles (msec): 00:16:48.864 | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 10], 00:16:48.864 | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], 00:16:48.864 | 70.00th=[ 19], 80.00th=[ 20], 90.00th=[ 38], 95.00th=[ 51], 00:16:48.865 | 99.00th=[ 101], 99.50th=[ 101], 99.90th=[ 101], 99.95th=[ 101], 00:16:48.865 | 99.99th=[ 101] 00:16:48.865 write: IOPS=3633, BW=14.2MiB/s (14.9MB/s)(14.3MiB/1010msec); 0 zone resets 00:16:48.865 slat (usec): min=3, max=26030, avg=107.97, stdev=993.80 00:16:48.865 clat (usec): min=213, max=96679, avg=17035.95, stdev=16455.74 00:16:48.865 lat (usec): min=254, max=96684, avg=17143.92, stdev=16521.78 00:16:48.865 clat percentiles (usec): 00:16:48.865 | 1.00th=[ 1139], 5.00th=[ 1532], 10.00th=[ 4752], 20.00th=[ 7635], 00:16:48.865 | 30.00th=[ 9372], 40.00th=[10159], 50.00th=[11469], 60.00th=[12649], 00:16:48.865 | 70.00th=[14353], 80.00th=[22676], 90.00th=[38011], 95.00th=[57934], 00:16:48.865 | 99.00th=[74974], 99.50th=[96994], 99.90th=[96994], 99.95th=[96994], 00:16:48.865 | 99.99th=[96994] 00:16:48.865 bw ( KiB/s): min=11784, max=16888, per=25.37%, avg=14336.00, stdev=3609.07, samples=2 00:16:48.865 iops : min= 2946, max= 4222, avg=3584.00, stdev=902.27, samples=2 00:16:48.865 lat (usec) : 250=0.01%, 500=0.06%, 750=0.21%, 1000=0.18% 00:16:48.865 lat (msec) : 2=2.66%, 4=2.07%, 10=28.84%, 20=46.47%, 50=12.52% 00:16:48.865 lat (msec) : 100=6.64%, 250=0.34% 00:16:48.865 cpu : usr=2.78%, sys=5.65%, ctx=295, majf=0, minf=2 00:16:48.865 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:48.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.865 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.865 issued rwts: total=3584,3670,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.865 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.865 job1: (groupid=0, jobs=1): err= 0: pid=1056821: Tue Nov 26 01:09:39 2024 00:16:48.865 read: IOPS=2544, BW=9.94MiB/s (10.4MB/s)(10.1MiB/1018msec) 00:16:48.865 slat (usec): min=3, max=17436, avg=174.41, stdev=1226.08 00:16:48.865 clat (usec): min=6442, max=51891, avg=21773.05, stdev=6722.75 00:16:48.865 lat (usec): min=6449, max=51932, avg=21947.47, stdev=6811.74 00:16:48.865 clat percentiles (usec): 00:16:48.865 | 1.00th=[11994], 5.00th=[13960], 10.00th=[14615], 20.00th=[17957], 00:16:48.865 | 30.00th=[18482], 40.00th=[19006], 50.00th=[19530], 60.00th=[20841], 00:16:48.865 | 70.00th=[21890], 80.00th=[28181], 90.00th=[34341], 95.00th=[35390], 00:16:48.865 | 99.00th=[38011], 99.50th=[40633], 99.90th=[47973], 99.95th=[51119], 00:16:48.865 | 99.99th=[51643] 00:16:48.865 write: IOPS=3017, BW=11.8MiB/s (12.4MB/s)(12.0MiB/1018msec); 0 zone resets 00:16:48.865 slat (usec): min=4, max=38391, avg=168.98, stdev=1216.14 00:16:48.865 clat (usec): min=3063, max=87206, avg=22934.96, stdev=12611.55 00:16:48.865 lat (usec): min=3070, max=87231, avg=23103.94, stdev=12718.04 00:16:48.865 clat percentiles (usec): 00:16:48.865 | 1.00th=[ 6390], 5.00th=[10683], 10.00th=[11338], 20.00th=[14091], 00:16:48.865 | 30.00th=[19006], 40.00th=[20055], 50.00th=[20841], 60.00th=[21365], 00:16:48.865 | 70.00th=[21627], 80.00th=[24511], 90.00th=[39584], 95.00th=[53216], 00:16:48.865 | 99.00th=[71828], 99.50th=[79168], 99.90th=[87557], 99.95th=[87557], 00:16:48.865 | 99.99th=[87557] 00:16:48.865 bw ( KiB/s): min=11504, max=12288, per=21.05%, avg=11896.00, stdev=554.37, samples=2 00:16:48.866 iops : min= 2876, max= 3072, avg=2974.00, stdev=138.59, samples=2 00:16:48.866 lat (msec) : 4=0.11%, 10=2.12%, 20=44.79%, 50=49.82%, 100=3.16% 00:16:48.866 cpu : usr=3.74%, sys=6.19%, ctx=252, majf=0, minf=1 00:16:48.866 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:16:48.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.866 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.866 issued rwts: total=2590,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.866 job2: (groupid=0, jobs=1): err= 0: pid=1056822: Tue Nov 26 01:09:39 2024 00:16:48.866 read: IOPS=4523, BW=17.7MiB/s (18.5MB/s)(18.0MiB/1021msec) 00:16:48.866 slat (usec): min=2, max=9905, avg=99.17, stdev=680.80 00:16:48.866 clat (usec): min=322, max=40119, avg=12867.63, stdev=4732.53 00:16:48.866 lat (usec): min=359, max=40132, avg=12966.80, stdev=4780.93 00:16:48.866 clat percentiles (usec): 00:16:48.866 | 1.00th=[ 5604], 5.00th=[ 8717], 10.00th=[ 9634], 20.00th=[10421], 00:16:48.866 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11731], 60.00th=[11994], 00:16:48.866 | 70.00th=[12387], 80.00th=[13829], 90.00th=[17957], 95.00th=[22414], 00:16:48.866 | 99.00th=[31589], 99.50th=[33817], 99.90th=[40109], 99.95th=[40109], 00:16:48.866 | 99.99th=[40109] 00:16:48.866 write: IOPS=5014, BW=19.6MiB/s (20.5MB/s)(20.0MiB/1021msec); 0 zone resets 00:16:48.866 slat (usec): min=3, max=10180, avg=89.77, stdev=551.90 00:16:48.866 clat (usec): min=4655, max=48346, avg=13511.08, stdev=4673.62 00:16:48.866 lat (usec): min=4668, max=48351, avg=13600.85, stdev=4709.16 00:16:48.866 clat percentiles (usec): 00:16:48.866 | 1.00th=[ 6325], 5.00th=[ 8291], 10.00th=[ 8979], 20.00th=[10814], 00:16:48.866 | 30.00th=[11076], 40.00th=[11731], 50.00th=[12256], 60.00th=[12649], 00:16:48.866 | 70.00th=[13698], 80.00th=[16581], 90.00th=[19268], 95.00th=[22414], 00:16:48.866 | 99.00th=[32375], 99.50th=[32900], 99.90th=[35914], 99.95th=[35914], 00:16:48.866 | 99.99th=[48497] 00:16:48.866 bw ( KiB/s): min=19224, max=20792, per=35.41%, avg=20008.00, stdev=1108.74, samples=2 00:16:48.866 iops : min= 4806, max= 5198, avg=5002.00, stdev=277.19, samples=2 00:16:48.866 lat (usec) : 500=0.01% 00:16:48.866 lat (msec) : 2=0.31%, 4=0.13%, 10=11.92%, 20=80.37%, 50=7.26% 00:16:48.866 cpu : usr=3.63%, sys=7.25%, ctx=451, majf=0, minf=1 00:16:48.866 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:48.866 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.866 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.866 issued rwts: total=4618,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.866 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.866 job3: (groupid=0, jobs=1): err= 0: pid=1056823: Tue Nov 26 01:09:39 2024 00:16:48.866 read: IOPS=2132, BW=8530KiB/s (8734kB/s)(8632KiB/1012msec) 00:16:48.866 slat (usec): min=3, max=27087, avg=206.52, stdev=1485.83 00:16:48.866 clat (usec): min=6872, max=73629, avg=24832.80, stdev=9723.54 00:16:48.866 lat (usec): min=6880, max=79099, avg=25039.32, stdev=9891.89 00:16:48.866 clat percentiles (usec): 00:16:48.867 | 1.00th=[14091], 5.00th=[17957], 10.00th=[18220], 20.00th=[19006], 00:16:48.867 | 30.00th=[19006], 40.00th=[20055], 50.00th=[20841], 60.00th=[21627], 00:16:48.867 | 70.00th=[24773], 80.00th=[30278], 90.00th=[39060], 95.00th=[44303], 00:16:48.867 | 99.00th=[58983], 99.50th=[66323], 99.90th=[73925], 99.95th=[73925], 00:16:48.867 | 99.99th=[73925] 00:16:48.867 write: IOPS=2529, BW=9.88MiB/s (10.4MB/s)(10.0MiB/1012msec); 0 zone resets 00:16:48.867 slat (usec): min=4, max=31474, avg=205.81, stdev=1370.70 00:16:48.867 clat (msec): min=3, max=122, avg=28.66, stdev=20.69 00:16:48.867 lat (msec): min=3, max=122, avg=28.87, stdev=20.81 00:16:48.867 clat percentiles (msec): 00:16:48.867 | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 15], 20.00th=[ 19], 00:16:48.867 | 30.00th=[ 21], 40.00th=[ 21], 50.00th=[ 22], 60.00th=[ 24], 00:16:48.867 | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 58], 95.00th=[ 75], 00:16:48.867 | 99.00th=[ 120], 99.50th=[ 122], 99.90th=[ 123], 99.95th=[ 123], 00:16:48.867 | 99.99th=[ 123] 00:16:48.867 bw ( KiB/s): min= 8048, max=12288, per=18.00%, avg=10168.00, stdev=2998.13, samples=2 00:16:48.867 iops : min= 2012, max= 3072, avg=2542.00, stdev=749.53, samples=2 00:16:48.867 lat (msec) : 4=0.13%, 10=3.20%, 20=29.76%, 50=59.24%, 100=6.34% 00:16:48.867 lat (msec) : 250=1.34% 00:16:48.867 cpu : usr=3.46%, sys=4.95%, ctx=245, majf=0, minf=1 00:16:48.867 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:16:48.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:48.867 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:48.867 issued rwts: total=2158,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:48.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:48.867 00:16:48.867 Run status group 0 (all jobs): 00:16:48.867 READ: bw=49.5MiB/s (52.0MB/s), 8530KiB/s-17.7MiB/s (8734kB/s-18.5MB/s), io=50.6MiB (53.0MB), run=1010-1021msec 00:16:48.867 WRITE: bw=55.2MiB/s (57.9MB/s), 9.88MiB/s-19.6MiB/s (10.4MB/s-20.5MB/s), io=56.3MiB (59.1MB), run=1010-1021msec 00:16:48.867 00:16:48.867 Disk stats (read/write): 00:16:48.867 nvme0n1: ios=2578/2567, merge=0/0, ticks=30312/24119, in_queue=54431, util=86.57% 00:16:48.867 nvme0n2: ios=2534/2560, merge=0/0, ticks=53918/48019, in_queue=101937, util=97.76% 00:16:48.867 nvme0n3: ios=4144/4248, merge=0/0, ticks=34957/37500, in_queue=72457, util=100.00% 00:16:48.867 nvme0n4: ios=2086/2127, merge=0/0, ticks=47388/46240, in_queue=93628, util=100.00% 00:16:48.867 01:09:39 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:48.867 [global] 00:16:48.867 thread=1 00:16:48.867 invalidate=1 00:16:48.867 rw=randwrite 00:16:48.867 time_based=1 00:16:48.867 runtime=1 00:16:48.867 ioengine=libaio 00:16:48.867 direct=1 00:16:48.867 bs=4096 00:16:48.867 iodepth=128 00:16:48.867 norandommap=0 00:16:48.867 numjobs=1 00:16:48.867 00:16:48.867 verify_dump=1 00:16:48.868 verify_backlog=512 00:16:48.868 verify_state_save=0 00:16:48.868 do_verify=1 00:16:48.868 verify=crc32c-intel 00:16:48.868 [job0] 00:16:48.868 filename=/dev/nvme0n1 00:16:48.868 [job1] 00:16:48.868 filename=/dev/nvme0n2 00:16:48.868 [job2] 00:16:48.868 filename=/dev/nvme0n3 00:16:48.868 [job3] 00:16:48.868 filename=/dev/nvme0n4 00:16:48.868 Could not set queue depth (nvme0n1) 00:16:48.868 Could not set queue depth (nvme0n2) 00:16:48.868 Could not set queue depth (nvme0n3) 00:16:48.868 Could not set queue depth (nvme0n4) 00:16:49.130 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.130 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.130 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.130 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:49.130 fio-3.35 00:16:49.130 Starting 4 threads 00:16:50.506 00:16:50.506 job0: (groupid=0, jobs=1): err= 0: pid=1057180: Tue Nov 26 01:09:40 2024 00:16:50.506 read: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec) 00:16:50.506 slat (usec): min=2, max=14848, avg=88.88, stdev=716.20 00:16:50.506 clat (usec): min=1839, max=38882, avg=12305.13, stdev=5559.87 00:16:50.506 lat (usec): min=1843, max=38896, avg=12394.01, stdev=5604.43 00:16:50.506 clat percentiles (usec): 00:16:50.506 | 1.00th=[ 2573], 5.00th=[ 6390], 10.00th=[ 7898], 20.00th=[ 8848], 00:16:50.506 | 30.00th=[ 9372], 40.00th=[ 9765], 50.00th=[10814], 60.00th=[11731], 00:16:50.506 | 70.00th=[13304], 80.00th=[15533], 90.00th=[18482], 95.00th=[24773], 00:16:50.506 | 99.00th=[34341], 99.50th=[36439], 99.90th=[36439], 99.95th=[36439], 00:16:50.506 | 99.99th=[39060] 00:16:50.506 write: IOPS=4710, BW=18.4MiB/s (19.3MB/s)(18.5MiB/1006msec); 0 zone resets 00:16:50.506 slat (usec): min=3, max=9607, avg=100.70, stdev=508.30 00:16:50.506 clat (usec): min=467, max=74589, avg=14953.96, stdev=10601.93 00:16:50.506 lat (usec): min=482, max=74597, avg=15054.66, stdev=10653.96 00:16:50.506 clat percentiles (usec): 00:16:50.506 | 1.00th=[ 1336], 5.00th=[ 3556], 10.00th=[ 7439], 20.00th=[ 9765], 00:16:50.506 | 30.00th=[10290], 40.00th=[10683], 50.00th=[10814], 60.00th=[11600], 00:16:50.506 | 70.00th=[14222], 80.00th=[19530], 90.00th=[33162], 95.00th=[40633], 00:16:50.506 | 99.00th=[49546], 99.50th=[55313], 99.90th=[74974], 99.95th=[74974], 00:16:50.506 | 99.99th=[74974] 00:16:50.506 bw ( KiB/s): min=15728, max=21168, per=27.73%, avg=18448.00, stdev=3846.66, samples=2 00:16:50.506 iops : min= 3932, max= 5292, avg=4612.00, stdev=961.67, samples=2 00:16:50.506 lat (usec) : 500=0.01%, 750=0.05%, 1000=0.15% 00:16:50.506 lat (msec) : 2=0.96%, 4=3.09%, 10=30.08%, 20=51.83%, 50=13.43% 00:16:50.506 lat (msec) : 100=0.39% 00:16:50.506 cpu : usr=4.08%, sys=8.26%, ctx=583, majf=0, minf=1 00:16:50.506 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:50.506 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.506 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.506 issued rwts: total=4608,4739,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.506 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.506 job1: (groupid=0, jobs=1): err= 0: pid=1057181: Tue Nov 26 01:09:40 2024 00:16:50.506 read: IOPS=4613, BW=18.0MiB/s (18.9MB/s)(18.1MiB/1006msec) 00:16:50.506 slat (usec): min=2, max=15730, avg=103.27, stdev=726.82 00:16:50.506 clat (usec): min=549, max=65750, avg=13625.72, stdev=8700.51 00:16:50.506 lat (usec): min=3467, max=65754, avg=13728.99, stdev=8747.54 00:16:50.506 clat percentiles (usec): 00:16:50.506 | 1.00th=[ 5604], 5.00th=[ 6980], 10.00th=[ 7635], 20.00th=[ 8225], 00:16:50.506 | 30.00th=[ 8979], 40.00th=[10028], 50.00th=[10552], 60.00th=[11600], 00:16:50.506 | 70.00th=[12780], 80.00th=[16581], 90.00th=[21365], 95.00th=[35390], 00:16:50.506 | 99.00th=[48497], 99.50th=[53216], 99.90th=[55313], 99.95th=[55313], 00:16:50.506 | 99.99th=[65799] 00:16:50.506 write: IOPS=5089, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1006msec); 0 zone resets 00:16:50.506 slat (usec): min=2, max=27245, avg=77.79, stdev=558.51 00:16:50.506 clat (usec): min=832, max=81199, avg=12548.30, stdev=8578.31 00:16:50.506 lat (usec): min=2345, max=81204, avg=12626.08, stdev=8605.24 00:16:50.506 clat percentiles (usec): 00:16:50.506 | 1.00th=[ 3392], 5.00th=[ 4490], 10.00th=[ 5538], 20.00th=[ 7046], 00:16:50.506 | 30.00th=[ 8717], 40.00th=[10159], 50.00th=[10552], 60.00th=[10945], 00:16:50.506 | 70.00th=[11338], 80.00th=[14746], 90.00th=[23462], 95.00th=[30540], 00:16:50.506 | 99.00th=[49021], 99.50th=[57410], 99.90th=[64750], 99.95th=[81265], 00:16:50.506 | 99.99th=[81265] 00:16:50.506 bw ( KiB/s): min=15624, max=24576, per=30.21%, avg=20100.00, stdev=6330.02, samples=2 00:16:50.506 iops : min= 3906, max= 6144, avg=5025.00, stdev=1582.50, samples=2 00:16:50.506 lat (usec) : 750=0.01%, 1000=0.01% 00:16:50.506 lat (msec) : 4=1.23%, 10=38.09%, 20=44.11%, 50=15.72%, 100=0.83% 00:16:50.506 cpu : usr=5.07%, sys=6.47%, ctx=457, majf=0, minf=2 00:16:50.506 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:50.506 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.506 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.506 issued rwts: total=4641,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.506 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.506 job2: (groupid=0, jobs=1): err= 0: pid=1057182: Tue Nov 26 01:09:40 2024 00:16:50.507 read: IOPS=3035, BW=11.9MiB/s (12.4MB/s)(12.0MiB/1012msec) 00:16:50.507 slat (usec): min=3, max=31422, avg=156.71, stdev=1179.82 00:16:50.507 clat (usec): min=8975, max=91531, avg=19785.42, stdev=11694.58 00:16:50.507 lat (usec): min=8991, max=91552, avg=19942.12, stdev=11810.44 00:16:50.507 clat percentiles (usec): 00:16:50.507 | 1.00th=[ 8979], 5.00th=[11338], 10.00th=[11863], 20.00th=[12387], 00:16:50.507 | 30.00th=[12649], 40.00th=[13042], 50.00th=[15139], 60.00th=[20317], 00:16:50.507 | 70.00th=[21365], 80.00th=[24249], 90.00th=[29492], 95.00th=[41157], 00:16:50.507 | 99.00th=[83362], 99.50th=[83362], 99.90th=[83362], 99.95th=[83362], 00:16:50.507 | 99.99th=[91751] 00:16:50.507 write: IOPS=3347, BW=13.1MiB/s (13.7MB/s)(13.2MiB/1012msec); 0 zone resets 00:16:50.507 slat (usec): min=4, max=32805, avg=139.91, stdev=926.44 00:16:50.507 clat (usec): min=470, max=86062, avg=19613.81, stdev=16129.46 00:16:50.507 lat (usec): min=479, max=86089, avg=19753.72, stdev=16205.85 00:16:50.507 clat percentiles (usec): 00:16:50.507 | 1.00th=[ 3392], 5.00th=[ 9765], 10.00th=[10552], 20.00th=[11731], 00:16:50.507 | 30.00th=[12518], 40.00th=[13173], 50.00th=[13698], 60.00th=[14353], 00:16:50.507 | 70.00th=[16581], 80.00th=[21627], 90.00th=[45351], 95.00th=[65799], 00:16:50.507 | 99.00th=[83362], 99.50th=[84411], 99.90th=[85459], 99.95th=[86508], 00:16:50.507 | 99.99th=[86508] 00:16:50.507 bw ( KiB/s): min=12312, max=13800, per=19.63%, avg=13056.00, stdev=1052.17, samples=2 00:16:50.507 iops : min= 3078, max= 3450, avg=3264.00, stdev=263.04, samples=2 00:16:50.507 lat (usec) : 500=0.03% 00:16:50.507 lat (msec) : 4=0.98%, 10=2.38%, 20=65.34%, 50=26.02%, 100=5.25% 00:16:50.507 cpu : usr=4.95%, sys=5.84%, ctx=260, majf=0, minf=1 00:16:50.507 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:16:50.507 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.507 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.507 issued rwts: total=3072,3388,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.507 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.507 job3: (groupid=0, jobs=1): err= 0: pid=1057187: Tue Nov 26 01:09:40 2024 00:16:50.507 read: IOPS=3144, BW=12.3MiB/s (12.9MB/s)(12.4MiB/1012msec) 00:16:50.507 slat (usec): min=2, max=15981, avg=136.74, stdev=1044.25 00:16:50.507 clat (usec): min=8202, max=69984, avg=18932.11, stdev=8910.28 00:16:50.507 lat (usec): min=8206, max=69996, avg=19068.85, stdev=9019.55 00:16:50.507 clat percentiles (usec): 00:16:50.507 | 1.00th=[ 8848], 5.00th=[ 9503], 10.00th=[11469], 20.00th=[13698], 00:16:50.507 | 30.00th=[15008], 40.00th=[15533], 50.00th=[16712], 60.00th=[17957], 00:16:50.507 | 70.00th=[19792], 80.00th=[22676], 90.00th=[27395], 95.00th=[40109], 00:16:50.507 | 99.00th=[54789], 99.50th=[54789], 99.90th=[59507], 99.95th=[65799], 00:16:50.507 | 99.99th=[69731] 00:16:50.507 write: IOPS=3541, BW=13.8MiB/s (14.5MB/s)(14.0MiB/1012msec); 0 zone resets 00:16:50.507 slat (usec): min=3, max=17989, avg=135.34, stdev=792.54 00:16:50.507 clat (usec): min=5061, max=57196, avg=18896.14, stdev=7730.21 00:16:50.507 lat (usec): min=5068, max=57201, avg=19031.48, stdev=7772.43 00:16:50.507 clat percentiles (usec): 00:16:50.507 | 1.00th=[ 6718], 5.00th=[ 7963], 10.00th=[11207], 20.00th=[13304], 00:16:50.507 | 30.00th=[14222], 40.00th=[15533], 50.00th=[16319], 60.00th=[19006], 00:16:50.507 | 70.00th=[22152], 80.00th=[23462], 90.00th=[31065], 95.00th=[34866], 00:16:50.507 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[42206], 00:16:50.507 | 99.99th=[57410] 00:16:50.507 bw ( KiB/s): min=13368, max=15168, per=21.45%, avg=14268.00, stdev=1272.79, samples=2 00:16:50.507 iops : min= 3342, max= 3792, avg=3567.00, stdev=318.20, samples=2 00:16:50.507 lat (msec) : 10=6.93%, 20=60.12%, 50=31.91%, 100=1.03% 00:16:50.507 cpu : usr=2.77%, sys=4.85%, ctx=328, majf=0, minf=1 00:16:50.507 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:16:50.507 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:50.507 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:50.507 issued rwts: total=3182,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:50.507 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:50.507 00:16:50.507 Run status group 0 (all jobs): 00:16:50.507 READ: bw=59.8MiB/s (62.7MB/s), 11.9MiB/s-18.0MiB/s (12.4MB/s-18.9MB/s), io=60.6MiB (63.5MB), run=1006-1012msec 00:16:50.507 WRITE: bw=65.0MiB/s (68.1MB/s), 13.1MiB/s-19.9MiB/s (13.7MB/s-20.8MB/s), io=65.7MiB (68.9MB), run=1006-1012msec 00:16:50.507 00:16:50.507 Disk stats (read/write): 00:16:50.507 nvme0n1: ios=3626/3647, merge=0/0, ticks=42388/56802, in_queue=99190, util=96.19% 00:16:50.507 nvme0n2: ios=3633/4044, merge=0/0, ticks=27522/31574, in_queue=59096, util=84.91% 00:16:50.507 nvme0n3: ios=2616/3069, merge=0/0, ticks=24372/28977, in_queue=53349, util=89.44% 00:16:50.507 nvme0n4: ios=2617/3027, merge=0/0, ticks=30366/29885, in_queue=60251, util=90.81% 00:16:50.507 01:09:40 -- target/fio.sh@55 -- # sync 00:16:50.507 01:09:40 -- target/fio.sh@59 -- # fio_pid=1057329 00:16:50.507 01:09:40 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:50.507 01:09:40 -- target/fio.sh@61 -- # sleep 3 00:16:50.507 [global] 00:16:50.507 thread=1 00:16:50.507 invalidate=1 00:16:50.507 rw=read 00:16:50.507 time_based=1 00:16:50.507 runtime=10 00:16:50.507 ioengine=libaio 00:16:50.507 direct=1 00:16:50.507 bs=4096 00:16:50.507 iodepth=1 00:16:50.507 norandommap=1 00:16:50.507 numjobs=1 00:16:50.507 00:16:50.507 [job0] 00:16:50.507 filename=/dev/nvme0n1 00:16:50.507 [job1] 00:16:50.507 filename=/dev/nvme0n2 00:16:50.507 [job2] 00:16:50.507 filename=/dev/nvme0n3 00:16:50.507 [job3] 00:16:50.507 filename=/dev/nvme0n4 00:16:50.507 Could not set queue depth (nvme0n1) 00:16:50.507 Could not set queue depth (nvme0n2) 00:16:50.507 Could not set queue depth (nvme0n3) 00:16:50.507 Could not set queue depth (nvme0n4) 00:16:50.507 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.507 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.507 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.507 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:50.507 fio-3.35 00:16:50.507 Starting 4 threads 00:16:53.787 01:09:43 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:16:53.787 01:09:44 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:16:53.787 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=6971392, buflen=4096 00:16:53.787 fio: pid=1057424, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:53.787 01:09:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:53.787 01:09:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:16:53.787 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=413696, buflen=4096 00:16:53.787 fio: pid=1057419, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:54.045 01:09:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:54.045 01:09:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:16:54.303 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=17793024, buflen=4096 00:16:54.303 fio: pid=1057417, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:54.303 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=15368192, buflen=4096 00:16:54.303 fio: pid=1057418, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:16:54.562 01:09:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:54.562 01:09:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:16:54.562 00:16:54.562 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1057417: Tue Nov 26 01:09:44 2024 00:16:54.562 read: IOPS=1257, BW=5028KiB/s (5148kB/s)(17.0MiB/3456msec) 00:16:54.562 slat (usec): min=4, max=28741, avg=19.22, stdev=504.37 00:16:54.562 clat (usec): min=172, max=42040, avg=768.92, stdev=4583.29 00:16:54.562 lat (usec): min=177, max=42054, avg=788.14, stdev=4612.05 00:16:54.562 clat percentiles (usec): 00:16:54.562 | 1.00th=[ 182], 5.00th=[ 194], 10.00th=[ 212], 20.00th=[ 221], 00:16:54.562 | 30.00th=[ 227], 40.00th=[ 233], 50.00th=[ 237], 60.00th=[ 243], 00:16:54.562 | 70.00th=[ 249], 80.00th=[ 260], 90.00th=[ 297], 95.00th=[ 375], 00:16:54.562 | 99.00th=[41157], 99.50th=[41157], 99.90th=[42206], 99.95th=[42206], 00:16:54.562 | 99.99th=[42206] 00:16:54.562 bw ( KiB/s): min= 96, max=11128, per=46.49%, avg=4985.33, stdev=4967.80, samples=6 00:16:54.562 iops : min= 24, max= 2782, avg=1246.33, stdev=1241.95, samples=6 00:16:54.562 lat (usec) : 250=72.24%, 500=26.40%, 750=0.02%, 1000=0.02% 00:16:54.562 lat (msec) : 50=1.29% 00:16:54.562 cpu : usr=0.43%, sys=1.27%, ctx=4350, majf=0, minf=1 00:16:54.562 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 issued rwts: total=4345,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.562 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.562 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1057418: Tue Nov 26 01:09:44 2024 00:16:54.562 read: IOPS=1016, BW=4064KiB/s (4161kB/s)(14.7MiB/3693msec) 00:16:54.562 slat (usec): min=4, max=10371, avg=11.56, stdev=207.77 00:16:54.562 clat (usec): min=170, max=47226, avg=964.56, stdev=5416.38 00:16:54.562 lat (usec): min=175, max=47239, avg=976.13, stdev=5422.47 00:16:54.562 clat percentiles (usec): 00:16:54.562 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 190], 00:16:54.562 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 206], 60.00th=[ 217], 00:16:54.562 | 70.00th=[ 233], 80.00th=[ 293], 90.00th=[ 396], 95.00th=[ 429], 00:16:54.562 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:54.562 | 99.99th=[47449] 00:16:54.562 bw ( KiB/s): min= 96, max=13613, per=32.94%, avg=3532.14, stdev=5784.96, samples=7 00:16:54.562 iops : min= 24, max= 3403, avg=883.00, stdev=1446.17, samples=7 00:16:54.562 lat (usec) : 250=75.83%, 500=22.01%, 750=0.35% 00:16:54.562 lat (msec) : 2=0.03%, 50=1.76% 00:16:54.562 cpu : usr=0.33%, sys=0.76%, ctx=3757, majf=0, minf=2 00:16:54.562 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 issued rwts: total=3753,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.562 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.562 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1057419: Tue Nov 26 01:09:44 2024 00:16:54.562 read: IOPS=32, BW=127KiB/s (131kB/s)(404KiB/3170msec) 00:16:54.562 slat (usec): min=8, max=3859, avg=66.26, stdev=379.46 00:16:54.562 clat (usec): min=347, max=43999, avg=31063.66, stdev=17634.16 00:16:54.562 lat (usec): min=382, max=44923, avg=31130.45, stdev=17655.97 00:16:54.562 clat percentiles (usec): 00:16:54.562 | 1.00th=[ 355], 5.00th=[ 383], 10.00th=[ 461], 20.00th=[ 570], 00:16:54.562 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:54.562 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:16:54.562 | 99.00th=[42206], 99.50th=[43779], 99.90th=[43779], 99.95th=[43779], 00:16:54.562 | 99.99th=[43779] 00:16:54.562 bw ( KiB/s): min= 96, max= 264, per=1.20%, avg=129.33, stdev=66.24, samples=6 00:16:54.562 iops : min= 24, max= 66, avg=32.33, stdev=16.56, samples=6 00:16:54.562 lat (usec) : 500=13.73%, 750=10.78% 00:16:54.562 lat (msec) : 50=74.51% 00:16:54.562 cpu : usr=0.19%, sys=0.00%, ctx=104, majf=0, minf=1 00:16:54.562 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 complete : 0=1.0%, 4=99.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 issued rwts: total=102,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.562 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.562 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=1057424: Tue Nov 26 01:09:44 2024 00:16:54.562 read: IOPS=582, BW=2328KiB/s (2384kB/s)(6808KiB/2924msec) 00:16:54.562 slat (nsec): min=4457, max=36157, avg=9974.65, stdev=6077.51 00:16:54.562 clat (usec): min=186, max=42037, avg=1691.77, stdev=7393.16 00:16:54.562 lat (usec): min=191, max=42055, avg=1701.74, stdev=7396.38 00:16:54.562 clat percentiles (usec): 00:16:54.562 | 1.00th=[ 196], 5.00th=[ 204], 10.00th=[ 208], 20.00th=[ 217], 00:16:54.562 | 30.00th=[ 223], 40.00th=[ 235], 50.00th=[ 334], 60.00th=[ 375], 00:16:54.562 | 70.00th=[ 392], 80.00th=[ 412], 90.00th=[ 461], 95.00th=[ 553], 00:16:54.562 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:54.562 | 99.99th=[42206] 00:16:54.562 bw ( KiB/s): min= 96, max=10472, per=25.17%, avg=2699.20, stdev=4492.99, samples=5 00:16:54.562 iops : min= 24, max= 2618, avg=674.80, stdev=1123.25, samples=5 00:16:54.562 lat (usec) : 250=45.04%, 500=49.03%, 750=2.35%, 1000=0.18% 00:16:54.562 lat (msec) : 50=3.35% 00:16:54.562 cpu : usr=0.14%, sys=0.72%, ctx=1704, majf=0, minf=1 00:16:54.562 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.562 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.562 issued rwts: total=1703,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.562 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.562 00:16:54.562 Run status group 0 (all jobs): 00:16:54.562 READ: bw=10.5MiB/s (11.0MB/s), 127KiB/s-5028KiB/s (131kB/s-5148kB/s), io=38.7MiB (40.5MB), run=2924-3693msec 00:16:54.562 00:16:54.562 Disk stats (read/write): 00:16:54.562 nvme0n1: ios=4390/0, merge=0/0, ticks=3884/0, in_queue=3884, util=98.23% 00:16:54.562 nvme0n2: ios=3414/0, merge=0/0, ticks=3524/0, in_queue=3524, util=96.03% 00:16:54.562 nvme0n3: ios=153/0, merge=0/0, ticks=4112/0, in_queue=4112, util=99.41% 00:16:54.562 nvme0n4: ios=1754/0, merge=0/0, ticks=3135/0, in_queue=3135, util=99.35% 00:16:54.820 01:09:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:54.820 01:09:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:16:55.078 01:09:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:55.078 01:09:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:16:55.336 01:09:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:55.336 01:09:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:16:55.594 01:09:45 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:16:55.594 01:09:45 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:16:55.852 01:09:46 -- target/fio.sh@69 -- # fio_status=0 00:16:55.852 01:09:46 -- target/fio.sh@70 -- # wait 1057329 00:16:55.852 01:09:46 -- target/fio.sh@70 -- # fio_status=4 00:16:55.852 01:09:46 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:55.853 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:16:55.853 01:09:46 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:55.853 01:09:46 -- common/autotest_common.sh@1208 -- # local i=0 00:16:55.853 01:09:46 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:55.853 01:09:46 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:55.853 01:09:46 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:55.853 01:09:46 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:55.853 01:09:46 -- common/autotest_common.sh@1220 -- # return 0 00:16:55.853 01:09:46 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:16:55.853 01:09:46 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:16:55.853 nvmf hotplug test: fio failed as expected 00:16:55.853 01:09:46 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:56.111 01:09:46 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:16:56.111 01:09:46 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:16:56.111 01:09:46 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:16:56.111 01:09:46 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:16:56.111 01:09:46 -- target/fio.sh@91 -- # nvmftestfini 00:16:56.111 01:09:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:56.111 01:09:46 -- nvmf/common.sh@116 -- # sync 00:16:56.111 01:09:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:56.111 01:09:46 -- nvmf/common.sh@119 -- # set +e 00:16:56.111 01:09:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:56.111 01:09:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:56.111 rmmod nvme_tcp 00:16:56.111 rmmod nvme_fabrics 00:16:56.111 rmmod nvme_keyring 00:16:56.111 01:09:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:56.111 01:09:46 -- nvmf/common.sh@123 -- # set -e 00:16:56.111 01:09:46 -- nvmf/common.sh@124 -- # return 0 00:16:56.111 01:09:46 -- nvmf/common.sh@477 -- # '[' -n 1055120 ']' 00:16:56.111 01:09:46 -- nvmf/common.sh@478 -- # killprocess 1055120 00:16:56.111 01:09:46 -- common/autotest_common.sh@936 -- # '[' -z 1055120 ']' 00:16:56.111 01:09:46 -- common/autotest_common.sh@940 -- # kill -0 1055120 00:16:56.111 01:09:46 -- common/autotest_common.sh@941 -- # uname 00:16:56.111 01:09:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:56.111 01:09:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1055120 00:16:56.369 01:09:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:56.369 01:09:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:56.369 01:09:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1055120' 00:16:56.369 killing process with pid 1055120 00:16:56.369 01:09:46 -- common/autotest_common.sh@955 -- # kill 1055120 00:16:56.369 01:09:46 -- common/autotest_common.sh@960 -- # wait 1055120 00:16:56.629 01:09:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:56.629 01:09:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:56.629 01:09:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:56.629 01:09:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:56.629 01:09:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:56.629 01:09:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:56.629 01:09:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:56.629 01:09:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:58.535 01:09:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:58.535 00:16:58.535 real 0m24.498s 00:16:58.535 user 1m25.447s 00:16:58.535 sys 0m6.495s 00:16:58.535 01:09:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:58.535 01:09:49 -- common/autotest_common.sh@10 -- # set +x 00:16:58.535 ************************************ 00:16:58.535 END TEST nvmf_fio_target 00:16:58.535 ************************************ 00:16:58.535 01:09:49 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:58.535 01:09:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:58.535 01:09:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:58.535 01:09:49 -- common/autotest_common.sh@10 -- # set +x 00:16:58.535 ************************************ 00:16:58.535 START TEST nvmf_bdevio 00:16:58.535 ************************************ 00:16:58.535 01:09:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:16:58.796 * Looking for test storage... 00:16:58.796 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:58.796 01:09:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:58.796 01:09:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:58.796 01:09:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:58.796 01:09:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:58.796 01:09:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:58.796 01:09:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:58.796 01:09:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:58.796 01:09:49 -- scripts/common.sh@335 -- # IFS=.-: 00:16:58.796 01:09:49 -- scripts/common.sh@335 -- # read -ra ver1 00:16:58.796 01:09:49 -- scripts/common.sh@336 -- # IFS=.-: 00:16:58.796 01:09:49 -- scripts/common.sh@336 -- # read -ra ver2 00:16:58.796 01:09:49 -- scripts/common.sh@337 -- # local 'op=<' 00:16:58.796 01:09:49 -- scripts/common.sh@339 -- # ver1_l=2 00:16:58.796 01:09:49 -- scripts/common.sh@340 -- # ver2_l=1 00:16:58.796 01:09:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:58.796 01:09:49 -- scripts/common.sh@343 -- # case "$op" in 00:16:58.796 01:09:49 -- scripts/common.sh@344 -- # : 1 00:16:58.796 01:09:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:58.796 01:09:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:58.796 01:09:49 -- scripts/common.sh@364 -- # decimal 1 00:16:58.796 01:09:49 -- scripts/common.sh@352 -- # local d=1 00:16:58.796 01:09:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:58.796 01:09:49 -- scripts/common.sh@354 -- # echo 1 00:16:58.796 01:09:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:58.796 01:09:49 -- scripts/common.sh@365 -- # decimal 2 00:16:58.796 01:09:49 -- scripts/common.sh@352 -- # local d=2 00:16:58.796 01:09:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:58.796 01:09:49 -- scripts/common.sh@354 -- # echo 2 00:16:58.796 01:09:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:58.796 01:09:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:58.796 01:09:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:58.796 01:09:49 -- scripts/common.sh@367 -- # return 0 00:16:58.796 01:09:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:58.796 01:09:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:58.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.796 --rc genhtml_branch_coverage=1 00:16:58.796 --rc genhtml_function_coverage=1 00:16:58.796 --rc genhtml_legend=1 00:16:58.796 --rc geninfo_all_blocks=1 00:16:58.796 --rc geninfo_unexecuted_blocks=1 00:16:58.796 00:16:58.796 ' 00:16:58.796 01:09:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:58.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.796 --rc genhtml_branch_coverage=1 00:16:58.796 --rc genhtml_function_coverage=1 00:16:58.796 --rc genhtml_legend=1 00:16:58.796 --rc geninfo_all_blocks=1 00:16:58.796 --rc geninfo_unexecuted_blocks=1 00:16:58.796 00:16:58.796 ' 00:16:58.796 01:09:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:58.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.796 --rc genhtml_branch_coverage=1 00:16:58.796 --rc genhtml_function_coverage=1 00:16:58.796 --rc genhtml_legend=1 00:16:58.796 --rc geninfo_all_blocks=1 00:16:58.796 --rc geninfo_unexecuted_blocks=1 00:16:58.796 00:16:58.796 ' 00:16:58.796 01:09:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:58.796 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:58.796 --rc genhtml_branch_coverage=1 00:16:58.796 --rc genhtml_function_coverage=1 00:16:58.796 --rc genhtml_legend=1 00:16:58.796 --rc geninfo_all_blocks=1 00:16:58.796 --rc geninfo_unexecuted_blocks=1 00:16:58.796 00:16:58.796 ' 00:16:58.796 01:09:49 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:58.796 01:09:49 -- nvmf/common.sh@7 -- # uname -s 00:16:58.796 01:09:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:58.796 01:09:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:58.796 01:09:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:58.796 01:09:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:58.796 01:09:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:58.796 01:09:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:58.796 01:09:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:58.796 01:09:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:58.796 01:09:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:58.796 01:09:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:58.796 01:09:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:58.796 01:09:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:58.796 01:09:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:58.796 01:09:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:58.796 01:09:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:58.796 01:09:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:58.796 01:09:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:58.796 01:09:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:58.796 01:09:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:58.796 01:09:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.796 01:09:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.796 01:09:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.796 01:09:49 -- paths/export.sh@5 -- # export PATH 00:16:58.796 01:09:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:58.796 01:09:49 -- nvmf/common.sh@46 -- # : 0 00:16:58.796 01:09:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:58.796 01:09:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:58.796 01:09:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:58.796 01:09:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:58.796 01:09:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:58.796 01:09:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:58.796 01:09:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:58.796 01:09:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:58.796 01:09:49 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:58.796 01:09:49 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:58.796 01:09:49 -- target/bdevio.sh@14 -- # nvmftestinit 00:16:58.796 01:09:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:58.796 01:09:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:58.796 01:09:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:58.796 01:09:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:58.796 01:09:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:58.796 01:09:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:58.796 01:09:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:58.796 01:09:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:58.796 01:09:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:58.796 01:09:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:58.796 01:09:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:58.796 01:09:49 -- common/autotest_common.sh@10 -- # set +x 00:17:01.328 01:09:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:01.328 01:09:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:01.328 01:09:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:01.328 01:09:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:01.328 01:09:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:01.328 01:09:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:01.328 01:09:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:01.328 01:09:51 -- nvmf/common.sh@294 -- # net_devs=() 00:17:01.328 01:09:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:01.328 01:09:51 -- nvmf/common.sh@295 -- # e810=() 00:17:01.328 01:09:51 -- nvmf/common.sh@295 -- # local -ga e810 00:17:01.328 01:09:51 -- nvmf/common.sh@296 -- # x722=() 00:17:01.328 01:09:51 -- nvmf/common.sh@296 -- # local -ga x722 00:17:01.328 01:09:51 -- nvmf/common.sh@297 -- # mlx=() 00:17:01.328 01:09:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:01.328 01:09:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:01.328 01:09:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:01.328 01:09:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:01.328 01:09:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:01.328 01:09:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:01.328 01:09:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:01.328 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:01.328 01:09:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:01.328 01:09:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:01.328 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:01.328 01:09:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:01.328 01:09:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:01.328 01:09:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:01.328 01:09:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:01.328 01:09:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:01.328 01:09:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:01.328 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:01.328 01:09:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:01.328 01:09:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:01.328 01:09:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:01.328 01:09:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:01.328 01:09:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:01.328 01:09:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:01.328 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:01.328 01:09:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:01.328 01:09:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:01.328 01:09:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:01.328 01:09:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:01.328 01:09:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:01.328 01:09:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:01.328 01:09:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:01.328 01:09:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:01.328 01:09:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:01.328 01:09:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:01.328 01:09:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:01.328 01:09:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:01.328 01:09:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:01.328 01:09:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:01.328 01:09:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:01.328 01:09:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:01.328 01:09:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:01.328 01:09:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:01.328 01:09:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:01.328 01:09:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:01.328 01:09:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:01.328 01:09:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:01.328 01:09:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:01.328 01:09:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:01.328 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:01.328 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.205 ms 00:17:01.328 00:17:01.328 --- 10.0.0.2 ping statistics --- 00:17:01.328 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:01.328 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:17:01.328 01:09:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:01.328 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:01.328 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:17:01.328 00:17:01.328 --- 10.0.0.1 ping statistics --- 00:17:01.328 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:01.328 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:17:01.328 01:09:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:01.328 01:09:51 -- nvmf/common.sh@410 -- # return 0 00:17:01.328 01:09:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:01.328 01:09:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:01.328 01:09:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:01.328 01:09:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:01.328 01:09:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:01.328 01:09:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:01.328 01:09:51 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:01.328 01:09:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:01.328 01:09:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:01.328 01:09:51 -- common/autotest_common.sh@10 -- # set +x 00:17:01.328 01:09:51 -- nvmf/common.sh@469 -- # nvmfpid=1060077 00:17:01.328 01:09:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:01.328 01:09:51 -- nvmf/common.sh@470 -- # waitforlisten 1060077 00:17:01.328 01:09:51 -- common/autotest_common.sh@829 -- # '[' -z 1060077 ']' 00:17:01.328 01:09:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:01.328 01:09:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:01.328 01:09:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:01.328 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:01.328 01:09:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:01.328 01:09:51 -- common/autotest_common.sh@10 -- # set +x 00:17:01.328 [2024-11-26 01:09:51.432883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:01.329 [2024-11-26 01:09:51.432973] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:01.329 EAL: No free 2048 kB hugepages reported on node 1 00:17:01.329 [2024-11-26 01:09:51.502659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:01.329 [2024-11-26 01:09:51.624350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:01.329 [2024-11-26 01:09:51.624515] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:01.329 [2024-11-26 01:09:51.624536] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:01.329 [2024-11-26 01:09:51.624552] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:01.329 [2024-11-26 01:09:51.624640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:01.329 [2024-11-26 01:09:51.624705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:01.329 [2024-11-26 01:09:51.624762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:01.329 [2024-11-26 01:09:51.624766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:02.263 01:09:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.263 01:09:52 -- common/autotest_common.sh@862 -- # return 0 00:17:02.263 01:09:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:02.263 01:09:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:02.263 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:17:02.263 01:09:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:02.263 01:09:52 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:02.263 01:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.263 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:17:02.263 [2024-11-26 01:09:52.469279] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:02.263 01:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.263 01:09:52 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:02.263 01:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.263 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:17:02.263 Malloc0 00:17:02.263 01:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.263 01:09:52 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:02.263 01:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.263 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:17:02.263 01:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.263 01:09:52 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:02.263 01:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.263 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:17:02.263 01:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.263 01:09:52 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:02.263 01:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.263 01:09:52 -- common/autotest_common.sh@10 -- # set +x 00:17:02.263 [2024-11-26 01:09:52.523192] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:02.263 01:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.263 01:09:52 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:02.263 01:09:52 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:02.263 01:09:52 -- nvmf/common.sh@520 -- # config=() 00:17:02.263 01:09:52 -- nvmf/common.sh@520 -- # local subsystem config 00:17:02.263 01:09:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:02.263 01:09:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:02.263 { 00:17:02.263 "params": { 00:17:02.263 "name": "Nvme$subsystem", 00:17:02.263 "trtype": "$TEST_TRANSPORT", 00:17:02.263 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:02.263 "adrfam": "ipv4", 00:17:02.263 "trsvcid": "$NVMF_PORT", 00:17:02.263 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:02.263 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:02.263 "hdgst": ${hdgst:-false}, 00:17:02.263 "ddgst": ${ddgst:-false} 00:17:02.263 }, 00:17:02.263 "method": "bdev_nvme_attach_controller" 00:17:02.263 } 00:17:02.263 EOF 00:17:02.263 )") 00:17:02.263 01:09:52 -- nvmf/common.sh@542 -- # cat 00:17:02.263 01:09:52 -- nvmf/common.sh@544 -- # jq . 00:17:02.263 01:09:52 -- nvmf/common.sh@545 -- # IFS=, 00:17:02.263 01:09:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:02.263 "params": { 00:17:02.263 "name": "Nvme1", 00:17:02.263 "trtype": "tcp", 00:17:02.263 "traddr": "10.0.0.2", 00:17:02.263 "adrfam": "ipv4", 00:17:02.263 "trsvcid": "4420", 00:17:02.263 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:02.263 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:02.263 "hdgst": false, 00:17:02.263 "ddgst": false 00:17:02.263 }, 00:17:02.263 "method": "bdev_nvme_attach_controller" 00:17:02.263 }' 00:17:02.263 [2024-11-26 01:09:52.566584] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:02.263 [2024-11-26 01:09:52.566651] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1060239 ] 00:17:02.263 EAL: No free 2048 kB hugepages reported on node 1 00:17:02.263 [2024-11-26 01:09:52.626448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:02.263 [2024-11-26 01:09:52.739233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:02.263 [2024-11-26 01:09:52.739284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:02.263 [2024-11-26 01:09:52.739288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:02.522 [2024-11-26 01:09:53.034435] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:02.522 [2024-11-26 01:09:53.034509] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:02.522 I/O targets: 00:17:02.522 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:02.522 00:17:02.522 00:17:02.522 CUnit - A unit testing framework for C - Version 2.1-3 00:17:02.522 http://cunit.sourceforge.net/ 00:17:02.522 00:17:02.522 00:17:02.522 Suite: bdevio tests on: Nvme1n1 00:17:02.780 Test: blockdev write read block ...passed 00:17:02.780 Test: blockdev write zeroes read block ...passed 00:17:02.780 Test: blockdev write zeroes read no split ...passed 00:17:02.780 Test: blockdev write zeroes read split ...passed 00:17:02.780 Test: blockdev write zeroes read split partial ...passed 00:17:02.780 Test: blockdev reset ...[2024-11-26 01:09:53.150065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:02.780 [2024-11-26 01:09:53.150170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a74f20 (9): Bad file descriptor 00:17:02.780 [2024-11-26 01:09:53.205105] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:02.780 passed 00:17:02.780 Test: blockdev write read 8 blocks ...passed 00:17:02.780 Test: blockdev write read size > 128k ...passed 00:17:02.780 Test: blockdev write read invalid size ...passed 00:17:02.780 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:02.780 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:02.780 Test: blockdev write read max offset ...passed 00:17:03.037 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:03.037 Test: blockdev writev readv 8 blocks ...passed 00:17:03.037 Test: blockdev writev readv 30 x 1block ...passed 00:17:03.037 Test: blockdev writev readv block ...passed 00:17:03.037 Test: blockdev writev readv size > 128k ...passed 00:17:03.038 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:03.038 Test: blockdev comparev and writev ...[2024-11-26 01:09:53.418138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.418174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.418208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.418226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.418544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.418569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.418591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.418607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.418935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.418960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.418986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.419002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.419305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.419329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.419351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:03.038 [2024-11-26 01:09:53.419376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:03.038 passed 00:17:03.038 Test: blockdev nvme passthru rw ...passed 00:17:03.038 Test: blockdev nvme passthru vendor specific ...[2024-11-26 01:09:53.500939] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.038 [2024-11-26 01:09:53.500966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.501119] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.038 [2024-11-26 01:09:53.501144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.501301] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.038 [2024-11-26 01:09:53.501325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:03.038 [2024-11-26 01:09:53.501477] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:03.038 [2024-11-26 01:09:53.501500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:03.038 passed 00:17:03.038 Test: blockdev nvme admin passthru ...passed 00:17:03.038 Test: blockdev copy ...passed 00:17:03.038 00:17:03.038 Run Summary: Type Total Ran Passed Failed Inactive 00:17:03.038 suites 1 1 n/a 0 0 00:17:03.038 tests 23 23 23 0 0 00:17:03.038 asserts 152 152 152 0 n/a 00:17:03.038 00:17:03.038 Elapsed time = 1.058 seconds 00:17:03.296 01:09:53 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:03.296 01:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.296 01:09:53 -- common/autotest_common.sh@10 -- # set +x 00:17:03.296 01:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.296 01:09:53 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:03.296 01:09:53 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:03.296 01:09:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:03.296 01:09:53 -- nvmf/common.sh@116 -- # sync 00:17:03.296 01:09:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:03.296 01:09:53 -- nvmf/common.sh@119 -- # set +e 00:17:03.296 01:09:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:03.296 01:09:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:03.296 rmmod nvme_tcp 00:17:03.553 rmmod nvme_fabrics 00:17:03.553 rmmod nvme_keyring 00:17:03.553 01:09:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:03.553 01:09:53 -- nvmf/common.sh@123 -- # set -e 00:17:03.553 01:09:53 -- nvmf/common.sh@124 -- # return 0 00:17:03.553 01:09:53 -- nvmf/common.sh@477 -- # '[' -n 1060077 ']' 00:17:03.553 01:09:53 -- nvmf/common.sh@478 -- # killprocess 1060077 00:17:03.553 01:09:53 -- common/autotest_common.sh@936 -- # '[' -z 1060077 ']' 00:17:03.553 01:09:53 -- common/autotest_common.sh@940 -- # kill -0 1060077 00:17:03.553 01:09:53 -- common/autotest_common.sh@941 -- # uname 00:17:03.553 01:09:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:03.553 01:09:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1060077 00:17:03.553 01:09:53 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:03.553 01:09:53 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:03.553 01:09:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1060077' 00:17:03.553 killing process with pid 1060077 00:17:03.553 01:09:53 -- common/autotest_common.sh@955 -- # kill 1060077 00:17:03.553 01:09:53 -- common/autotest_common.sh@960 -- # wait 1060077 00:17:03.810 01:09:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:03.810 01:09:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:03.810 01:09:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:03.810 01:09:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:03.810 01:09:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:03.810 01:09:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:03.810 01:09:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:03.810 01:09:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.344 01:09:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:06.344 00:17:06.344 real 0m7.218s 00:17:06.344 user 0m13.597s 00:17:06.344 sys 0m2.142s 00:17:06.344 01:09:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:06.345 01:09:56 -- common/autotest_common.sh@10 -- # set +x 00:17:06.345 ************************************ 00:17:06.345 END TEST nvmf_bdevio 00:17:06.345 ************************************ 00:17:06.345 01:09:56 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:06.345 01:09:56 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:06.345 01:09:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:06.345 01:09:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:06.345 01:09:56 -- common/autotest_common.sh@10 -- # set +x 00:17:06.345 ************************************ 00:17:06.345 START TEST nvmf_bdevio_no_huge 00:17:06.345 ************************************ 00:17:06.345 01:09:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:06.345 * Looking for test storage... 00:17:06.345 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:06.345 01:09:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:06.345 01:09:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:06.345 01:09:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:06.345 01:09:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:06.345 01:09:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:06.345 01:09:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:06.345 01:09:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:06.345 01:09:56 -- scripts/common.sh@335 -- # IFS=.-: 00:17:06.345 01:09:56 -- scripts/common.sh@335 -- # read -ra ver1 00:17:06.345 01:09:56 -- scripts/common.sh@336 -- # IFS=.-: 00:17:06.345 01:09:56 -- scripts/common.sh@336 -- # read -ra ver2 00:17:06.345 01:09:56 -- scripts/common.sh@337 -- # local 'op=<' 00:17:06.345 01:09:56 -- scripts/common.sh@339 -- # ver1_l=2 00:17:06.345 01:09:56 -- scripts/common.sh@340 -- # ver2_l=1 00:17:06.345 01:09:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:06.345 01:09:56 -- scripts/common.sh@343 -- # case "$op" in 00:17:06.345 01:09:56 -- scripts/common.sh@344 -- # : 1 00:17:06.345 01:09:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:06.345 01:09:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.345 01:09:56 -- scripts/common.sh@364 -- # decimal 1 00:17:06.345 01:09:56 -- scripts/common.sh@352 -- # local d=1 00:17:06.345 01:09:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:06.345 01:09:56 -- scripts/common.sh@354 -- # echo 1 00:17:06.345 01:09:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:06.345 01:09:56 -- scripts/common.sh@365 -- # decimal 2 00:17:06.345 01:09:56 -- scripts/common.sh@352 -- # local d=2 00:17:06.345 01:09:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:06.345 01:09:56 -- scripts/common.sh@354 -- # echo 2 00:17:06.345 01:09:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:06.345 01:09:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:06.345 01:09:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:06.345 01:09:56 -- scripts/common.sh@367 -- # return 0 00:17:06.345 01:09:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:06.345 01:09:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:06.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.345 --rc genhtml_branch_coverage=1 00:17:06.345 --rc genhtml_function_coverage=1 00:17:06.345 --rc genhtml_legend=1 00:17:06.345 --rc geninfo_all_blocks=1 00:17:06.345 --rc geninfo_unexecuted_blocks=1 00:17:06.345 00:17:06.345 ' 00:17:06.345 01:09:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:06.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.345 --rc genhtml_branch_coverage=1 00:17:06.345 --rc genhtml_function_coverage=1 00:17:06.345 --rc genhtml_legend=1 00:17:06.345 --rc geninfo_all_blocks=1 00:17:06.345 --rc geninfo_unexecuted_blocks=1 00:17:06.345 00:17:06.345 ' 00:17:06.345 01:09:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:06.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.345 --rc genhtml_branch_coverage=1 00:17:06.345 --rc genhtml_function_coverage=1 00:17:06.345 --rc genhtml_legend=1 00:17:06.345 --rc geninfo_all_blocks=1 00:17:06.345 --rc geninfo_unexecuted_blocks=1 00:17:06.345 00:17:06.345 ' 00:17:06.345 01:09:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:06.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.345 --rc genhtml_branch_coverage=1 00:17:06.345 --rc genhtml_function_coverage=1 00:17:06.345 --rc genhtml_legend=1 00:17:06.345 --rc geninfo_all_blocks=1 00:17:06.345 --rc geninfo_unexecuted_blocks=1 00:17:06.345 00:17:06.345 ' 00:17:06.345 01:09:56 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:06.345 01:09:56 -- nvmf/common.sh@7 -- # uname -s 00:17:06.345 01:09:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:06.345 01:09:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:06.345 01:09:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:06.345 01:09:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:06.345 01:09:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:06.345 01:09:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:06.345 01:09:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:06.345 01:09:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:06.345 01:09:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:06.345 01:09:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:06.345 01:09:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.345 01:09:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:06.345 01:09:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:06.345 01:09:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:06.345 01:09:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:06.345 01:09:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:06.345 01:09:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:06.345 01:09:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:06.345 01:09:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:06.345 01:09:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.345 01:09:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.345 01:09:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.345 01:09:56 -- paths/export.sh@5 -- # export PATH 00:17:06.345 01:09:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.345 01:09:56 -- nvmf/common.sh@46 -- # : 0 00:17:06.345 01:09:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:06.345 01:09:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:06.345 01:09:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:06.345 01:09:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:06.345 01:09:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:06.345 01:09:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:06.345 01:09:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:06.345 01:09:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:06.345 01:09:56 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:06.345 01:09:56 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:06.345 01:09:56 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:06.345 01:09:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:06.345 01:09:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:06.345 01:09:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:06.345 01:09:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:06.345 01:09:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:06.345 01:09:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.345 01:09:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:06.345 01:09:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.345 01:09:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:06.345 01:09:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:06.345 01:09:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:06.345 01:09:56 -- common/autotest_common.sh@10 -- # set +x 00:17:08.249 01:09:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:08.249 01:09:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:08.249 01:09:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:08.249 01:09:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:08.249 01:09:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:08.249 01:09:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:08.249 01:09:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:08.249 01:09:58 -- nvmf/common.sh@294 -- # net_devs=() 00:17:08.249 01:09:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:08.249 01:09:58 -- nvmf/common.sh@295 -- # e810=() 00:17:08.249 01:09:58 -- nvmf/common.sh@295 -- # local -ga e810 00:17:08.249 01:09:58 -- nvmf/common.sh@296 -- # x722=() 00:17:08.249 01:09:58 -- nvmf/common.sh@296 -- # local -ga x722 00:17:08.249 01:09:58 -- nvmf/common.sh@297 -- # mlx=() 00:17:08.249 01:09:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:08.249 01:09:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:08.249 01:09:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:08.249 01:09:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:08.249 01:09:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:08.249 01:09:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:08.249 01:09:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:08.250 01:09:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:08.250 01:09:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.250 01:09:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:08.250 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:08.250 01:09:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:08.250 01:09:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:08.250 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:08.250 01:09:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:08.250 01:09:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.250 01:09:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.250 01:09:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.250 01:09:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.250 01:09:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:08.250 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:08.250 01:09:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.250 01:09:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:08.250 01:09:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:08.250 01:09:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:08.250 01:09:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:08.250 01:09:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:08.250 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:08.250 01:09:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:08.250 01:09:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:08.250 01:09:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:08.250 01:09:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:08.250 01:09:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:08.250 01:09:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:08.250 01:09:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:08.250 01:09:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:08.250 01:09:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:08.250 01:09:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:08.250 01:09:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:08.250 01:09:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:08.250 01:09:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:08.250 01:09:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:08.250 01:09:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:08.250 01:09:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:08.250 01:09:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:08.250 01:09:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:08.250 01:09:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:08.250 01:09:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:08.250 01:09:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:08.250 01:09:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:08.250 01:09:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:08.250 01:09:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:08.250 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:08.250 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:17:08.250 00:17:08.250 --- 10.0.0.2 ping statistics --- 00:17:08.250 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.250 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:17:08.250 01:09:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:08.250 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:08.250 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:17:08.250 00:17:08.250 --- 10.0.0.1 ping statistics --- 00:17:08.250 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:08.250 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:17:08.250 01:09:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:08.250 01:09:58 -- nvmf/common.sh@410 -- # return 0 00:17:08.250 01:09:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:08.250 01:09:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:08.250 01:09:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:08.250 01:09:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:08.250 01:09:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:08.250 01:09:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:08.250 01:09:58 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:08.250 01:09:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:08.250 01:09:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:08.250 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:17:08.250 01:09:58 -- nvmf/common.sh@469 -- # nvmfpid=1062394 00:17:08.250 01:09:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:08.250 01:09:58 -- nvmf/common.sh@470 -- # waitforlisten 1062394 00:17:08.250 01:09:58 -- common/autotest_common.sh@829 -- # '[' -z 1062394 ']' 00:17:08.250 01:09:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:08.250 01:09:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:08.250 01:09:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:08.250 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:08.250 01:09:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:08.250 01:09:58 -- common/autotest_common.sh@10 -- # set +x 00:17:08.250 [2024-11-26 01:09:58.668172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:08.250 [2024-11-26 01:09:58.668256] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:08.250 [2024-11-26 01:09:58.751958] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:08.509 [2024-11-26 01:09:58.876028] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:08.509 [2024-11-26 01:09:58.876214] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.509 [2024-11-26 01:09:58.876235] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.509 [2024-11-26 01:09:58.876249] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.509 [2024-11-26 01:09:58.876353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:08.509 [2024-11-26 01:09:58.876409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:08.509 [2024-11-26 01:09:58.876466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:08.509 [2024-11-26 01:09:58.876469] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:09.443 01:09:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:09.443 01:09:59 -- common/autotest_common.sh@862 -- # return 0 00:17:09.443 01:09:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:09.443 01:09:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:09.443 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:17:09.443 01:09:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:09.443 01:09:59 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:09.443 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.443 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:17:09.443 [2024-11-26 01:09:59.690864] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:09.443 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.443 01:09:59 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:09.443 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.443 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:17:09.443 Malloc0 00:17:09.443 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.443 01:09:59 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:09.443 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.443 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:17:09.443 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.443 01:09:59 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:09.443 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.443 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:17:09.443 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.443 01:09:59 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:09.443 01:09:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.443 01:09:59 -- common/autotest_common.sh@10 -- # set +x 00:17:09.443 [2024-11-26 01:09:59.729328] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:09.443 01:09:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.443 01:09:59 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:09.443 01:09:59 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:09.443 01:09:59 -- nvmf/common.sh@520 -- # config=() 00:17:09.443 01:09:59 -- nvmf/common.sh@520 -- # local subsystem config 00:17:09.443 01:09:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:09.443 01:09:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:09.443 { 00:17:09.443 "params": { 00:17:09.443 "name": "Nvme$subsystem", 00:17:09.443 "trtype": "$TEST_TRANSPORT", 00:17:09.443 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:09.443 "adrfam": "ipv4", 00:17:09.443 "trsvcid": "$NVMF_PORT", 00:17:09.443 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:09.443 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:09.443 "hdgst": ${hdgst:-false}, 00:17:09.443 "ddgst": ${ddgst:-false} 00:17:09.443 }, 00:17:09.443 "method": "bdev_nvme_attach_controller" 00:17:09.443 } 00:17:09.443 EOF 00:17:09.443 )") 00:17:09.443 01:09:59 -- nvmf/common.sh@542 -- # cat 00:17:09.443 01:09:59 -- nvmf/common.sh@544 -- # jq . 00:17:09.443 01:09:59 -- nvmf/common.sh@545 -- # IFS=, 00:17:09.443 01:09:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:09.443 "params": { 00:17:09.443 "name": "Nvme1", 00:17:09.443 "trtype": "tcp", 00:17:09.443 "traddr": "10.0.0.2", 00:17:09.443 "adrfam": "ipv4", 00:17:09.443 "trsvcid": "4420", 00:17:09.443 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:09.443 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:09.443 "hdgst": false, 00:17:09.443 "ddgst": false 00:17:09.443 }, 00:17:09.443 "method": "bdev_nvme_attach_controller" 00:17:09.443 }' 00:17:09.443 [2024-11-26 01:09:59.772928] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:09.443 [2024-11-26 01:09:59.773021] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid1062545 ] 00:17:09.443 [2024-11-26 01:09:59.839060] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:09.443 [2024-11-26 01:09:59.953527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.443 [2024-11-26 01:09:59.953577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:09.443 [2024-11-26 01:09:59.953580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:10.012 [2024-11-26 01:10:00.235666] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:10.012 [2024-11-26 01:10:00.235739] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:10.012 I/O targets: 00:17:10.012 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:10.012 00:17:10.012 00:17:10.012 CUnit - A unit testing framework for C - Version 2.1-3 00:17:10.012 http://cunit.sourceforge.net/ 00:17:10.012 00:17:10.012 00:17:10.012 Suite: bdevio tests on: Nvme1n1 00:17:10.012 Test: blockdev write read block ...passed 00:17:10.012 Test: blockdev write zeroes read block ...passed 00:17:10.012 Test: blockdev write zeroes read no split ...passed 00:17:10.012 Test: blockdev write zeroes read split ...passed 00:17:10.012 Test: blockdev write zeroes read split partial ...passed 00:17:10.012 Test: blockdev reset ...[2024-11-26 01:10:00.397105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:10.012 [2024-11-26 01:10:00.397254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f247d0 (9): Bad file descriptor 00:17:10.012 [2024-11-26 01:10:00.413453] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:10.012 passed 00:17:10.012 Test: blockdev write read 8 blocks ...passed 00:17:10.012 Test: blockdev write read size > 128k ...passed 00:17:10.012 Test: blockdev write read invalid size ...passed 00:17:10.012 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:10.012 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:10.012 Test: blockdev write read max offset ...passed 00:17:10.308 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:10.309 Test: blockdev writev readv 8 blocks ...passed 00:17:10.309 Test: blockdev writev readv 30 x 1block ...passed 00:17:10.309 Test: blockdev writev readv block ...passed 00:17:10.309 Test: blockdev writev readv size > 128k ...passed 00:17:10.309 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:10.309 Test: blockdev comparev and writev ...[2024-11-26 01:10:00.587824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.587860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.587884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.587901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.588223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.588248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.588270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.588286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.588593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.588617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.588639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.588656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.588968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.588996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.589018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:10.309 [2024-11-26 01:10:00.589035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:10.309 passed 00:17:10.309 Test: blockdev nvme passthru rw ...passed 00:17:10.309 Test: blockdev nvme passthru vendor specific ...[2024-11-26 01:10:00.672930] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.309 [2024-11-26 01:10:00.672957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.673104] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.309 [2024-11-26 01:10:00.673127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.673272] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.309 [2024-11-26 01:10:00.673295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:10.309 [2024-11-26 01:10:00.673439] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:10.309 [2024-11-26 01:10:00.673461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:10.309 passed 00:17:10.309 Test: blockdev nvme admin passthru ...passed 00:17:10.309 Test: blockdev copy ...passed 00:17:10.309 00:17:10.309 Run Summary: Type Total Ran Passed Failed Inactive 00:17:10.309 suites 1 1 n/a 0 0 00:17:10.309 tests 23 23 23 0 0 00:17:10.309 asserts 152 152 152 0 n/a 00:17:10.309 00:17:10.309 Elapsed time = 0.981 seconds 00:17:10.592 01:10:01 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:10.592 01:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.592 01:10:01 -- common/autotest_common.sh@10 -- # set +x 00:17:10.592 01:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.592 01:10:01 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:10.592 01:10:01 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:10.592 01:10:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:10.592 01:10:01 -- nvmf/common.sh@116 -- # sync 00:17:10.592 01:10:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:10.592 01:10:01 -- nvmf/common.sh@119 -- # set +e 00:17:10.592 01:10:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:10.592 01:10:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:10.592 rmmod nvme_tcp 00:17:10.592 rmmod nvme_fabrics 00:17:10.592 rmmod nvme_keyring 00:17:10.850 01:10:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:10.850 01:10:01 -- nvmf/common.sh@123 -- # set -e 00:17:10.850 01:10:01 -- nvmf/common.sh@124 -- # return 0 00:17:10.850 01:10:01 -- nvmf/common.sh@477 -- # '[' -n 1062394 ']' 00:17:10.850 01:10:01 -- nvmf/common.sh@478 -- # killprocess 1062394 00:17:10.850 01:10:01 -- common/autotest_common.sh@936 -- # '[' -z 1062394 ']' 00:17:10.850 01:10:01 -- common/autotest_common.sh@940 -- # kill -0 1062394 00:17:10.850 01:10:01 -- common/autotest_common.sh@941 -- # uname 00:17:10.850 01:10:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:10.850 01:10:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1062394 00:17:10.850 01:10:01 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:10.850 01:10:01 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:10.850 01:10:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1062394' 00:17:10.850 killing process with pid 1062394 00:17:10.850 01:10:01 -- common/autotest_common.sh@955 -- # kill 1062394 00:17:10.850 01:10:01 -- common/autotest_common.sh@960 -- # wait 1062394 00:17:11.108 01:10:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:11.108 01:10:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:11.108 01:10:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:11.108 01:10:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:11.108 01:10:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:11.108 01:10:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:11.108 01:10:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:11.108 01:10:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.645 01:10:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:13.645 00:17:13.645 real 0m7.394s 00:17:13.645 user 0m13.734s 00:17:13.645 sys 0m2.664s 00:17:13.645 01:10:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:13.645 01:10:03 -- common/autotest_common.sh@10 -- # set +x 00:17:13.645 ************************************ 00:17:13.645 END TEST nvmf_bdevio_no_huge 00:17:13.645 ************************************ 00:17:13.645 01:10:03 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:13.645 01:10:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:13.645 01:10:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:13.645 01:10:03 -- common/autotest_common.sh@10 -- # set +x 00:17:13.645 ************************************ 00:17:13.645 START TEST nvmf_tls 00:17:13.645 ************************************ 00:17:13.645 01:10:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:13.645 * Looking for test storage... 00:17:13.645 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:13.645 01:10:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:13.645 01:10:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:13.645 01:10:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:13.645 01:10:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:13.645 01:10:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:13.645 01:10:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:13.645 01:10:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:13.645 01:10:03 -- scripts/common.sh@335 -- # IFS=.-: 00:17:13.645 01:10:03 -- scripts/common.sh@335 -- # read -ra ver1 00:17:13.645 01:10:03 -- scripts/common.sh@336 -- # IFS=.-: 00:17:13.645 01:10:03 -- scripts/common.sh@336 -- # read -ra ver2 00:17:13.645 01:10:03 -- scripts/common.sh@337 -- # local 'op=<' 00:17:13.645 01:10:03 -- scripts/common.sh@339 -- # ver1_l=2 00:17:13.645 01:10:03 -- scripts/common.sh@340 -- # ver2_l=1 00:17:13.645 01:10:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:13.645 01:10:03 -- scripts/common.sh@343 -- # case "$op" in 00:17:13.645 01:10:03 -- scripts/common.sh@344 -- # : 1 00:17:13.645 01:10:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:13.646 01:10:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:13.646 01:10:03 -- scripts/common.sh@364 -- # decimal 1 00:17:13.646 01:10:03 -- scripts/common.sh@352 -- # local d=1 00:17:13.646 01:10:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:13.646 01:10:03 -- scripts/common.sh@354 -- # echo 1 00:17:13.646 01:10:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:13.646 01:10:03 -- scripts/common.sh@365 -- # decimal 2 00:17:13.646 01:10:03 -- scripts/common.sh@352 -- # local d=2 00:17:13.646 01:10:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:13.646 01:10:03 -- scripts/common.sh@354 -- # echo 2 00:17:13.646 01:10:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:13.646 01:10:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:13.646 01:10:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:13.646 01:10:03 -- scripts/common.sh@367 -- # return 0 00:17:13.646 01:10:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:13.646 01:10:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:13.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.646 --rc genhtml_branch_coverage=1 00:17:13.646 --rc genhtml_function_coverage=1 00:17:13.646 --rc genhtml_legend=1 00:17:13.646 --rc geninfo_all_blocks=1 00:17:13.646 --rc geninfo_unexecuted_blocks=1 00:17:13.646 00:17:13.646 ' 00:17:13.646 01:10:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:13.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.646 --rc genhtml_branch_coverage=1 00:17:13.646 --rc genhtml_function_coverage=1 00:17:13.646 --rc genhtml_legend=1 00:17:13.646 --rc geninfo_all_blocks=1 00:17:13.646 --rc geninfo_unexecuted_blocks=1 00:17:13.646 00:17:13.646 ' 00:17:13.646 01:10:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:13.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.646 --rc genhtml_branch_coverage=1 00:17:13.646 --rc genhtml_function_coverage=1 00:17:13.646 --rc genhtml_legend=1 00:17:13.646 --rc geninfo_all_blocks=1 00:17:13.646 --rc geninfo_unexecuted_blocks=1 00:17:13.646 00:17:13.646 ' 00:17:13.646 01:10:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:13.646 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.646 --rc genhtml_branch_coverage=1 00:17:13.646 --rc genhtml_function_coverage=1 00:17:13.646 --rc genhtml_legend=1 00:17:13.646 --rc geninfo_all_blocks=1 00:17:13.646 --rc geninfo_unexecuted_blocks=1 00:17:13.646 00:17:13.646 ' 00:17:13.646 01:10:03 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:13.646 01:10:03 -- nvmf/common.sh@7 -- # uname -s 00:17:13.646 01:10:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:13.646 01:10:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:13.646 01:10:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:13.646 01:10:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:13.646 01:10:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:13.646 01:10:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:13.646 01:10:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:13.646 01:10:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:13.646 01:10:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:13.646 01:10:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:13.646 01:10:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.646 01:10:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.646 01:10:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:13.646 01:10:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:13.646 01:10:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:13.646 01:10:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:13.646 01:10:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:13.646 01:10:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:13.646 01:10:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:13.646 01:10:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.646 01:10:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.646 01:10:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.646 01:10:03 -- paths/export.sh@5 -- # export PATH 00:17:13.646 01:10:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.646 01:10:03 -- nvmf/common.sh@46 -- # : 0 00:17:13.646 01:10:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:13.646 01:10:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:13.646 01:10:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:13.646 01:10:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:13.646 01:10:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:13.646 01:10:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:13.646 01:10:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:13.646 01:10:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:13.646 01:10:03 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:13.646 01:10:03 -- target/tls.sh@71 -- # nvmftestinit 00:17:13.646 01:10:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:13.646 01:10:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:13.646 01:10:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:13.646 01:10:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:13.646 01:10:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:13.646 01:10:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:13.646 01:10:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:13.646 01:10:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.646 01:10:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:13.646 01:10:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:13.646 01:10:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:13.646 01:10:03 -- common/autotest_common.sh@10 -- # set +x 00:17:15.548 01:10:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:15.548 01:10:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:15.548 01:10:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:15.548 01:10:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:15.548 01:10:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:15.548 01:10:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:15.548 01:10:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:15.548 01:10:05 -- nvmf/common.sh@294 -- # net_devs=() 00:17:15.548 01:10:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:15.548 01:10:05 -- nvmf/common.sh@295 -- # e810=() 00:17:15.548 01:10:05 -- nvmf/common.sh@295 -- # local -ga e810 00:17:15.548 01:10:05 -- nvmf/common.sh@296 -- # x722=() 00:17:15.548 01:10:05 -- nvmf/common.sh@296 -- # local -ga x722 00:17:15.548 01:10:05 -- nvmf/common.sh@297 -- # mlx=() 00:17:15.548 01:10:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:15.548 01:10:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:15.548 01:10:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:15.548 01:10:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:15.548 01:10:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:15.548 01:10:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:15.548 01:10:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:15.548 01:10:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:15.548 01:10:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.548 01:10:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:15.548 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:15.548 01:10:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.548 01:10:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.549 01:10:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:15.549 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:15.549 01:10:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:15.549 01:10:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.549 01:10:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.549 01:10:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.549 01:10:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.549 01:10:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:15.549 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:15.549 01:10:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.549 01:10:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.549 01:10:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.549 01:10:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.549 01:10:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.549 01:10:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:15.549 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:15.549 01:10:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.549 01:10:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:15.549 01:10:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:15.549 01:10:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:15.549 01:10:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:15.549 01:10:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:15.549 01:10:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:15.549 01:10:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:15.549 01:10:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:15.549 01:10:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:15.549 01:10:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:15.549 01:10:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:15.549 01:10:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:15.549 01:10:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:15.549 01:10:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:15.549 01:10:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:15.549 01:10:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:15.549 01:10:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:15.549 01:10:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:15.549 01:10:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:15.549 01:10:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:15.549 01:10:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:15.808 01:10:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:15.808 01:10:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:15.808 01:10:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:15.808 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:15.808 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.317 ms 00:17:15.808 00:17:15.808 --- 10.0.0.2 ping statistics --- 00:17:15.808 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.808 rtt min/avg/max/mdev = 0.317/0.317/0.317/0.000 ms 00:17:15.808 01:10:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:15.808 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:15.808 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:17:15.808 00:17:15.808 --- 10.0.0.1 ping statistics --- 00:17:15.808 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.808 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:17:15.808 01:10:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:15.808 01:10:06 -- nvmf/common.sh@410 -- # return 0 00:17:15.808 01:10:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:15.808 01:10:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:15.808 01:10:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:15.808 01:10:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:15.808 01:10:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:15.808 01:10:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:15.808 01:10:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:15.808 01:10:06 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:15.808 01:10:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:15.808 01:10:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:15.808 01:10:06 -- common/autotest_common.sh@10 -- # set +x 00:17:15.808 01:10:06 -- nvmf/common.sh@469 -- # nvmfpid=1064717 00:17:15.808 01:10:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:15.808 01:10:06 -- nvmf/common.sh@470 -- # waitforlisten 1064717 00:17:15.808 01:10:06 -- common/autotest_common.sh@829 -- # '[' -z 1064717 ']' 00:17:15.808 01:10:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:15.808 01:10:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:15.808 01:10:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:15.808 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:15.808 01:10:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:15.808 01:10:06 -- common/autotest_common.sh@10 -- # set +x 00:17:15.808 [2024-11-26 01:10:06.199562] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.808 [2024-11-26 01:10:06.199646] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:15.808 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.808 [2024-11-26 01:10:06.265912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.068 [2024-11-26 01:10:06.373729] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:16.068 [2024-11-26 01:10:06.373875] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:16.068 [2024-11-26 01:10:06.373891] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:16.068 [2024-11-26 01:10:06.373904] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:16.068 [2024-11-26 01:10:06.373943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:16.068 01:10:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:16.068 01:10:06 -- common/autotest_common.sh@862 -- # return 0 00:17:16.068 01:10:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:16.068 01:10:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:16.068 01:10:06 -- common/autotest_common.sh@10 -- # set +x 00:17:16.068 01:10:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:16.068 01:10:06 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:16.068 01:10:06 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:16.326 true 00:17:16.326 01:10:06 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:16.326 01:10:06 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:16.585 01:10:07 -- target/tls.sh@82 -- # version=0 00:17:16.585 01:10:07 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:16.585 01:10:07 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:16.844 01:10:07 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:16.844 01:10:07 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:17.103 01:10:07 -- target/tls.sh@90 -- # version=13 00:17:17.103 01:10:07 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:17.103 01:10:07 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:17.361 01:10:07 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:17.361 01:10:07 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:17.619 01:10:08 -- target/tls.sh@98 -- # version=7 00:17:17.619 01:10:08 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:17.620 01:10:08 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:17.620 01:10:08 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:17.878 01:10:08 -- target/tls.sh@105 -- # ktls=false 00:17:17.878 01:10:08 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:17.878 01:10:08 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:18.136 01:10:08 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:18.136 01:10:08 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:18.395 01:10:08 -- target/tls.sh@113 -- # ktls=true 00:17:18.395 01:10:08 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:18.395 01:10:08 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:18.654 01:10:09 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:18.654 01:10:09 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:18.911 01:10:09 -- target/tls.sh@121 -- # ktls=false 00:17:18.911 01:10:09 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:18.911 01:10:09 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:18.911 01:10:09 -- target/tls.sh@49 -- # local key hash crc 00:17:18.911 01:10:09 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:18.911 01:10:09 -- target/tls.sh@51 -- # hash=01 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # gzip -1 -c 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # tail -c8 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # head -c 4 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # crc='p$H�' 00:17:18.911 01:10:09 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:18.911 01:10:09 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:18.911 01:10:09 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:18.911 01:10:09 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:18.911 01:10:09 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:18.911 01:10:09 -- target/tls.sh@49 -- # local key hash crc 00:17:18.911 01:10:09 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:18.911 01:10:09 -- target/tls.sh@51 -- # hash=01 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # gzip -1 -c 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # tail -c8 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # head -c 4 00:17:18.911 01:10:09 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:18.911 01:10:09 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:18.911 01:10:09 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:18.911 01:10:09 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:18.911 01:10:09 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:18.911 01:10:09 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:18.911 01:10:09 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:18.912 01:10:09 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:18.912 01:10:09 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:18.912 01:10:09 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:18.912 01:10:09 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:18.912 01:10:09 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:19.170 01:10:09 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:19.737 01:10:10 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.737 01:10:10 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:19.737 01:10:10 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:19.995 [2024-11-26 01:10:10.303820] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:19.995 01:10:10 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:20.253 01:10:10 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:20.511 [2024-11-26 01:10:10.897414] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:20.511 [2024-11-26 01:10:10.897721] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:20.511 01:10:10 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:20.769 malloc0 00:17:20.769 01:10:11 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:21.026 01:10:11 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.284 01:10:11 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:21.284 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.482 Initializing NVMe Controllers 00:17:33.482 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:33.482 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:33.482 Initialization complete. Launching workers. 00:17:33.482 ======================================================== 00:17:33.482 Latency(us) 00:17:33.482 Device Information : IOPS MiB/s Average min max 00:17:33.482 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7700.46 30.08 8313.94 1293.98 11421.56 00:17:33.482 ======================================================== 00:17:33.482 Total : 7700.46 30.08 8313.94 1293.98 11421.56 00:17:33.482 00:17:33.482 01:10:21 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:33.482 01:10:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:33.482 01:10:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:33.482 01:10:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:33.482 01:10:21 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:33.482 01:10:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:33.482 01:10:21 -- target/tls.sh@28 -- # bdevperf_pid=1066676 00:17:33.482 01:10:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:33.482 01:10:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:33.482 01:10:21 -- target/tls.sh@31 -- # waitforlisten 1066676 /var/tmp/bdevperf.sock 00:17:33.482 01:10:21 -- common/autotest_common.sh@829 -- # '[' -z 1066676 ']' 00:17:33.482 01:10:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:33.482 01:10:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.482 01:10:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:33.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:33.482 01:10:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.482 01:10:21 -- common/autotest_common.sh@10 -- # set +x 00:17:33.482 [2024-11-26 01:10:21.894236] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:33.482 [2024-11-26 01:10:21.894322] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1066676 ] 00:17:33.482 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.482 [2024-11-26 01:10:21.950683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:33.482 [2024-11-26 01:10:22.053303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:33.482 01:10:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:33.482 01:10:22 -- common/autotest_common.sh@862 -- # return 0 00:17:33.482 01:10:22 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:33.482 [2024-11-26 01:10:23.067918] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:33.482 TLSTESTn1 00:17:33.482 01:10:23 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:33.482 Running I/O for 10 seconds... 00:17:43.450 00:17:43.450 Latency(us) 00:17:43.450 [2024-11-26T00:10:33.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:43.450 [2024-11-26T00:10:33.985Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:43.450 Verification LBA range: start 0x0 length 0x2000 00:17:43.450 TLSTESTn1 : 10.02 4605.23 17.99 0.00 0.00 27754.98 4951.61 42913.94 00:17:43.450 [2024-11-26T00:10:33.985Z] =================================================================================================================== 00:17:43.450 [2024-11-26T00:10:33.985Z] Total : 4605.23 17.99 0.00 0.00 27754.98 4951.61 42913.94 00:17:43.450 0 00:17:43.450 01:10:33 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:43.450 01:10:33 -- target/tls.sh@45 -- # killprocess 1066676 00:17:43.450 01:10:33 -- common/autotest_common.sh@936 -- # '[' -z 1066676 ']' 00:17:43.450 01:10:33 -- common/autotest_common.sh@940 -- # kill -0 1066676 00:17:43.450 01:10:33 -- common/autotest_common.sh@941 -- # uname 00:17:43.450 01:10:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:43.450 01:10:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1066676 00:17:43.450 01:10:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:43.450 01:10:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:43.450 01:10:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1066676' 00:17:43.450 killing process with pid 1066676 00:17:43.450 01:10:33 -- common/autotest_common.sh@955 -- # kill 1066676 00:17:43.450 Received shutdown signal, test time was about 10.000000 seconds 00:17:43.450 00:17:43.450 Latency(us) 00:17:43.450 [2024-11-26T00:10:33.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:43.450 [2024-11-26T00:10:33.985Z] =================================================================================================================== 00:17:43.450 [2024-11-26T00:10:33.985Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:43.450 01:10:33 -- common/autotest_common.sh@960 -- # wait 1066676 00:17:43.450 01:10:33 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:43.450 01:10:33 -- common/autotest_common.sh@650 -- # local es=0 00:17:43.450 01:10:33 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:43.450 01:10:33 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:43.450 01:10:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:43.450 01:10:33 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:43.450 01:10:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:43.450 01:10:33 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:43.450 01:10:33 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:43.450 01:10:33 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:43.450 01:10:33 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:43.450 01:10:33 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:43.450 01:10:33 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:43.450 01:10:33 -- target/tls.sh@28 -- # bdevperf_pid=1068050 00:17:43.450 01:10:33 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:43.450 01:10:33 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:43.450 01:10:33 -- target/tls.sh@31 -- # waitforlisten 1068050 /var/tmp/bdevperf.sock 00:17:43.450 01:10:33 -- common/autotest_common.sh@829 -- # '[' -z 1068050 ']' 00:17:43.451 01:10:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:43.451 01:10:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:43.451 01:10:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:43.451 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:43.451 01:10:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:43.451 01:10:33 -- common/autotest_common.sh@10 -- # set +x 00:17:43.451 [2024-11-26 01:10:33.674919] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:43.451 [2024-11-26 01:10:33.675007] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1068050 ] 00:17:43.451 EAL: No free 2048 kB hugepages reported on node 1 00:17:43.451 [2024-11-26 01:10:33.733719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:43.451 [2024-11-26 01:10:33.837087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:44.384 01:10:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:44.384 01:10:34 -- common/autotest_common.sh@862 -- # return 0 00:17:44.384 01:10:34 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:44.642 [2024-11-26 01:10:34.923377] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:44.642 [2024-11-26 01:10:34.931651] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:44.642 [2024-11-26 01:10:34.932301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x246c1f0 (107): Transport endpoint is not connected 00:17:44.642 [2024-11-26 01:10:34.933289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x246c1f0 (9): Bad file descriptor 00:17:44.642 [2024-11-26 01:10:34.934287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:44.642 [2024-11-26 01:10:34.934306] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:44.642 [2024-11-26 01:10:34.934319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:44.642 request: 00:17:44.642 { 00:17:44.642 "name": "TLSTEST", 00:17:44.642 "trtype": "tcp", 00:17:44.642 "traddr": "10.0.0.2", 00:17:44.642 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:44.642 "adrfam": "ipv4", 00:17:44.642 "trsvcid": "4420", 00:17:44.642 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:44.642 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:44.642 "method": "bdev_nvme_attach_controller", 00:17:44.642 "req_id": 1 00:17:44.642 } 00:17:44.642 Got JSON-RPC error response 00:17:44.642 response: 00:17:44.642 { 00:17:44.642 "code": -32602, 00:17:44.642 "message": "Invalid parameters" 00:17:44.642 } 00:17:44.642 01:10:34 -- target/tls.sh@36 -- # killprocess 1068050 00:17:44.642 01:10:34 -- common/autotest_common.sh@936 -- # '[' -z 1068050 ']' 00:17:44.642 01:10:34 -- common/autotest_common.sh@940 -- # kill -0 1068050 00:17:44.642 01:10:34 -- common/autotest_common.sh@941 -- # uname 00:17:44.642 01:10:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:44.642 01:10:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068050 00:17:44.642 01:10:34 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:44.642 01:10:34 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:44.642 01:10:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068050' 00:17:44.642 killing process with pid 1068050 00:17:44.642 01:10:34 -- common/autotest_common.sh@955 -- # kill 1068050 00:17:44.642 Received shutdown signal, test time was about 10.000000 seconds 00:17:44.642 00:17:44.642 Latency(us) 00:17:44.642 [2024-11-26T00:10:35.177Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:44.642 [2024-11-26T00:10:35.177Z] =================================================================================================================== 00:17:44.642 [2024-11-26T00:10:35.177Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:44.642 01:10:34 -- common/autotest_common.sh@960 -- # wait 1068050 00:17:44.900 01:10:35 -- target/tls.sh@37 -- # return 1 00:17:44.900 01:10:35 -- common/autotest_common.sh@653 -- # es=1 00:17:44.900 01:10:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:44.900 01:10:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:44.900 01:10:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:44.900 01:10:35 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.900 01:10:35 -- common/autotest_common.sh@650 -- # local es=0 00:17:44.900 01:10:35 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.900 01:10:35 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:44.901 01:10:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.901 01:10:35 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:44.901 01:10:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:44.901 01:10:35 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:44.901 01:10:35 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:44.901 01:10:35 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:44.901 01:10:35 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:44.901 01:10:35 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:44.901 01:10:35 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:44.901 01:10:35 -- target/tls.sh@28 -- # bdevperf_pid=1068315 00:17:44.901 01:10:35 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:44.901 01:10:35 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:44.901 01:10:35 -- target/tls.sh@31 -- # waitforlisten 1068315 /var/tmp/bdevperf.sock 00:17:44.901 01:10:35 -- common/autotest_common.sh@829 -- # '[' -z 1068315 ']' 00:17:44.901 01:10:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:44.901 01:10:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.901 01:10:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:44.901 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:44.901 01:10:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.901 01:10:35 -- common/autotest_common.sh@10 -- # set +x 00:17:44.901 [2024-11-26 01:10:35.297098] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.901 [2024-11-26 01:10:35.297182] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1068315 ] 00:17:44.901 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.901 [2024-11-26 01:10:35.354131] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:45.159 [2024-11-26 01:10:35.456478] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:46.093 01:10:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:46.093 01:10:36 -- common/autotest_common.sh@862 -- # return 0 00:17:46.093 01:10:36 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:46.093 [2024-11-26 01:10:36.492209] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:46.093 [2024-11-26 01:10:36.497409] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:46.093 [2024-11-26 01:10:36.497442] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:46.093 [2024-11-26 01:10:36.497514] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:46.093 [2024-11-26 01:10:36.497976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbdf1f0 (107): Transport endpoint is not connected 00:17:46.093 [2024-11-26 01:10:36.498953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbdf1f0 (9): Bad file descriptor 00:17:46.093 [2024-11-26 01:10:36.499952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:46.093 [2024-11-26 01:10:36.499972] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:46.093 [2024-11-26 01:10:36.499985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:46.093 request: 00:17:46.093 { 00:17:46.093 "name": "TLSTEST", 00:17:46.093 "trtype": "tcp", 00:17:46.093 "traddr": "10.0.0.2", 00:17:46.093 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:46.093 "adrfam": "ipv4", 00:17:46.093 "trsvcid": "4420", 00:17:46.093 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:46.093 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:46.093 "method": "bdev_nvme_attach_controller", 00:17:46.093 "req_id": 1 00:17:46.093 } 00:17:46.093 Got JSON-RPC error response 00:17:46.093 response: 00:17:46.093 { 00:17:46.093 "code": -32602, 00:17:46.093 "message": "Invalid parameters" 00:17:46.093 } 00:17:46.093 01:10:36 -- target/tls.sh@36 -- # killprocess 1068315 00:17:46.093 01:10:36 -- common/autotest_common.sh@936 -- # '[' -z 1068315 ']' 00:17:46.093 01:10:36 -- common/autotest_common.sh@940 -- # kill -0 1068315 00:17:46.093 01:10:36 -- common/autotest_common.sh@941 -- # uname 00:17:46.093 01:10:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:46.093 01:10:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068315 00:17:46.093 01:10:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:46.093 01:10:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:46.093 01:10:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068315' 00:17:46.093 killing process with pid 1068315 00:17:46.093 01:10:36 -- common/autotest_common.sh@955 -- # kill 1068315 00:17:46.093 Received shutdown signal, test time was about 10.000000 seconds 00:17:46.093 00:17:46.093 Latency(us) 00:17:46.093 [2024-11-26T00:10:36.628Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:46.093 [2024-11-26T00:10:36.628Z] =================================================================================================================== 00:17:46.093 [2024-11-26T00:10:36.628Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:46.093 01:10:36 -- common/autotest_common.sh@960 -- # wait 1068315 00:17:46.351 01:10:36 -- target/tls.sh@37 -- # return 1 00:17:46.351 01:10:36 -- common/autotest_common.sh@653 -- # es=1 00:17:46.351 01:10:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:46.351 01:10:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:46.351 01:10:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:46.351 01:10:36 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:46.351 01:10:36 -- common/autotest_common.sh@650 -- # local es=0 00:17:46.351 01:10:36 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:46.352 01:10:36 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:46.352 01:10:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:46.352 01:10:36 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:46.352 01:10:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:46.352 01:10:36 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:46.352 01:10:36 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:46.352 01:10:36 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:46.352 01:10:36 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:46.352 01:10:36 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:46.352 01:10:36 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:46.352 01:10:36 -- target/tls.sh@28 -- # bdevperf_pid=1068474 00:17:46.352 01:10:36 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:46.352 01:10:36 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:46.352 01:10:36 -- target/tls.sh@31 -- # waitforlisten 1068474 /var/tmp/bdevperf.sock 00:17:46.352 01:10:36 -- common/autotest_common.sh@829 -- # '[' -z 1068474 ']' 00:17:46.352 01:10:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:46.352 01:10:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:46.352 01:10:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:46.352 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:46.352 01:10:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:46.352 01:10:36 -- common/autotest_common.sh@10 -- # set +x 00:17:46.352 [2024-11-26 01:10:36.851565] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:46.352 [2024-11-26 01:10:36.851652] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1068474 ] 00:17:46.352 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.610 [2024-11-26 01:10:36.909613] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.610 [2024-11-26 01:10:37.009716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.541 01:10:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.541 01:10:37 -- common/autotest_common.sh@862 -- # return 0 00:17:47.541 01:10:37 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:47.541 [2024-11-26 01:10:38.033226] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:47.541 [2024-11-26 01:10:38.039632] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:47.541 [2024-11-26 01:10:38.039662] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:47.541 [2024-11-26 01:10:38.039724] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:47.541 [2024-11-26 01:10:38.040051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xacd1f0 (107): Transport endpoint is not connected 00:17:47.541 [2024-11-26 01:10:38.041027] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xacd1f0 (9): Bad file descriptor 00:17:47.541 [2024-11-26 01:10:38.042025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:47.541 [2024-11-26 01:10:38.042046] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:47.541 [2024-11-26 01:10:38.042059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:47.541 request: 00:17:47.541 { 00:17:47.541 "name": "TLSTEST", 00:17:47.541 "trtype": "tcp", 00:17:47.541 "traddr": "10.0.0.2", 00:17:47.541 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:47.541 "adrfam": "ipv4", 00:17:47.541 "trsvcid": "4420", 00:17:47.541 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:47.541 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:47.541 "method": "bdev_nvme_attach_controller", 00:17:47.541 "req_id": 1 00:17:47.541 } 00:17:47.541 Got JSON-RPC error response 00:17:47.541 response: 00:17:47.541 { 00:17:47.541 "code": -32602, 00:17:47.541 "message": "Invalid parameters" 00:17:47.541 } 00:17:47.541 01:10:38 -- target/tls.sh@36 -- # killprocess 1068474 00:17:47.541 01:10:38 -- common/autotest_common.sh@936 -- # '[' -z 1068474 ']' 00:17:47.541 01:10:38 -- common/autotest_common.sh@940 -- # kill -0 1068474 00:17:47.541 01:10:38 -- common/autotest_common.sh@941 -- # uname 00:17:47.541 01:10:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:47.541 01:10:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068474 00:17:47.798 01:10:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:47.798 01:10:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:47.798 01:10:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068474' 00:17:47.798 killing process with pid 1068474 00:17:47.798 01:10:38 -- common/autotest_common.sh@955 -- # kill 1068474 00:17:47.798 Received shutdown signal, test time was about 10.000000 seconds 00:17:47.798 00:17:47.798 Latency(us) 00:17:47.798 [2024-11-26T00:10:38.333Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:47.798 [2024-11-26T00:10:38.333Z] =================================================================================================================== 00:17:47.798 [2024-11-26T00:10:38.333Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:47.798 01:10:38 -- common/autotest_common.sh@960 -- # wait 1068474 00:17:48.055 01:10:38 -- target/tls.sh@37 -- # return 1 00:17:48.055 01:10:38 -- common/autotest_common.sh@653 -- # es=1 00:17:48.055 01:10:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:48.055 01:10:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:48.055 01:10:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:48.055 01:10:38 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:48.055 01:10:38 -- common/autotest_common.sh@650 -- # local es=0 00:17:48.055 01:10:38 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:48.055 01:10:38 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:48.055 01:10:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:48.055 01:10:38 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:48.055 01:10:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:48.055 01:10:38 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:48.055 01:10:38 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:48.055 01:10:38 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:48.055 01:10:38 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:48.055 01:10:38 -- target/tls.sh@23 -- # psk= 00:17:48.055 01:10:38 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:48.055 01:10:38 -- target/tls.sh@28 -- # bdevperf_pid=1068740 00:17:48.055 01:10:38 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:48.055 01:10:38 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:48.055 01:10:38 -- target/tls.sh@31 -- # waitforlisten 1068740 /var/tmp/bdevperf.sock 00:17:48.055 01:10:38 -- common/autotest_common.sh@829 -- # '[' -z 1068740 ']' 00:17:48.055 01:10:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:48.055 01:10:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:48.055 01:10:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:48.055 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:48.055 01:10:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:48.055 01:10:38 -- common/autotest_common.sh@10 -- # set +x 00:17:48.055 [2024-11-26 01:10:38.395763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:48.055 [2024-11-26 01:10:38.395850] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1068740 ] 00:17:48.055 EAL: No free 2048 kB hugepages reported on node 1 00:17:48.055 [2024-11-26 01:10:38.454539] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:48.055 [2024-11-26 01:10:38.556239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:48.983 01:10:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:48.983 01:10:39 -- common/autotest_common.sh@862 -- # return 0 00:17:48.983 01:10:39 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:49.240 [2024-11-26 01:10:39.593774] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:49.240 [2024-11-26 01:10:39.595425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x241d050 (9): Bad file descriptor 00:17:49.240 [2024-11-26 01:10:39.596420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:49.240 [2024-11-26 01:10:39.596441] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:49.240 [2024-11-26 01:10:39.596454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:49.240 request: 00:17:49.240 { 00:17:49.240 "name": "TLSTEST", 00:17:49.240 "trtype": "tcp", 00:17:49.240 "traddr": "10.0.0.2", 00:17:49.240 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:49.240 "adrfam": "ipv4", 00:17:49.240 "trsvcid": "4420", 00:17:49.240 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:49.240 "method": "bdev_nvme_attach_controller", 00:17:49.240 "req_id": 1 00:17:49.240 } 00:17:49.240 Got JSON-RPC error response 00:17:49.240 response: 00:17:49.240 { 00:17:49.240 "code": -32602, 00:17:49.240 "message": "Invalid parameters" 00:17:49.240 } 00:17:49.240 01:10:39 -- target/tls.sh@36 -- # killprocess 1068740 00:17:49.240 01:10:39 -- common/autotest_common.sh@936 -- # '[' -z 1068740 ']' 00:17:49.240 01:10:39 -- common/autotest_common.sh@940 -- # kill -0 1068740 00:17:49.240 01:10:39 -- common/autotest_common.sh@941 -- # uname 00:17:49.240 01:10:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.240 01:10:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068740 00:17:49.240 01:10:39 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:49.240 01:10:39 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:49.240 01:10:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068740' 00:17:49.240 killing process with pid 1068740 00:17:49.240 01:10:39 -- common/autotest_common.sh@955 -- # kill 1068740 00:17:49.240 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.240 00:17:49.240 Latency(us) 00:17:49.240 [2024-11-26T00:10:39.775Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.240 [2024-11-26T00:10:39.775Z] =================================================================================================================== 00:17:49.240 [2024-11-26T00:10:39.775Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:49.240 01:10:39 -- common/autotest_common.sh@960 -- # wait 1068740 00:17:49.497 01:10:39 -- target/tls.sh@37 -- # return 1 00:17:49.497 01:10:39 -- common/autotest_common.sh@653 -- # es=1 00:17:49.497 01:10:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:49.497 01:10:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:49.497 01:10:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:49.497 01:10:39 -- target/tls.sh@167 -- # killprocess 1064717 00:17:49.497 01:10:39 -- common/autotest_common.sh@936 -- # '[' -z 1064717 ']' 00:17:49.497 01:10:39 -- common/autotest_common.sh@940 -- # kill -0 1064717 00:17:49.497 01:10:39 -- common/autotest_common.sh@941 -- # uname 00:17:49.497 01:10:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.497 01:10:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1064717 00:17:49.497 01:10:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:49.497 01:10:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:49.497 01:10:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1064717' 00:17:49.497 killing process with pid 1064717 00:17:49.497 01:10:39 -- common/autotest_common.sh@955 -- # kill 1064717 00:17:49.497 01:10:39 -- common/autotest_common.sh@960 -- # wait 1064717 00:17:49.754 01:10:40 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:49.754 01:10:40 -- target/tls.sh@49 -- # local key hash crc 00:17:49.754 01:10:40 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:49.754 01:10:40 -- target/tls.sh@51 -- # hash=02 00:17:49.754 01:10:40 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:49.754 01:10:40 -- target/tls.sh@52 -- # gzip -1 -c 00:17:49.754 01:10:40 -- target/tls.sh@52 -- # tail -c8 00:17:49.754 01:10:40 -- target/tls.sh@52 -- # head -c 4 00:17:49.754 01:10:40 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:49.754 01:10:40 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:49.754 01:10:40 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:49.754 01:10:40 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:49.754 01:10:40 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:49.754 01:10:40 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:49.754 01:10:40 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:49.754 01:10:40 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:49.754 01:10:40 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:49.754 01:10:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:49.754 01:10:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:49.754 01:10:40 -- common/autotest_common.sh@10 -- # set +x 00:17:49.754 01:10:40 -- nvmf/common.sh@469 -- # nvmfpid=1068914 00:17:49.754 01:10:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:49.754 01:10:40 -- nvmf/common.sh@470 -- # waitforlisten 1068914 00:17:49.754 01:10:40 -- common/autotest_common.sh@829 -- # '[' -z 1068914 ']' 00:17:49.754 01:10:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:49.754 01:10:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:49.754 01:10:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:49.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:49.754 01:10:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:49.754 01:10:40 -- common/autotest_common.sh@10 -- # set +x 00:17:50.011 [2024-11-26 01:10:40.309962] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:50.011 [2024-11-26 01:10:40.310069] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:50.011 EAL: No free 2048 kB hugepages reported on node 1 00:17:50.011 [2024-11-26 01:10:40.378654] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:50.012 [2024-11-26 01:10:40.497094] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:50.012 [2024-11-26 01:10:40.497230] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:50.012 [2024-11-26 01:10:40.497248] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:50.012 [2024-11-26 01:10:40.497260] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:50.012 [2024-11-26 01:10:40.497286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:51.004 01:10:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:51.004 01:10:41 -- common/autotest_common.sh@862 -- # return 0 00:17:51.004 01:10:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:51.004 01:10:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:51.004 01:10:41 -- common/autotest_common.sh@10 -- # set +x 00:17:51.004 01:10:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:51.004 01:10:41 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:51.004 01:10:41 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:51.004 01:10:41 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:51.285 [2024-11-26 01:10:41.651654] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:51.285 01:10:41 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:51.543 01:10:41 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:51.801 [2024-11-26 01:10:42.221203] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:51.801 [2024-11-26 01:10:42.221487] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:51.801 01:10:42 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:52.059 malloc0 00:17:52.059 01:10:42 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:52.317 01:10:42 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:52.574 01:10:43 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:52.575 01:10:43 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:52.575 01:10:43 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:52.575 01:10:43 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:52.575 01:10:43 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:52.575 01:10:43 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:52.575 01:10:43 -- target/tls.sh@28 -- # bdevperf_pid=1069342 00:17:52.575 01:10:43 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:52.575 01:10:43 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:52.575 01:10:43 -- target/tls.sh@31 -- # waitforlisten 1069342 /var/tmp/bdevperf.sock 00:17:52.575 01:10:43 -- common/autotest_common.sh@829 -- # '[' -z 1069342 ']' 00:17:52.575 01:10:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:52.575 01:10:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:52.575 01:10:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:52.575 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:52.575 01:10:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:52.575 01:10:43 -- common/autotest_common.sh@10 -- # set +x 00:17:52.575 [2024-11-26 01:10:43.088902] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:52.575 [2024-11-26 01:10:43.088973] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1069342 ] 00:17:52.833 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.833 [2024-11-26 01:10:43.145531] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.833 [2024-11-26 01:10:43.247618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:53.766 01:10:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:53.766 01:10:44 -- common/autotest_common.sh@862 -- # return 0 00:17:53.766 01:10:44 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:54.024 [2024-11-26 01:10:44.379015] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:54.024 TLSTESTn1 00:17:54.024 01:10:44 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:54.282 Running I/O for 10 seconds... 00:18:04.252 00:18:04.252 Latency(us) 00:18:04.252 [2024-11-26T00:10:54.787Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:04.252 [2024-11-26T00:10:54.787Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:04.252 Verification LBA range: start 0x0 length 0x2000 00:18:04.252 TLSTESTn1 : 10.01 3801.88 14.85 0.00 0.00 33621.82 5024.43 41554.68 00:18:04.252 [2024-11-26T00:10:54.787Z] =================================================================================================================== 00:18:04.252 [2024-11-26T00:10:54.787Z] Total : 3801.88 14.85 0.00 0.00 33621.82 5024.43 41554.68 00:18:04.252 0 00:18:04.252 01:10:54 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:04.252 01:10:54 -- target/tls.sh@45 -- # killprocess 1069342 00:18:04.252 01:10:54 -- common/autotest_common.sh@936 -- # '[' -z 1069342 ']' 00:18:04.252 01:10:54 -- common/autotest_common.sh@940 -- # kill -0 1069342 00:18:04.252 01:10:54 -- common/autotest_common.sh@941 -- # uname 00:18:04.252 01:10:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:04.252 01:10:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1069342 00:18:04.252 01:10:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:04.252 01:10:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:04.252 01:10:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1069342' 00:18:04.252 killing process with pid 1069342 00:18:04.252 01:10:54 -- common/autotest_common.sh@955 -- # kill 1069342 00:18:04.252 Received shutdown signal, test time was about 10.000000 seconds 00:18:04.252 00:18:04.252 Latency(us) 00:18:04.252 [2024-11-26T00:10:54.787Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:04.252 [2024-11-26T00:10:54.787Z] =================================================================================================================== 00:18:04.252 [2024-11-26T00:10:54.787Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:04.252 01:10:54 -- common/autotest_common.sh@960 -- # wait 1069342 00:18:04.510 01:10:54 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.510 01:10:54 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.510 01:10:54 -- common/autotest_common.sh@650 -- # local es=0 00:18:04.510 01:10:54 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.510 01:10:54 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:04.510 01:10:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:04.510 01:10:54 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:04.510 01:10:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:04.510 01:10:54 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:04.510 01:10:54 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:04.510 01:10:54 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:04.510 01:10:54 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:04.510 01:10:54 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:04.510 01:10:54 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:04.510 01:10:54 -- target/tls.sh@28 -- # bdevperf_pid=1070714 00:18:04.510 01:10:54 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:04.510 01:10:54 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:04.510 01:10:54 -- target/tls.sh@31 -- # waitforlisten 1070714 /var/tmp/bdevperf.sock 00:18:04.510 01:10:54 -- common/autotest_common.sh@829 -- # '[' -z 1070714 ']' 00:18:04.510 01:10:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:04.510 01:10:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:04.510 01:10:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:04.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:04.510 01:10:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:04.510 01:10:54 -- common/autotest_common.sh@10 -- # set +x 00:18:04.510 [2024-11-26 01:10:54.961196] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:04.510 [2024-11-26 01:10:54.961292] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1070714 ] 00:18:04.510 EAL: No free 2048 kB hugepages reported on node 1 00:18:04.510 [2024-11-26 01:10:55.022532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:04.768 [2024-11-26 01:10:55.126577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:05.701 01:10:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:05.701 01:10:55 -- common/autotest_common.sh@862 -- # return 0 00:18:05.701 01:10:55 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:05.959 [2024-11-26 01:10:56.247103] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:05.959 [2024-11-26 01:10:56.247174] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:05.959 request: 00:18:05.959 { 00:18:05.959 "name": "TLSTEST", 00:18:05.959 "trtype": "tcp", 00:18:05.959 "traddr": "10.0.0.2", 00:18:05.959 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:05.959 "adrfam": "ipv4", 00:18:05.959 "trsvcid": "4420", 00:18:05.959 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:05.959 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:05.959 "method": "bdev_nvme_attach_controller", 00:18:05.959 "req_id": 1 00:18:05.959 } 00:18:05.959 Got JSON-RPC error response 00:18:05.959 response: 00:18:05.959 { 00:18:05.959 "code": -22, 00:18:05.959 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:05.959 } 00:18:05.959 01:10:56 -- target/tls.sh@36 -- # killprocess 1070714 00:18:05.959 01:10:56 -- common/autotest_common.sh@936 -- # '[' -z 1070714 ']' 00:18:05.959 01:10:56 -- common/autotest_common.sh@940 -- # kill -0 1070714 00:18:05.959 01:10:56 -- common/autotest_common.sh@941 -- # uname 00:18:05.959 01:10:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:05.959 01:10:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1070714 00:18:05.959 01:10:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:05.959 01:10:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:05.959 01:10:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1070714' 00:18:05.959 killing process with pid 1070714 00:18:05.959 01:10:56 -- common/autotest_common.sh@955 -- # kill 1070714 00:18:05.959 Received shutdown signal, test time was about 10.000000 seconds 00:18:05.959 00:18:05.959 Latency(us) 00:18:05.959 [2024-11-26T00:10:56.494Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:05.959 [2024-11-26T00:10:56.494Z] =================================================================================================================== 00:18:05.959 [2024-11-26T00:10:56.494Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:05.959 01:10:56 -- common/autotest_common.sh@960 -- # wait 1070714 00:18:06.218 01:10:56 -- target/tls.sh@37 -- # return 1 00:18:06.218 01:10:56 -- common/autotest_common.sh@653 -- # es=1 00:18:06.218 01:10:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:06.218 01:10:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:06.218 01:10:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:06.218 01:10:56 -- target/tls.sh@183 -- # killprocess 1068914 00:18:06.218 01:10:56 -- common/autotest_common.sh@936 -- # '[' -z 1068914 ']' 00:18:06.218 01:10:56 -- common/autotest_common.sh@940 -- # kill -0 1068914 00:18:06.218 01:10:56 -- common/autotest_common.sh@941 -- # uname 00:18:06.218 01:10:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:06.218 01:10:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1068914 00:18:06.218 01:10:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:06.218 01:10:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:06.218 01:10:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1068914' 00:18:06.218 killing process with pid 1068914 00:18:06.218 01:10:56 -- common/autotest_common.sh@955 -- # kill 1068914 00:18:06.218 01:10:56 -- common/autotest_common.sh@960 -- # wait 1068914 00:18:06.476 01:10:56 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:06.476 01:10:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:06.476 01:10:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:06.476 01:10:56 -- common/autotest_common.sh@10 -- # set +x 00:18:06.476 01:10:56 -- nvmf/common.sh@469 -- # nvmfpid=1070998 00:18:06.476 01:10:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:06.476 01:10:56 -- nvmf/common.sh@470 -- # waitforlisten 1070998 00:18:06.476 01:10:56 -- common/autotest_common.sh@829 -- # '[' -z 1070998 ']' 00:18:06.476 01:10:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:06.476 01:10:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.476 01:10:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:06.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:06.476 01:10:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.476 01:10:56 -- common/autotest_common.sh@10 -- # set +x 00:18:06.476 [2024-11-26 01:10:56.955702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:06.476 [2024-11-26 01:10:56.955786] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:06.476 EAL: No free 2048 kB hugepages reported on node 1 00:18:06.735 [2024-11-26 01:10:57.030564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:06.735 [2024-11-26 01:10:57.137345] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:06.735 [2024-11-26 01:10:57.137503] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:06.735 [2024-11-26 01:10:57.137519] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:06.735 [2024-11-26 01:10:57.137530] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:06.735 [2024-11-26 01:10:57.137560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:07.669 01:10:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.669 01:10:57 -- common/autotest_common.sh@862 -- # return 0 00:18:07.669 01:10:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:07.669 01:10:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:07.669 01:10:57 -- common/autotest_common.sh@10 -- # set +x 00:18:07.669 01:10:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:07.669 01:10:57 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.669 01:10:57 -- common/autotest_common.sh@650 -- # local es=0 00:18:07.669 01:10:57 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.669 01:10:57 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:07.669 01:10:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:07.669 01:10:57 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:07.669 01:10:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:07.669 01:10:57 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.669 01:10:57 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:07.669 01:10:57 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:07.669 [2024-11-26 01:10:58.161448] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:07.669 01:10:58 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:07.928 01:10:58 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:08.187 [2024-11-26 01:10:58.662855] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:08.187 [2024-11-26 01:10:58.663137] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:08.187 01:10:58 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:08.754 malloc0 00:18:08.754 01:10:58 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:08.754 01:10:59 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.012 [2024-11-26 01:10:59.469633] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:09.012 [2024-11-26 01:10:59.469677] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:09.012 [2024-11-26 01:10:59.469711] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:09.012 request: 00:18:09.012 { 00:18:09.012 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:09.012 "host": "nqn.2016-06.io.spdk:host1", 00:18:09.012 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:09.012 "method": "nvmf_subsystem_add_host", 00:18:09.012 "req_id": 1 00:18:09.012 } 00:18:09.012 Got JSON-RPC error response 00:18:09.012 response: 00:18:09.012 { 00:18:09.012 "code": -32603, 00:18:09.012 "message": "Internal error" 00:18:09.012 } 00:18:09.012 01:10:59 -- common/autotest_common.sh@653 -- # es=1 00:18:09.012 01:10:59 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:09.012 01:10:59 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:09.012 01:10:59 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:09.012 01:10:59 -- target/tls.sh@189 -- # killprocess 1070998 00:18:09.012 01:10:59 -- common/autotest_common.sh@936 -- # '[' -z 1070998 ']' 00:18:09.012 01:10:59 -- common/autotest_common.sh@940 -- # kill -0 1070998 00:18:09.012 01:10:59 -- common/autotest_common.sh@941 -- # uname 00:18:09.012 01:10:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:09.012 01:10:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1070998 00:18:09.012 01:10:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:09.012 01:10:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:09.012 01:10:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1070998' 00:18:09.012 killing process with pid 1070998 00:18:09.012 01:10:59 -- common/autotest_common.sh@955 -- # kill 1070998 00:18:09.012 01:10:59 -- common/autotest_common.sh@960 -- # wait 1070998 00:18:09.296 01:10:59 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:09.296 01:10:59 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:09.296 01:10:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:09.296 01:10:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:09.296 01:10:59 -- common/autotest_common.sh@10 -- # set +x 00:18:09.296 01:10:59 -- nvmf/common.sh@469 -- # nvmfpid=1071356 00:18:09.296 01:10:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:09.296 01:10:59 -- nvmf/common.sh@470 -- # waitforlisten 1071356 00:18:09.296 01:10:59 -- common/autotest_common.sh@829 -- # '[' -z 1071356 ']' 00:18:09.296 01:10:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:09.296 01:10:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:09.296 01:10:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:09.296 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:09.296 01:10:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:09.296 01:10:59 -- common/autotest_common.sh@10 -- # set +x 00:18:09.554 [2024-11-26 01:10:59.860322] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:09.554 [2024-11-26 01:10:59.860409] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:09.554 EAL: No free 2048 kB hugepages reported on node 1 00:18:09.554 [2024-11-26 01:10:59.928177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:09.554 [2024-11-26 01:11:00.051357] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:09.554 [2024-11-26 01:11:00.051525] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:09.554 [2024-11-26 01:11:00.051545] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:09.554 [2024-11-26 01:11:00.051559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:09.554 [2024-11-26 01:11:00.051590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:10.488 01:11:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:10.488 01:11:00 -- common/autotest_common.sh@862 -- # return 0 00:18:10.488 01:11:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:10.488 01:11:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:10.488 01:11:00 -- common/autotest_common.sh@10 -- # set +x 00:18:10.488 01:11:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:10.488 01:11:00 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.488 01:11:00 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:10.488 01:11:00 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:10.746 [2024-11-26 01:11:01.136241] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:10.746 01:11:01 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:11.004 01:11:01 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:11.262 [2024-11-26 01:11:01.625523] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:11.262 [2024-11-26 01:11:01.625803] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:11.262 01:11:01 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:11.521 malloc0 00:18:11.521 01:11:01 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:11.779 01:11:02 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.037 01:11:02 -- target/tls.sh@197 -- # bdevperf_pid=1071733 00:18:12.037 01:11:02 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:12.037 01:11:02 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:12.037 01:11:02 -- target/tls.sh@200 -- # waitforlisten 1071733 /var/tmp/bdevperf.sock 00:18:12.037 01:11:02 -- common/autotest_common.sh@829 -- # '[' -z 1071733 ']' 00:18:12.037 01:11:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:12.037 01:11:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:12.037 01:11:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:12.037 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:12.037 01:11:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:12.037 01:11:02 -- common/autotest_common.sh@10 -- # set +x 00:18:12.037 [2024-11-26 01:11:02.454802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:12.037 [2024-11-26 01:11:02.454870] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1071733 ] 00:18:12.037 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.037 [2024-11-26 01:11:02.511085] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:12.296 [2024-11-26 01:11:02.614824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:13.230 01:11:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:13.230 01:11:03 -- common/autotest_common.sh@862 -- # return 0 00:18:13.230 01:11:03 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:13.230 [2024-11-26 01:11:03.667948] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:13.230 TLSTESTn1 00:18:13.230 01:11:03 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:13.796 01:11:04 -- target/tls.sh@205 -- # tgtconf='{ 00:18:13.796 "subsystems": [ 00:18:13.796 { 00:18:13.796 "subsystem": "iobuf", 00:18:13.796 "config": [ 00:18:13.796 { 00:18:13.796 "method": "iobuf_set_options", 00:18:13.796 "params": { 00:18:13.796 "small_pool_count": 8192, 00:18:13.796 "large_pool_count": 1024, 00:18:13.796 "small_bufsize": 8192, 00:18:13.796 "large_bufsize": 135168 00:18:13.796 } 00:18:13.796 } 00:18:13.796 ] 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "subsystem": "sock", 00:18:13.796 "config": [ 00:18:13.796 { 00:18:13.796 "method": "sock_impl_set_options", 00:18:13.796 "params": { 00:18:13.796 "impl_name": "posix", 00:18:13.796 "recv_buf_size": 2097152, 00:18:13.796 "send_buf_size": 2097152, 00:18:13.796 "enable_recv_pipe": true, 00:18:13.796 "enable_quickack": false, 00:18:13.796 "enable_placement_id": 0, 00:18:13.796 "enable_zerocopy_send_server": true, 00:18:13.796 "enable_zerocopy_send_client": false, 00:18:13.796 "zerocopy_threshold": 0, 00:18:13.796 "tls_version": 0, 00:18:13.796 "enable_ktls": false 00:18:13.796 } 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "method": "sock_impl_set_options", 00:18:13.796 "params": { 00:18:13.796 "impl_name": "ssl", 00:18:13.796 "recv_buf_size": 4096, 00:18:13.796 "send_buf_size": 4096, 00:18:13.796 "enable_recv_pipe": true, 00:18:13.796 "enable_quickack": false, 00:18:13.796 "enable_placement_id": 0, 00:18:13.796 "enable_zerocopy_send_server": true, 00:18:13.796 "enable_zerocopy_send_client": false, 00:18:13.796 "zerocopy_threshold": 0, 00:18:13.796 "tls_version": 0, 00:18:13.796 "enable_ktls": false 00:18:13.796 } 00:18:13.796 } 00:18:13.796 ] 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "subsystem": "vmd", 00:18:13.796 "config": [] 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "subsystem": "accel", 00:18:13.796 "config": [ 00:18:13.796 { 00:18:13.796 "method": "accel_set_options", 00:18:13.796 "params": { 00:18:13.796 "small_cache_size": 128, 00:18:13.796 "large_cache_size": 16, 00:18:13.796 "task_count": 2048, 00:18:13.796 "sequence_count": 2048, 00:18:13.796 "buf_count": 2048 00:18:13.796 } 00:18:13.796 } 00:18:13.796 ] 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "subsystem": "bdev", 00:18:13.796 "config": [ 00:18:13.796 { 00:18:13.796 "method": "bdev_set_options", 00:18:13.796 "params": { 00:18:13.796 "bdev_io_pool_size": 65535, 00:18:13.796 "bdev_io_cache_size": 256, 00:18:13.796 "bdev_auto_examine": true, 00:18:13.796 "iobuf_small_cache_size": 128, 00:18:13.796 "iobuf_large_cache_size": 16 00:18:13.796 } 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "method": "bdev_raid_set_options", 00:18:13.796 "params": { 00:18:13.796 "process_window_size_kb": 1024 00:18:13.796 } 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "method": "bdev_iscsi_set_options", 00:18:13.796 "params": { 00:18:13.796 "timeout_sec": 30 00:18:13.796 } 00:18:13.796 }, 00:18:13.796 { 00:18:13.796 "method": "bdev_nvme_set_options", 00:18:13.796 "params": { 00:18:13.796 "action_on_timeout": "none", 00:18:13.796 "timeout_us": 0, 00:18:13.796 "timeout_admin_us": 0, 00:18:13.796 "keep_alive_timeout_ms": 10000, 00:18:13.796 "transport_retry_count": 4, 00:18:13.797 "arbitration_burst": 0, 00:18:13.797 "low_priority_weight": 0, 00:18:13.797 "medium_priority_weight": 0, 00:18:13.797 "high_priority_weight": 0, 00:18:13.797 "nvme_adminq_poll_period_us": 10000, 00:18:13.797 "nvme_ioq_poll_period_us": 0, 00:18:13.797 "io_queue_requests": 0, 00:18:13.797 "delay_cmd_submit": true, 00:18:13.797 "bdev_retry_count": 3, 00:18:13.797 "transport_ack_timeout": 0, 00:18:13.797 "ctrlr_loss_timeout_sec": 0, 00:18:13.797 "reconnect_delay_sec": 0, 00:18:13.797 "fast_io_fail_timeout_sec": 0, 00:18:13.797 "generate_uuids": false, 00:18:13.797 "transport_tos": 0, 00:18:13.797 "io_path_stat": false, 00:18:13.797 "allow_accel_sequence": false 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "bdev_nvme_set_hotplug", 00:18:13.797 "params": { 00:18:13.797 "period_us": 100000, 00:18:13.797 "enable": false 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "bdev_malloc_create", 00:18:13.797 "params": { 00:18:13.797 "name": "malloc0", 00:18:13.797 "num_blocks": 8192, 00:18:13.797 "block_size": 4096, 00:18:13.797 "physical_block_size": 4096, 00:18:13.797 "uuid": "be5f17ef-7c48-4b62-b050-99b157cdc3d6", 00:18:13.797 "optimal_io_boundary": 0 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "bdev_wait_for_examine" 00:18:13.797 } 00:18:13.797 ] 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "subsystem": "nbd", 00:18:13.797 "config": [] 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "subsystem": "scheduler", 00:18:13.797 "config": [ 00:18:13.797 { 00:18:13.797 "method": "framework_set_scheduler", 00:18:13.797 "params": { 00:18:13.797 "name": "static" 00:18:13.797 } 00:18:13.797 } 00:18:13.797 ] 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "subsystem": "nvmf", 00:18:13.797 "config": [ 00:18:13.797 { 00:18:13.797 "method": "nvmf_set_config", 00:18:13.797 "params": { 00:18:13.797 "discovery_filter": "match_any", 00:18:13.797 "admin_cmd_passthru": { 00:18:13.797 "identify_ctrlr": false 00:18:13.797 } 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_set_max_subsystems", 00:18:13.797 "params": { 00:18:13.797 "max_subsystems": 1024 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_set_crdt", 00:18:13.797 "params": { 00:18:13.797 "crdt1": 0, 00:18:13.797 "crdt2": 0, 00:18:13.797 "crdt3": 0 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_create_transport", 00:18:13.797 "params": { 00:18:13.797 "trtype": "TCP", 00:18:13.797 "max_queue_depth": 128, 00:18:13.797 "max_io_qpairs_per_ctrlr": 127, 00:18:13.797 "in_capsule_data_size": 4096, 00:18:13.797 "max_io_size": 131072, 00:18:13.797 "io_unit_size": 131072, 00:18:13.797 "max_aq_depth": 128, 00:18:13.797 "num_shared_buffers": 511, 00:18:13.797 "buf_cache_size": 4294967295, 00:18:13.797 "dif_insert_or_strip": false, 00:18:13.797 "zcopy": false, 00:18:13.797 "c2h_success": false, 00:18:13.797 "sock_priority": 0, 00:18:13.797 "abort_timeout_sec": 1 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_create_subsystem", 00:18:13.797 "params": { 00:18:13.797 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:13.797 "allow_any_host": false, 00:18:13.797 "serial_number": "SPDK00000000000001", 00:18:13.797 "model_number": "SPDK bdev Controller", 00:18:13.797 "max_namespaces": 10, 00:18:13.797 "min_cntlid": 1, 00:18:13.797 "max_cntlid": 65519, 00:18:13.797 "ana_reporting": false 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_subsystem_add_host", 00:18:13.797 "params": { 00:18:13.797 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:13.797 "host": "nqn.2016-06.io.spdk:host1", 00:18:13.797 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_subsystem_add_ns", 00:18:13.797 "params": { 00:18:13.797 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:13.797 "namespace": { 00:18:13.797 "nsid": 1, 00:18:13.797 "bdev_name": "malloc0", 00:18:13.797 "nguid": "BE5F17EF7C484B62B05099B157CDC3D6", 00:18:13.797 "uuid": "be5f17ef-7c48-4b62-b050-99b157cdc3d6" 00:18:13.797 } 00:18:13.797 } 00:18:13.797 }, 00:18:13.797 { 00:18:13.797 "method": "nvmf_subsystem_add_listener", 00:18:13.797 "params": { 00:18:13.797 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:13.797 "listen_address": { 00:18:13.797 "trtype": "TCP", 00:18:13.797 "adrfam": "IPv4", 00:18:13.797 "traddr": "10.0.0.2", 00:18:13.797 "trsvcid": "4420" 00:18:13.797 }, 00:18:13.797 "secure_channel": true 00:18:13.797 } 00:18:13.797 } 00:18:13.797 ] 00:18:13.797 } 00:18:13.797 ] 00:18:13.797 }' 00:18:13.797 01:11:04 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:14.056 01:11:04 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:14.056 "subsystems": [ 00:18:14.056 { 00:18:14.056 "subsystem": "iobuf", 00:18:14.056 "config": [ 00:18:14.056 { 00:18:14.056 "method": "iobuf_set_options", 00:18:14.056 "params": { 00:18:14.056 "small_pool_count": 8192, 00:18:14.056 "large_pool_count": 1024, 00:18:14.056 "small_bufsize": 8192, 00:18:14.056 "large_bufsize": 135168 00:18:14.056 } 00:18:14.056 } 00:18:14.056 ] 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "subsystem": "sock", 00:18:14.056 "config": [ 00:18:14.056 { 00:18:14.056 "method": "sock_impl_set_options", 00:18:14.056 "params": { 00:18:14.056 "impl_name": "posix", 00:18:14.056 "recv_buf_size": 2097152, 00:18:14.056 "send_buf_size": 2097152, 00:18:14.056 "enable_recv_pipe": true, 00:18:14.056 "enable_quickack": false, 00:18:14.056 "enable_placement_id": 0, 00:18:14.056 "enable_zerocopy_send_server": true, 00:18:14.056 "enable_zerocopy_send_client": false, 00:18:14.056 "zerocopy_threshold": 0, 00:18:14.056 "tls_version": 0, 00:18:14.056 "enable_ktls": false 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "sock_impl_set_options", 00:18:14.056 "params": { 00:18:14.056 "impl_name": "ssl", 00:18:14.056 "recv_buf_size": 4096, 00:18:14.056 "send_buf_size": 4096, 00:18:14.056 "enable_recv_pipe": true, 00:18:14.056 "enable_quickack": false, 00:18:14.056 "enable_placement_id": 0, 00:18:14.056 "enable_zerocopy_send_server": true, 00:18:14.056 "enable_zerocopy_send_client": false, 00:18:14.056 "zerocopy_threshold": 0, 00:18:14.056 "tls_version": 0, 00:18:14.056 "enable_ktls": false 00:18:14.056 } 00:18:14.056 } 00:18:14.056 ] 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "subsystem": "vmd", 00:18:14.056 "config": [] 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "subsystem": "accel", 00:18:14.056 "config": [ 00:18:14.056 { 00:18:14.056 "method": "accel_set_options", 00:18:14.056 "params": { 00:18:14.056 "small_cache_size": 128, 00:18:14.056 "large_cache_size": 16, 00:18:14.056 "task_count": 2048, 00:18:14.056 "sequence_count": 2048, 00:18:14.056 "buf_count": 2048 00:18:14.056 } 00:18:14.056 } 00:18:14.056 ] 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "subsystem": "bdev", 00:18:14.056 "config": [ 00:18:14.056 { 00:18:14.056 "method": "bdev_set_options", 00:18:14.056 "params": { 00:18:14.056 "bdev_io_pool_size": 65535, 00:18:14.056 "bdev_io_cache_size": 256, 00:18:14.056 "bdev_auto_examine": true, 00:18:14.056 "iobuf_small_cache_size": 128, 00:18:14.056 "iobuf_large_cache_size": 16 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "bdev_raid_set_options", 00:18:14.056 "params": { 00:18:14.056 "process_window_size_kb": 1024 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "bdev_iscsi_set_options", 00:18:14.056 "params": { 00:18:14.056 "timeout_sec": 30 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "bdev_nvme_set_options", 00:18:14.056 "params": { 00:18:14.056 "action_on_timeout": "none", 00:18:14.056 "timeout_us": 0, 00:18:14.056 "timeout_admin_us": 0, 00:18:14.056 "keep_alive_timeout_ms": 10000, 00:18:14.056 "transport_retry_count": 4, 00:18:14.056 "arbitration_burst": 0, 00:18:14.056 "low_priority_weight": 0, 00:18:14.056 "medium_priority_weight": 0, 00:18:14.056 "high_priority_weight": 0, 00:18:14.056 "nvme_adminq_poll_period_us": 10000, 00:18:14.056 "nvme_ioq_poll_period_us": 0, 00:18:14.056 "io_queue_requests": 512, 00:18:14.056 "delay_cmd_submit": true, 00:18:14.056 "bdev_retry_count": 3, 00:18:14.056 "transport_ack_timeout": 0, 00:18:14.056 "ctrlr_loss_timeout_sec": 0, 00:18:14.056 "reconnect_delay_sec": 0, 00:18:14.056 "fast_io_fail_timeout_sec": 0, 00:18:14.056 "generate_uuids": false, 00:18:14.056 "transport_tos": 0, 00:18:14.056 "io_path_stat": false, 00:18:14.056 "allow_accel_sequence": false 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "bdev_nvme_attach_controller", 00:18:14.056 "params": { 00:18:14.056 "name": "TLSTEST", 00:18:14.056 "trtype": "TCP", 00:18:14.056 "adrfam": "IPv4", 00:18:14.056 "traddr": "10.0.0.2", 00:18:14.056 "trsvcid": "4420", 00:18:14.056 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.056 "prchk_reftag": false, 00:18:14.056 "prchk_guard": false, 00:18:14.056 "ctrlr_loss_timeout_sec": 0, 00:18:14.056 "reconnect_delay_sec": 0, 00:18:14.056 "fast_io_fail_timeout_sec": 0, 00:18:14.056 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:14.056 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:14.056 "hdgst": false, 00:18:14.056 "ddgst": false 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "bdev_nvme_set_hotplug", 00:18:14.056 "params": { 00:18:14.056 "period_us": 100000, 00:18:14.056 "enable": false 00:18:14.056 } 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "method": "bdev_wait_for_examine" 00:18:14.056 } 00:18:14.056 ] 00:18:14.056 }, 00:18:14.056 { 00:18:14.056 "subsystem": "nbd", 00:18:14.056 "config": [] 00:18:14.056 } 00:18:14.056 ] 00:18:14.056 }' 00:18:14.056 01:11:04 -- target/tls.sh@208 -- # killprocess 1071733 00:18:14.056 01:11:04 -- common/autotest_common.sh@936 -- # '[' -z 1071733 ']' 00:18:14.056 01:11:04 -- common/autotest_common.sh@940 -- # kill -0 1071733 00:18:14.056 01:11:04 -- common/autotest_common.sh@941 -- # uname 00:18:14.056 01:11:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:14.056 01:11:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1071733 00:18:14.056 01:11:04 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:14.056 01:11:04 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:14.056 01:11:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1071733' 00:18:14.056 killing process with pid 1071733 00:18:14.056 01:11:04 -- common/autotest_common.sh@955 -- # kill 1071733 00:18:14.056 Received shutdown signal, test time was about 10.000000 seconds 00:18:14.056 00:18:14.056 Latency(us) 00:18:14.056 [2024-11-26T00:11:04.591Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:14.056 [2024-11-26T00:11:04.591Z] =================================================================================================================== 00:18:14.056 [2024-11-26T00:11:04.591Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:14.056 01:11:04 -- common/autotest_common.sh@960 -- # wait 1071733 00:18:14.314 01:11:04 -- target/tls.sh@209 -- # killprocess 1071356 00:18:14.314 01:11:04 -- common/autotest_common.sh@936 -- # '[' -z 1071356 ']' 00:18:14.314 01:11:04 -- common/autotest_common.sh@940 -- # kill -0 1071356 00:18:14.315 01:11:04 -- common/autotest_common.sh@941 -- # uname 00:18:14.315 01:11:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:14.315 01:11:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1071356 00:18:14.315 01:11:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:14.315 01:11:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:14.315 01:11:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1071356' 00:18:14.315 killing process with pid 1071356 00:18:14.315 01:11:04 -- common/autotest_common.sh@955 -- # kill 1071356 00:18:14.315 01:11:04 -- common/autotest_common.sh@960 -- # wait 1071356 00:18:14.574 01:11:05 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:14.574 01:11:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:14.574 01:11:05 -- target/tls.sh@212 -- # echo '{ 00:18:14.574 "subsystems": [ 00:18:14.574 { 00:18:14.574 "subsystem": "iobuf", 00:18:14.574 "config": [ 00:18:14.574 { 00:18:14.574 "method": "iobuf_set_options", 00:18:14.574 "params": { 00:18:14.574 "small_pool_count": 8192, 00:18:14.574 "large_pool_count": 1024, 00:18:14.574 "small_bufsize": 8192, 00:18:14.574 "large_bufsize": 135168 00:18:14.574 } 00:18:14.574 } 00:18:14.574 ] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "sock", 00:18:14.574 "config": [ 00:18:14.574 { 00:18:14.574 "method": "sock_impl_set_options", 00:18:14.574 "params": { 00:18:14.574 "impl_name": "posix", 00:18:14.574 "recv_buf_size": 2097152, 00:18:14.574 "send_buf_size": 2097152, 00:18:14.574 "enable_recv_pipe": true, 00:18:14.574 "enable_quickack": false, 00:18:14.574 "enable_placement_id": 0, 00:18:14.574 "enable_zerocopy_send_server": true, 00:18:14.574 "enable_zerocopy_send_client": false, 00:18:14.574 "zerocopy_threshold": 0, 00:18:14.574 "tls_version": 0, 00:18:14.574 "enable_ktls": false 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "sock_impl_set_options", 00:18:14.574 "params": { 00:18:14.574 "impl_name": "ssl", 00:18:14.574 "recv_buf_size": 4096, 00:18:14.574 "send_buf_size": 4096, 00:18:14.574 "enable_recv_pipe": true, 00:18:14.574 "enable_quickack": false, 00:18:14.574 "enable_placement_id": 0, 00:18:14.574 "enable_zerocopy_send_server": true, 00:18:14.574 "enable_zerocopy_send_client": false, 00:18:14.574 "zerocopy_threshold": 0, 00:18:14.574 "tls_version": 0, 00:18:14.574 "enable_ktls": false 00:18:14.574 } 00:18:14.574 } 00:18:14.574 ] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "vmd", 00:18:14.574 "config": [] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "accel", 00:18:14.574 "config": [ 00:18:14.574 { 00:18:14.574 "method": "accel_set_options", 00:18:14.574 "params": { 00:18:14.574 "small_cache_size": 128, 00:18:14.574 "large_cache_size": 16, 00:18:14.574 "task_count": 2048, 00:18:14.574 "sequence_count": 2048, 00:18:14.574 "buf_count": 2048 00:18:14.574 } 00:18:14.574 } 00:18:14.574 ] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "bdev", 00:18:14.574 "config": [ 00:18:14.574 { 00:18:14.574 "method": "bdev_set_options", 00:18:14.574 "params": { 00:18:14.574 "bdev_io_pool_size": 65535, 00:18:14.574 "bdev_io_cache_size": 256, 00:18:14.574 "bdev_auto_examine": true, 00:18:14.574 "iobuf_small_cache_size": 128, 00:18:14.574 "iobuf_large_cache_size": 16 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "bdev_raid_set_options", 00:18:14.574 "params": { 00:18:14.574 "process_window_size_kb": 1024 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "bdev_iscsi_set_options", 00:18:14.574 "params": { 00:18:14.574 "timeout_sec": 30 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "bdev_nvme_set_options", 00:18:14.574 "params": { 00:18:14.574 "action_on_timeout": "none", 00:18:14.574 "timeout_us": 0, 00:18:14.574 "timeout_admin_us": 0, 00:18:14.574 "keep_alive_timeout_ms": 10000, 00:18:14.574 "transport_retry_count": 4, 00:18:14.574 "arbitration_burst": 0, 00:18:14.574 "low_priority_weight": 0, 00:18:14.574 "medium_priority_weight": 0, 00:18:14.574 "high_priority_weight": 0, 00:18:14.574 "nvme_adminq_poll_period_us": 10000, 00:18:14.574 "nvme_ioq_poll_period_us": 0, 00:18:14.574 "io_queue_requests": 0, 00:18:14.574 "delay_cmd_submit": true, 00:18:14.574 "bdev_retry_count": 3, 00:18:14.574 "transport_ack_timeout": 0, 00:18:14.574 "ctrlr_loss_timeout_sec": 0, 00:18:14.574 "reconnect_delay_sec": 0, 00:18:14.574 "fast_io_fail_timeout_sec": 0, 00:18:14.574 "generate_uuids": false, 00:18:14.574 "transport_tos": 0, 00:18:14.574 "io_path_stat": false, 00:18:14.574 "allow_accel_sequence": false 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "bdev_nvme_set_hotplug", 00:18:14.574 "params": { 00:18:14.574 "period_us": 100000, 00:18:14.574 "enable": false 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "bdev_malloc_create", 00:18:14.574 "params": { 00:18:14.574 "name": "malloc0", 00:18:14.574 "num_blocks": 8192, 00:18:14.574 "block_size": 4096, 00:18:14.574 "physical_block_size": 4096, 00:18:14.574 "uuid": "be5f17ef-7c48-4b62-b050-99b157cdc3d6", 00:18:14.574 "optimal_io_boundary": 0 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "bdev_wait_for_examine" 00:18:14.574 } 00:18:14.574 ] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "nbd", 00:18:14.574 "config": [] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "scheduler", 00:18:14.574 "config": [ 00:18:14.574 { 00:18:14.574 "method": "framework_set_scheduler", 00:18:14.574 "params": { 00:18:14.574 "name": "static" 00:18:14.574 } 00:18:14.574 } 00:18:14.574 ] 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "subsystem": "nvmf", 00:18:14.574 "config": [ 00:18:14.574 { 00:18:14.574 "method": "nvmf_set_config", 00:18:14.574 "params": { 00:18:14.574 "discovery_filter": "match_any", 00:18:14.574 "admin_cmd_passthru": { 00:18:14.574 "identify_ctrlr": false 00:18:14.574 } 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "nvmf_set_max_subsystems", 00:18:14.574 "params": { 00:18:14.574 "max_subsystems": 1024 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "nvmf_set_crdt", 00:18:14.574 "params": { 00:18:14.574 "crdt1": 0, 00:18:14.574 "crdt2": 0, 00:18:14.574 "crdt3": 0 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "nvmf_create_transport", 00:18:14.574 "params": { 00:18:14.574 "trtype": "TCP", 00:18:14.574 "max_queue_depth": 128, 00:18:14.574 "max_io_qpairs_per_ctrlr": 127, 00:18:14.574 "in_capsule_data_size": 4096, 00:18:14.574 "max_io_size": 131072, 00:18:14.574 "io_unit_size": 131072, 00:18:14.574 "max_aq_depth": 128, 00:18:14.574 "num_shared_buffers": 511, 00:18:14.574 "buf_cache_size": 4294967295, 00:18:14.574 "dif_insert_or_strip": false, 00:18:14.574 "zcopy": false, 00:18:14.574 "c2h_success": false, 00:18:14.574 "sock_priority": 0, 00:18:14.574 "abort_timeout_sec": 1 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "nvmf_create_subsystem", 00:18:14.574 "params": { 00:18:14.574 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.574 "allow_any_host": false, 00:18:14.574 "serial_number": "SPDK00000000000001", 00:18:14.574 "model_number": "SPDK bdev Controller", 00:18:14.574 "max_namespaces": 10, 00:18:14.574 "min_cntlid": 1, 00:18:14.574 "max_cntlid": 65519, 00:18:14.574 "ana_reporting": false 00:18:14.574 } 00:18:14.574 }, 00:18:14.574 { 00:18:14.574 "method": "nvmf_subsystem_add_host", 00:18:14.574 "params": { 00:18:14.575 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.575 "host": "nqn.2016-06.io.spdk:host1", 00:18:14.575 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:14.575 } 00:18:14.575 }, 00:18:14.575 { 00:18:14.575 "method": "nvmf_subsystem_add_ns", 00:18:14.575 "params": { 00:18:14.575 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.575 "namespace": { 00:18:14.575 "nsid": 1, 00:18:14.575 "bdev_name": "malloc0", 00:18:14.575 "nguid": "BE5F17EF7C484B62B05099B157CDC3D6", 00:18:14.575 "uuid": "be5f17ef-7c48-4b62-b050-99b157cdc3d6" 00:18:14.575 } 00:18:14.575 } 00:18:14.575 }, 00:18:14.575 { 00:18:14.575 "method": "nvmf_subsystem_add_listener", 00:18:14.575 "params": { 00:18:14.575 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:14.575 "listen_address": { 00:18:14.575 "trtype": "TCP", 00:18:14.575 "adrfam": "IPv4", 00:18:14.575 "traddr": "10.0.0.2", 00:18:14.575 "trsvcid": "4420" 00:18:14.575 }, 00:18:14.575 "secure_channel": true 00:18:14.575 } 00:18:14.575 } 00:18:14.575 ] 00:18:14.575 } 00:18:14.575 ] 00:18:14.575 }' 00:18:14.575 01:11:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:14.575 01:11:05 -- common/autotest_common.sh@10 -- # set +x 00:18:14.834 01:11:05 -- nvmf/common.sh@469 -- # nvmfpid=1072028 00:18:14.834 01:11:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:14.834 01:11:05 -- nvmf/common.sh@470 -- # waitforlisten 1072028 00:18:14.834 01:11:05 -- common/autotest_common.sh@829 -- # '[' -z 1072028 ']' 00:18:14.834 01:11:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:14.834 01:11:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:14.834 01:11:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:14.834 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:14.834 01:11:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:14.834 01:11:05 -- common/autotest_common.sh@10 -- # set +x 00:18:14.834 [2024-11-26 01:11:05.153391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:14.834 [2024-11-26 01:11:05.153468] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:14.834 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.834 [2024-11-26 01:11:05.220420] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:14.834 [2024-11-26 01:11:05.338117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:14.834 [2024-11-26 01:11:05.338281] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:14.834 [2024-11-26 01:11:05.338300] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:14.834 [2024-11-26 01:11:05.338315] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:14.834 [2024-11-26 01:11:05.338355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:15.093 [2024-11-26 01:11:05.562804] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:15.093 [2024-11-26 01:11:05.594818] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:15.093 [2024-11-26 01:11:05.595142] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:15.661 01:11:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:15.661 01:11:06 -- common/autotest_common.sh@862 -- # return 0 00:18:15.661 01:11:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:15.661 01:11:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:15.661 01:11:06 -- common/autotest_common.sh@10 -- # set +x 00:18:15.661 01:11:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:15.661 01:11:06 -- target/tls.sh@216 -- # bdevperf_pid=1072187 00:18:15.661 01:11:06 -- target/tls.sh@217 -- # waitforlisten 1072187 /var/tmp/bdevperf.sock 00:18:15.661 01:11:06 -- common/autotest_common.sh@829 -- # '[' -z 1072187 ']' 00:18:15.661 01:11:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:15.661 01:11:06 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:15.661 01:11:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:15.661 01:11:06 -- target/tls.sh@213 -- # echo '{ 00:18:15.661 "subsystems": [ 00:18:15.661 { 00:18:15.661 "subsystem": "iobuf", 00:18:15.661 "config": [ 00:18:15.661 { 00:18:15.661 "method": "iobuf_set_options", 00:18:15.661 "params": { 00:18:15.661 "small_pool_count": 8192, 00:18:15.661 "large_pool_count": 1024, 00:18:15.661 "small_bufsize": 8192, 00:18:15.661 "large_bufsize": 135168 00:18:15.661 } 00:18:15.661 } 00:18:15.661 ] 00:18:15.661 }, 00:18:15.661 { 00:18:15.661 "subsystem": "sock", 00:18:15.661 "config": [ 00:18:15.661 { 00:18:15.661 "method": "sock_impl_set_options", 00:18:15.661 "params": { 00:18:15.661 "impl_name": "posix", 00:18:15.661 "recv_buf_size": 2097152, 00:18:15.661 "send_buf_size": 2097152, 00:18:15.661 "enable_recv_pipe": true, 00:18:15.661 "enable_quickack": false, 00:18:15.661 "enable_placement_id": 0, 00:18:15.661 "enable_zerocopy_send_server": true, 00:18:15.661 "enable_zerocopy_send_client": false, 00:18:15.661 "zerocopy_threshold": 0, 00:18:15.661 "tls_version": 0, 00:18:15.661 "enable_ktls": false 00:18:15.661 } 00:18:15.661 }, 00:18:15.661 { 00:18:15.661 "method": "sock_impl_set_options", 00:18:15.661 "params": { 00:18:15.661 "impl_name": "ssl", 00:18:15.661 "recv_buf_size": 4096, 00:18:15.661 "send_buf_size": 4096, 00:18:15.661 "enable_recv_pipe": true, 00:18:15.661 "enable_quickack": false, 00:18:15.661 "enable_placement_id": 0, 00:18:15.661 "enable_zerocopy_send_server": true, 00:18:15.661 "enable_zerocopy_send_client": false, 00:18:15.661 "zerocopy_threshold": 0, 00:18:15.661 "tls_version": 0, 00:18:15.661 "enable_ktls": false 00:18:15.661 } 00:18:15.661 } 00:18:15.661 ] 00:18:15.661 }, 00:18:15.661 { 00:18:15.661 "subsystem": "vmd", 00:18:15.661 "config": [] 00:18:15.661 }, 00:18:15.661 { 00:18:15.661 "subsystem": "accel", 00:18:15.661 "config": [ 00:18:15.661 { 00:18:15.661 "method": "accel_set_options", 00:18:15.661 "params": { 00:18:15.661 "small_cache_size": 128, 00:18:15.661 "large_cache_size": 16, 00:18:15.661 "task_count": 2048, 00:18:15.661 "sequence_count": 2048, 00:18:15.662 "buf_count": 2048 00:18:15.662 } 00:18:15.662 } 00:18:15.662 ] 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "subsystem": "bdev", 00:18:15.662 "config": [ 00:18:15.662 { 00:18:15.662 "method": "bdev_set_options", 00:18:15.662 "params": { 00:18:15.662 "bdev_io_pool_size": 65535, 00:18:15.662 "bdev_io_cache_size": 256, 00:18:15.662 "bdev_auto_examine": true, 00:18:15.662 "iobuf_small_cache_size": 128, 00:18:15.662 "iobuf_large_cache_size": 16 00:18:15.662 } 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "method": "bdev_raid_set_options", 00:18:15.662 "params": { 00:18:15.662 "process_window_size_kb": 1024 00:18:15.662 } 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "method": "bdev_iscsi_set_options", 00:18:15.662 "params": { 00:18:15.662 "timeout_sec": 30 00:18:15.662 } 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "method": "bdev_nvme_set_options", 00:18:15.662 "params": { 00:18:15.662 "action_on_timeout": "none", 00:18:15.662 "timeout_us": 0, 00:18:15.662 "timeout_admin_us": 0, 00:18:15.662 "keep_alive_timeout_ms": 10000, 00:18:15.662 "transport_retry_count": 4, 00:18:15.662 "arbitration_burst": 0, 00:18:15.662 "low_priority_weight": 0, 00:18:15.662 "medium_priority_weight": 0, 00:18:15.662 "high_priority_weight": 0, 00:18:15.662 "nvme_adminq_poll_period_us": 10000, 00:18:15.662 "nvme_ioq_poll_period_us": 0, 00:18:15.662 "io_queue_requests": 512, 00:18:15.662 "delay_cmd_submit": true, 00:18:15.662 "bdev_retry_count": 3, 00:18:15.662 "transport_ack_timeout": 0, 00:18:15.662 "ctrlr_loss_timeout_sec": 0, 00:18:15.662 "reconnect_delay_sec": 0, 00:18:15.662 "fast_io_fail_timeout_sec": 0, 00:18:15.662 "generate_uuids": false, 00:18:15.662 "transport_tos": 0, 00:18:15.662 "io_path_stat": false, 00:18:15.662 "allow_accel_sequence": false 00:18:15.662 } 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "method": "bdev_nvme_attach_controller", 00:18:15.662 "params": { 00:18:15.662 "name": "TLSTEST", 00:18:15.662 "trtype": "TCP", 00:18:15.662 "adrfam": "IPv4", 00:18:15.662 "traddr": "10.0.0.2", 00:18:15.662 "trsvcid": "4420", 00:18:15.662 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.662 "prchk_reftag": false, 00:18:15.662 "prchk_guard": false, 00:18:15.662 "ctrlr_loss_timeout_sec": 0, 00:18:15.662 "reconnect_delay_sec": 0, 00:18:15.662 "fast_io_fail_timeout_sec": 0, 00:18:15.662 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:15.662 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.662 "hdgst": false, 00:18:15.662 "ddgst": false 00:18:15.662 } 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "method": "bdev_nvme_set_hotplug", 00:18:15.662 "params": { 00:18:15.662 "period_us": 100000, 00:18:15.662 "enable": false 00:18:15.662 } 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "method": "bdev_wait_for_examine" 00:18:15.662 } 00:18:15.662 ] 00:18:15.662 }, 00:18:15.662 { 00:18:15.662 "subsystem": "nbd", 00:18:15.662 "config": [] 00:18:15.662 } 00:18:15.662 ] 00:18:15.662 }' 00:18:15.662 01:11:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:15.662 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:15.662 01:11:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:15.662 01:11:06 -- common/autotest_common.sh@10 -- # set +x 00:18:15.921 [2024-11-26 01:11:06.225431] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.921 [2024-11-26 01:11:06.225503] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1072187 ] 00:18:15.921 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.921 [2024-11-26 01:11:06.287323] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.921 [2024-11-26 01:11:06.404841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:16.181 [2024-11-26 01:11:06.568831] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:16.747 01:11:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:16.747 01:11:07 -- common/autotest_common.sh@862 -- # return 0 00:18:16.747 01:11:07 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:16.747 Running I/O for 10 seconds... 00:18:28.944 00:18:28.944 Latency(us) 00:18:28.944 [2024-11-26T00:11:19.479Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:28.944 [2024-11-26T00:11:19.479Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:28.944 Verification LBA range: start 0x0 length 0x2000 00:18:28.944 TLSTESTn1 : 10.03 3644.67 14.24 0.00 0.00 35060.98 8689.59 75342.13 00:18:28.944 [2024-11-26T00:11:19.479Z] =================================================================================================================== 00:18:28.944 [2024-11-26T00:11:19.479Z] Total : 3644.67 14.24 0.00 0.00 35060.98 8689.59 75342.13 00:18:28.944 0 00:18:28.944 01:11:17 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:28.944 01:11:17 -- target/tls.sh@223 -- # killprocess 1072187 00:18:28.944 01:11:17 -- common/autotest_common.sh@936 -- # '[' -z 1072187 ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@940 -- # kill -0 1072187 00:18:28.944 01:11:17 -- common/autotest_common.sh@941 -- # uname 00:18:28.944 01:11:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1072187 00:18:28.944 01:11:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:28.944 01:11:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1072187' 00:18:28.944 killing process with pid 1072187 00:18:28.944 01:11:17 -- common/autotest_common.sh@955 -- # kill 1072187 00:18:28.944 Received shutdown signal, test time was about 10.000000 seconds 00:18:28.944 00:18:28.944 Latency(us) 00:18:28.944 [2024-11-26T00:11:19.479Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:28.944 [2024-11-26T00:11:19.479Z] =================================================================================================================== 00:18:28.944 [2024-11-26T00:11:19.479Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:28.944 01:11:17 -- common/autotest_common.sh@960 -- # wait 1072187 00:18:28.944 01:11:17 -- target/tls.sh@224 -- # killprocess 1072028 00:18:28.944 01:11:17 -- common/autotest_common.sh@936 -- # '[' -z 1072028 ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@940 -- # kill -0 1072028 00:18:28.944 01:11:17 -- common/autotest_common.sh@941 -- # uname 00:18:28.944 01:11:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1072028 00:18:28.944 01:11:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:28.944 01:11:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1072028' 00:18:28.944 killing process with pid 1072028 00:18:28.944 01:11:17 -- common/autotest_common.sh@955 -- # kill 1072028 00:18:28.944 01:11:17 -- common/autotest_common.sh@960 -- # wait 1072028 00:18:28.944 01:11:17 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:28.944 01:11:17 -- target/tls.sh@227 -- # cleanup 00:18:28.944 01:11:17 -- target/tls.sh@15 -- # process_shm --id 0 00:18:28.944 01:11:17 -- common/autotest_common.sh@806 -- # type=--id 00:18:28.944 01:11:17 -- common/autotest_common.sh@807 -- # id=0 00:18:28.944 01:11:17 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:28.944 01:11:17 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:28.944 01:11:17 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:28.944 01:11:17 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:28.944 01:11:17 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:28.944 01:11:17 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:28.944 nvmf_trace.0 00:18:28.944 01:11:18 -- common/autotest_common.sh@821 -- # return 0 00:18:28.944 01:11:18 -- target/tls.sh@16 -- # killprocess 1072187 00:18:28.944 01:11:18 -- common/autotest_common.sh@936 -- # '[' -z 1072187 ']' 00:18:28.944 01:11:18 -- common/autotest_common.sh@940 -- # kill -0 1072187 00:18:28.944 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1072187) - No such process 00:18:28.944 01:11:18 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1072187 is not found' 00:18:28.944 Process with pid 1072187 is not found 00:18:28.944 01:11:18 -- target/tls.sh@17 -- # nvmftestfini 00:18:28.944 01:11:18 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:28.944 01:11:18 -- nvmf/common.sh@116 -- # sync 00:18:28.944 01:11:18 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:28.944 01:11:18 -- nvmf/common.sh@119 -- # set +e 00:18:28.944 01:11:18 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:28.944 01:11:18 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:28.944 rmmod nvme_tcp 00:18:28.944 rmmod nvme_fabrics 00:18:28.944 rmmod nvme_keyring 00:18:28.944 01:11:18 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:28.944 01:11:18 -- nvmf/common.sh@123 -- # set -e 00:18:28.944 01:11:18 -- nvmf/common.sh@124 -- # return 0 00:18:28.944 01:11:18 -- nvmf/common.sh@477 -- # '[' -n 1072028 ']' 00:18:28.944 01:11:18 -- nvmf/common.sh@478 -- # killprocess 1072028 00:18:28.944 01:11:18 -- common/autotest_common.sh@936 -- # '[' -z 1072028 ']' 00:18:28.944 01:11:18 -- common/autotest_common.sh@940 -- # kill -0 1072028 00:18:28.944 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1072028) - No such process 00:18:28.944 01:11:18 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1072028 is not found' 00:18:28.944 Process with pid 1072028 is not found 00:18:28.944 01:11:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:28.944 01:11:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:28.944 01:11:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:28.944 01:11:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:28.944 01:11:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:28.944 01:11:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:28.944 01:11:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:28.944 01:11:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:29.883 01:11:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:29.883 01:11:20 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:29.883 00:18:29.883 real 1m16.421s 00:18:29.883 user 1m57.764s 00:18:29.883 sys 0m25.669s 00:18:29.883 01:11:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:29.883 01:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:29.883 ************************************ 00:18:29.883 END TEST nvmf_tls 00:18:29.883 ************************************ 00:18:29.883 01:11:20 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:29.883 01:11:20 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:29.883 01:11:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:29.883 01:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:29.883 ************************************ 00:18:29.883 START TEST nvmf_fips 00:18:29.883 ************************************ 00:18:29.883 01:11:20 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:29.883 * Looking for test storage... 00:18:29.883 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:29.883 01:11:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:29.883 01:11:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:29.883 01:11:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:29.883 01:11:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:29.883 01:11:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:29.883 01:11:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:29.883 01:11:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:29.883 01:11:20 -- scripts/common.sh@335 -- # IFS=.-: 00:18:29.883 01:11:20 -- scripts/common.sh@335 -- # read -ra ver1 00:18:29.883 01:11:20 -- scripts/common.sh@336 -- # IFS=.-: 00:18:29.883 01:11:20 -- scripts/common.sh@336 -- # read -ra ver2 00:18:29.883 01:11:20 -- scripts/common.sh@337 -- # local 'op=<' 00:18:29.883 01:11:20 -- scripts/common.sh@339 -- # ver1_l=2 00:18:29.883 01:11:20 -- scripts/common.sh@340 -- # ver2_l=1 00:18:29.883 01:11:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:29.883 01:11:20 -- scripts/common.sh@343 -- # case "$op" in 00:18:29.883 01:11:20 -- scripts/common.sh@344 -- # : 1 00:18:29.883 01:11:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:29.883 01:11:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:29.883 01:11:20 -- scripts/common.sh@364 -- # decimal 1 00:18:29.883 01:11:20 -- scripts/common.sh@352 -- # local d=1 00:18:29.883 01:11:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:29.883 01:11:20 -- scripts/common.sh@354 -- # echo 1 00:18:29.883 01:11:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:29.883 01:11:20 -- scripts/common.sh@365 -- # decimal 2 00:18:29.883 01:11:20 -- scripts/common.sh@352 -- # local d=2 00:18:29.883 01:11:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:29.883 01:11:20 -- scripts/common.sh@354 -- # echo 2 00:18:29.883 01:11:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:29.883 01:11:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:29.883 01:11:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:29.883 01:11:20 -- scripts/common.sh@367 -- # return 0 00:18:29.883 01:11:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:29.883 01:11:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:29.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:29.883 --rc genhtml_branch_coverage=1 00:18:29.883 --rc genhtml_function_coverage=1 00:18:29.883 --rc genhtml_legend=1 00:18:29.883 --rc geninfo_all_blocks=1 00:18:29.883 --rc geninfo_unexecuted_blocks=1 00:18:29.883 00:18:29.883 ' 00:18:29.883 01:11:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:29.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:29.883 --rc genhtml_branch_coverage=1 00:18:29.883 --rc genhtml_function_coverage=1 00:18:29.883 --rc genhtml_legend=1 00:18:29.883 --rc geninfo_all_blocks=1 00:18:29.883 --rc geninfo_unexecuted_blocks=1 00:18:29.883 00:18:29.883 ' 00:18:29.883 01:11:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:29.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:29.883 --rc genhtml_branch_coverage=1 00:18:29.883 --rc genhtml_function_coverage=1 00:18:29.883 --rc genhtml_legend=1 00:18:29.884 --rc geninfo_all_blocks=1 00:18:29.884 --rc geninfo_unexecuted_blocks=1 00:18:29.884 00:18:29.884 ' 00:18:29.884 01:11:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:29.884 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:29.884 --rc genhtml_branch_coverage=1 00:18:29.884 --rc genhtml_function_coverage=1 00:18:29.884 --rc genhtml_legend=1 00:18:29.884 --rc geninfo_all_blocks=1 00:18:29.884 --rc geninfo_unexecuted_blocks=1 00:18:29.884 00:18:29.884 ' 00:18:29.884 01:11:20 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:29.884 01:11:20 -- nvmf/common.sh@7 -- # uname -s 00:18:29.884 01:11:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:29.884 01:11:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:29.884 01:11:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:29.884 01:11:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:29.884 01:11:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:29.884 01:11:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:29.884 01:11:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:29.884 01:11:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:29.884 01:11:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:29.884 01:11:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:29.884 01:11:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:29.884 01:11:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:29.884 01:11:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:29.884 01:11:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:29.884 01:11:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:29.884 01:11:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:29.884 01:11:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:29.884 01:11:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:29.884 01:11:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:29.884 01:11:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.884 01:11:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.884 01:11:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.884 01:11:20 -- paths/export.sh@5 -- # export PATH 00:18:29.884 01:11:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.884 01:11:20 -- nvmf/common.sh@46 -- # : 0 00:18:29.884 01:11:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:29.884 01:11:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:29.884 01:11:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:29.884 01:11:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:29.884 01:11:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:29.884 01:11:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:29.884 01:11:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:29.884 01:11:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:29.884 01:11:20 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:29.884 01:11:20 -- fips/fips.sh@89 -- # check_openssl_version 00:18:29.884 01:11:20 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:29.884 01:11:20 -- fips/fips.sh@85 -- # openssl version 00:18:29.884 01:11:20 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:29.884 01:11:20 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:29.884 01:11:20 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:29.884 01:11:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:29.884 01:11:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:29.884 01:11:20 -- scripts/common.sh@335 -- # IFS=.-: 00:18:29.884 01:11:20 -- scripts/common.sh@335 -- # read -ra ver1 00:18:29.884 01:11:20 -- scripts/common.sh@336 -- # IFS=.-: 00:18:29.884 01:11:20 -- scripts/common.sh@336 -- # read -ra ver2 00:18:29.884 01:11:20 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:29.884 01:11:20 -- scripts/common.sh@339 -- # ver1_l=3 00:18:29.884 01:11:20 -- scripts/common.sh@340 -- # ver2_l=3 00:18:29.884 01:11:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:29.884 01:11:20 -- scripts/common.sh@343 -- # case "$op" in 00:18:29.884 01:11:20 -- scripts/common.sh@347 -- # : 1 00:18:29.884 01:11:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:29.884 01:11:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:29.884 01:11:20 -- scripts/common.sh@364 -- # decimal 3 00:18:29.884 01:11:20 -- scripts/common.sh@352 -- # local d=3 00:18:29.884 01:11:20 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:29.884 01:11:20 -- scripts/common.sh@354 -- # echo 3 00:18:29.884 01:11:20 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:29.884 01:11:20 -- scripts/common.sh@365 -- # decimal 3 00:18:29.884 01:11:20 -- scripts/common.sh@352 -- # local d=3 00:18:29.884 01:11:20 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:29.884 01:11:20 -- scripts/common.sh@354 -- # echo 3 00:18:29.884 01:11:20 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:29.884 01:11:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:29.884 01:11:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:29.884 01:11:20 -- scripts/common.sh@363 -- # (( v++ )) 00:18:29.884 01:11:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:29.884 01:11:20 -- scripts/common.sh@364 -- # decimal 1 00:18:29.884 01:11:20 -- scripts/common.sh@352 -- # local d=1 00:18:29.884 01:11:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:29.884 01:11:20 -- scripts/common.sh@354 -- # echo 1 00:18:29.884 01:11:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:29.884 01:11:20 -- scripts/common.sh@365 -- # decimal 0 00:18:29.884 01:11:20 -- scripts/common.sh@352 -- # local d=0 00:18:29.884 01:11:20 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:29.884 01:11:20 -- scripts/common.sh@354 -- # echo 0 00:18:29.884 01:11:20 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:29.884 01:11:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:29.884 01:11:20 -- scripts/common.sh@366 -- # return 0 00:18:29.884 01:11:20 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:29.884 01:11:20 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:29.884 01:11:20 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:29.884 01:11:20 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:29.884 01:11:20 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:29.884 01:11:20 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:29.884 01:11:20 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:29.884 01:11:20 -- fips/fips.sh@113 -- # build_openssl_config 00:18:29.884 01:11:20 -- fips/fips.sh@37 -- # cat 00:18:29.884 01:11:20 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:29.884 01:11:20 -- fips/fips.sh@58 -- # cat - 00:18:29.884 01:11:20 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:29.884 01:11:20 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:29.884 01:11:20 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:29.884 01:11:20 -- fips/fips.sh@116 -- # openssl list -providers 00:18:29.884 01:11:20 -- fips/fips.sh@116 -- # grep name 00:18:29.884 01:11:20 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:29.884 01:11:20 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:29.884 01:11:20 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:29.884 01:11:20 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:29.884 01:11:20 -- fips/fips.sh@127 -- # : 00:18:29.884 01:11:20 -- common/autotest_common.sh@650 -- # local es=0 00:18:29.884 01:11:20 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:29.884 01:11:20 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:29.884 01:11:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:29.884 01:11:20 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:29.884 01:11:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:29.884 01:11:20 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:29.884 01:11:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:29.884 01:11:20 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:29.884 01:11:20 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:29.884 01:11:20 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:30.143 Error setting digest 00:18:30.143 405234DA7D7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:30.143 405234DA7D7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:30.143 01:11:20 -- common/autotest_common.sh@653 -- # es=1 00:18:30.143 01:11:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:30.143 01:11:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:30.143 01:11:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:30.143 01:11:20 -- fips/fips.sh@130 -- # nvmftestinit 00:18:30.143 01:11:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:30.143 01:11:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:30.143 01:11:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:30.143 01:11:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:30.143 01:11:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:30.143 01:11:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:30.143 01:11:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:30.143 01:11:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:30.143 01:11:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:30.143 01:11:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:30.143 01:11:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:30.143 01:11:20 -- common/autotest_common.sh@10 -- # set +x 00:18:32.111 01:11:22 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:32.111 01:11:22 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:32.111 01:11:22 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:32.112 01:11:22 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:32.112 01:11:22 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:32.112 01:11:22 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:32.112 01:11:22 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:32.112 01:11:22 -- nvmf/common.sh@294 -- # net_devs=() 00:18:32.112 01:11:22 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:32.112 01:11:22 -- nvmf/common.sh@295 -- # e810=() 00:18:32.112 01:11:22 -- nvmf/common.sh@295 -- # local -ga e810 00:18:32.112 01:11:22 -- nvmf/common.sh@296 -- # x722=() 00:18:32.112 01:11:22 -- nvmf/common.sh@296 -- # local -ga x722 00:18:32.112 01:11:22 -- nvmf/common.sh@297 -- # mlx=() 00:18:32.112 01:11:22 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:32.112 01:11:22 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:32.112 01:11:22 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:32.112 01:11:22 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:32.112 01:11:22 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:32.112 01:11:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:32.112 01:11:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:32.112 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:32.112 01:11:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:32.112 01:11:22 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:32.112 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:32.112 01:11:22 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:32.112 01:11:22 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:32.112 01:11:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.112 01:11:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:32.112 01:11:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.112 01:11:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:32.112 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:32.112 01:11:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.112 01:11:22 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:32.112 01:11:22 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:32.112 01:11:22 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:32.112 01:11:22 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:32.112 01:11:22 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:32.112 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:32.112 01:11:22 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:32.112 01:11:22 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:32.112 01:11:22 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:32.112 01:11:22 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:32.112 01:11:22 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:32.112 01:11:22 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:32.112 01:11:22 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:32.112 01:11:22 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:32.112 01:11:22 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:32.112 01:11:22 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:32.112 01:11:22 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:32.112 01:11:22 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:32.112 01:11:22 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:32.112 01:11:22 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:32.112 01:11:22 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:32.112 01:11:22 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:32.112 01:11:22 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:32.112 01:11:22 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:32.112 01:11:22 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:32.112 01:11:22 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:32.112 01:11:22 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:32.112 01:11:22 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:32.112 01:11:22 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:32.112 01:11:22 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:32.112 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:32.112 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:18:32.112 00:18:32.112 --- 10.0.0.2 ping statistics --- 00:18:32.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.112 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:18:32.112 01:11:22 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:32.112 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:32.112 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.123 ms 00:18:32.112 00:18:32.112 --- 10.0.0.1 ping statistics --- 00:18:32.112 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:32.112 rtt min/avg/max/mdev = 0.123/0.123/0.123/0.000 ms 00:18:32.112 01:11:22 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:32.112 01:11:22 -- nvmf/common.sh@410 -- # return 0 00:18:32.112 01:11:22 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:32.112 01:11:22 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:32.112 01:11:22 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:32.112 01:11:22 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:32.112 01:11:22 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:32.112 01:11:22 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:32.112 01:11:22 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:32.112 01:11:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:32.112 01:11:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:32.112 01:11:22 -- common/autotest_common.sh@10 -- # set +x 00:18:32.112 01:11:22 -- nvmf/common.sh@469 -- # nvmfpid=1075643 00:18:32.112 01:11:22 -- nvmf/common.sh@470 -- # waitforlisten 1075643 00:18:32.112 01:11:22 -- common/autotest_common.sh@829 -- # '[' -z 1075643 ']' 00:18:32.112 01:11:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:32.112 01:11:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:32.112 01:11:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:32.112 01:11:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:32.112 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:32.112 01:11:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:32.112 01:11:22 -- common/autotest_common.sh@10 -- # set +x 00:18:32.112 [2024-11-26 01:11:22.596396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:32.112 [2024-11-26 01:11:22.596505] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:32.112 EAL: No free 2048 kB hugepages reported on node 1 00:18:32.380 [2024-11-26 01:11:22.665183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:32.380 [2024-11-26 01:11:22.768933] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:32.380 [2024-11-26 01:11:22.769101] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:32.380 [2024-11-26 01:11:22.769118] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:32.380 [2024-11-26 01:11:22.769130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:32.380 [2024-11-26 01:11:22.769165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:33.323 01:11:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:33.323 01:11:23 -- common/autotest_common.sh@862 -- # return 0 00:18:33.323 01:11:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:33.323 01:11:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:33.323 01:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:33.323 01:11:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:33.323 01:11:23 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:33.323 01:11:23 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:33.323 01:11:23 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:33.323 01:11:23 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:33.323 01:11:23 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:33.323 01:11:23 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:33.323 01:11:23 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:33.323 01:11:23 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:33.581 [2024-11-26 01:11:23.890582] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:33.581 [2024-11-26 01:11:23.906574] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:33.581 [2024-11-26 01:11:23.906858] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:33.581 malloc0 00:18:33.581 01:11:23 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:33.581 01:11:23 -- fips/fips.sh@147 -- # bdevperf_pid=1075807 00:18:33.581 01:11:23 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:33.581 01:11:23 -- fips/fips.sh@148 -- # waitforlisten 1075807 /var/tmp/bdevperf.sock 00:18:33.581 01:11:23 -- common/autotest_common.sh@829 -- # '[' -z 1075807 ']' 00:18:33.581 01:11:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:33.581 01:11:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:33.582 01:11:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:33.582 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:33.582 01:11:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:33.582 01:11:23 -- common/autotest_common.sh@10 -- # set +x 00:18:33.582 [2024-11-26 01:11:24.027086] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:33.582 [2024-11-26 01:11:24.027161] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1075807 ] 00:18:33.582 EAL: No free 2048 kB hugepages reported on node 1 00:18:33.582 [2024-11-26 01:11:24.090207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:33.840 [2024-11-26 01:11:24.208187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:34.775 01:11:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:34.775 01:11:24 -- common/autotest_common.sh@862 -- # return 0 00:18:34.775 01:11:24 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:34.775 [2024-11-26 01:11:25.181850] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:34.775 TLSTESTn1 00:18:34.775 01:11:25 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:35.036 Running I/O for 10 seconds... 00:18:45.013 00:18:45.013 Latency(us) 00:18:45.013 [2024-11-26T00:11:35.548Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:45.013 [2024-11-26T00:11:35.548Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:45.013 Verification LBA range: start 0x0 length 0x2000 00:18:45.013 TLSTESTn1 : 10.02 4440.82 17.35 0.00 0.00 28780.83 4927.34 44661.57 00:18:45.013 [2024-11-26T00:11:35.548Z] =================================================================================================================== 00:18:45.013 [2024-11-26T00:11:35.548Z] Total : 4440.82 17.35 0.00 0.00 28780.83 4927.34 44661.57 00:18:45.013 0 00:18:45.013 01:11:35 -- fips/fips.sh@1 -- # cleanup 00:18:45.013 01:11:35 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:45.013 01:11:35 -- common/autotest_common.sh@806 -- # type=--id 00:18:45.013 01:11:35 -- common/autotest_common.sh@807 -- # id=0 00:18:45.013 01:11:35 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:45.013 01:11:35 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:45.013 01:11:35 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:45.013 01:11:35 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:45.013 01:11:35 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:45.013 01:11:35 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:45.013 nvmf_trace.0 00:18:45.013 01:11:35 -- common/autotest_common.sh@821 -- # return 0 00:18:45.013 01:11:35 -- fips/fips.sh@16 -- # killprocess 1075807 00:18:45.013 01:11:35 -- common/autotest_common.sh@936 -- # '[' -z 1075807 ']' 00:18:45.013 01:11:35 -- common/autotest_common.sh@940 -- # kill -0 1075807 00:18:45.013 01:11:35 -- common/autotest_common.sh@941 -- # uname 00:18:45.013 01:11:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:45.013 01:11:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1075807 00:18:45.013 01:11:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:45.013 01:11:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:45.013 01:11:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1075807' 00:18:45.013 killing process with pid 1075807 00:18:45.013 01:11:35 -- common/autotest_common.sh@955 -- # kill 1075807 00:18:45.013 Received shutdown signal, test time was about 10.000000 seconds 00:18:45.013 00:18:45.013 Latency(us) 00:18:45.013 [2024-11-26T00:11:35.548Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:45.013 [2024-11-26T00:11:35.548Z] =================================================================================================================== 00:18:45.013 [2024-11-26T00:11:35.548Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:45.013 01:11:35 -- common/autotest_common.sh@960 -- # wait 1075807 00:18:45.272 01:11:35 -- fips/fips.sh@17 -- # nvmftestfini 00:18:45.272 01:11:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:45.272 01:11:35 -- nvmf/common.sh@116 -- # sync 00:18:45.272 01:11:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:45.272 01:11:35 -- nvmf/common.sh@119 -- # set +e 00:18:45.272 01:11:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:45.272 01:11:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:45.272 rmmod nvme_tcp 00:18:45.531 rmmod nvme_fabrics 00:18:45.531 rmmod nvme_keyring 00:18:45.531 01:11:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:45.531 01:11:35 -- nvmf/common.sh@123 -- # set -e 00:18:45.531 01:11:35 -- nvmf/common.sh@124 -- # return 0 00:18:45.531 01:11:35 -- nvmf/common.sh@477 -- # '[' -n 1075643 ']' 00:18:45.531 01:11:35 -- nvmf/common.sh@478 -- # killprocess 1075643 00:18:45.531 01:11:35 -- common/autotest_common.sh@936 -- # '[' -z 1075643 ']' 00:18:45.531 01:11:35 -- common/autotest_common.sh@940 -- # kill -0 1075643 00:18:45.531 01:11:35 -- common/autotest_common.sh@941 -- # uname 00:18:45.531 01:11:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:45.531 01:11:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1075643 00:18:45.531 01:11:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:45.531 01:11:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:45.531 01:11:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1075643' 00:18:45.531 killing process with pid 1075643 00:18:45.531 01:11:35 -- common/autotest_common.sh@955 -- # kill 1075643 00:18:45.531 01:11:35 -- common/autotest_common.sh@960 -- # wait 1075643 00:18:45.789 01:11:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:45.789 01:11:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:45.789 01:11:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:45.789 01:11:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:45.790 01:11:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:45.790 01:11:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:45.790 01:11:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:45.790 01:11:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:47.697 01:11:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:47.697 01:11:38 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:47.697 00:18:47.697 real 0m18.082s 00:18:47.697 user 0m23.881s 00:18:47.697 sys 0m5.738s 00:18:47.956 01:11:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:47.956 01:11:38 -- common/autotest_common.sh@10 -- # set +x 00:18:47.956 ************************************ 00:18:47.956 END TEST nvmf_fips 00:18:47.956 ************************************ 00:18:47.956 01:11:38 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:47.956 01:11:38 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:47.956 01:11:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:47.956 01:11:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:47.956 01:11:38 -- common/autotest_common.sh@10 -- # set +x 00:18:47.956 ************************************ 00:18:47.956 START TEST nvmf_fuzz 00:18:47.956 ************************************ 00:18:47.956 01:11:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:47.956 * Looking for test storage... 00:18:47.956 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:47.956 01:11:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:47.956 01:11:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:47.956 01:11:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:47.956 01:11:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:47.956 01:11:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:47.956 01:11:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:47.956 01:11:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:47.956 01:11:38 -- scripts/common.sh@335 -- # IFS=.-: 00:18:47.956 01:11:38 -- scripts/common.sh@335 -- # read -ra ver1 00:18:47.956 01:11:38 -- scripts/common.sh@336 -- # IFS=.-: 00:18:47.956 01:11:38 -- scripts/common.sh@336 -- # read -ra ver2 00:18:47.956 01:11:38 -- scripts/common.sh@337 -- # local 'op=<' 00:18:47.956 01:11:38 -- scripts/common.sh@339 -- # ver1_l=2 00:18:47.956 01:11:38 -- scripts/common.sh@340 -- # ver2_l=1 00:18:47.956 01:11:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:47.956 01:11:38 -- scripts/common.sh@343 -- # case "$op" in 00:18:47.956 01:11:38 -- scripts/common.sh@344 -- # : 1 00:18:47.956 01:11:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:47.956 01:11:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:47.956 01:11:38 -- scripts/common.sh@364 -- # decimal 1 00:18:47.956 01:11:38 -- scripts/common.sh@352 -- # local d=1 00:18:47.956 01:11:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:47.956 01:11:38 -- scripts/common.sh@354 -- # echo 1 00:18:47.956 01:11:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:47.956 01:11:38 -- scripts/common.sh@365 -- # decimal 2 00:18:47.956 01:11:38 -- scripts/common.sh@352 -- # local d=2 00:18:47.956 01:11:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:47.956 01:11:38 -- scripts/common.sh@354 -- # echo 2 00:18:47.956 01:11:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:47.956 01:11:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:47.956 01:11:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:47.956 01:11:38 -- scripts/common.sh@367 -- # return 0 00:18:47.956 01:11:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:47.956 01:11:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:47.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:47.956 --rc genhtml_branch_coverage=1 00:18:47.956 --rc genhtml_function_coverage=1 00:18:47.956 --rc genhtml_legend=1 00:18:47.956 --rc geninfo_all_blocks=1 00:18:47.956 --rc geninfo_unexecuted_blocks=1 00:18:47.956 00:18:47.956 ' 00:18:47.956 01:11:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:47.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:47.956 --rc genhtml_branch_coverage=1 00:18:47.956 --rc genhtml_function_coverage=1 00:18:47.956 --rc genhtml_legend=1 00:18:47.956 --rc geninfo_all_blocks=1 00:18:47.956 --rc geninfo_unexecuted_blocks=1 00:18:47.956 00:18:47.956 ' 00:18:47.956 01:11:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:47.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:47.956 --rc genhtml_branch_coverage=1 00:18:47.956 --rc genhtml_function_coverage=1 00:18:47.956 --rc genhtml_legend=1 00:18:47.956 --rc geninfo_all_blocks=1 00:18:47.956 --rc geninfo_unexecuted_blocks=1 00:18:47.956 00:18:47.956 ' 00:18:47.956 01:11:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:47.956 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:47.956 --rc genhtml_branch_coverage=1 00:18:47.956 --rc genhtml_function_coverage=1 00:18:47.956 --rc genhtml_legend=1 00:18:47.956 --rc geninfo_all_blocks=1 00:18:47.956 --rc geninfo_unexecuted_blocks=1 00:18:47.956 00:18:47.956 ' 00:18:47.956 01:11:38 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:47.956 01:11:38 -- nvmf/common.sh@7 -- # uname -s 00:18:47.956 01:11:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:47.956 01:11:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:47.956 01:11:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:47.956 01:11:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:47.956 01:11:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:47.956 01:11:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:47.956 01:11:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:47.956 01:11:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:47.956 01:11:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:47.956 01:11:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:47.956 01:11:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:47.956 01:11:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:47.956 01:11:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:47.956 01:11:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:47.956 01:11:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:47.956 01:11:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:47.956 01:11:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:47.956 01:11:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:47.956 01:11:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:47.956 01:11:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:47.956 01:11:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:47.956 01:11:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:47.956 01:11:38 -- paths/export.sh@5 -- # export PATH 00:18:47.956 01:11:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:47.956 01:11:38 -- nvmf/common.sh@46 -- # : 0 00:18:47.957 01:11:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:47.957 01:11:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:47.957 01:11:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:47.957 01:11:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:47.957 01:11:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:47.957 01:11:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:47.957 01:11:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:47.957 01:11:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:47.957 01:11:38 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:47.957 01:11:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:47.957 01:11:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:47.957 01:11:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:47.957 01:11:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:47.957 01:11:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:47.957 01:11:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:47.957 01:11:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:47.957 01:11:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:47.957 01:11:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:47.957 01:11:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:47.957 01:11:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:47.957 01:11:38 -- common/autotest_common.sh@10 -- # set +x 00:18:50.498 01:11:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:50.498 01:11:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:50.498 01:11:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:50.498 01:11:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:50.498 01:11:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:50.498 01:11:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:50.498 01:11:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:50.498 01:11:40 -- nvmf/common.sh@294 -- # net_devs=() 00:18:50.498 01:11:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:50.498 01:11:40 -- nvmf/common.sh@295 -- # e810=() 00:18:50.498 01:11:40 -- nvmf/common.sh@295 -- # local -ga e810 00:18:50.498 01:11:40 -- nvmf/common.sh@296 -- # x722=() 00:18:50.498 01:11:40 -- nvmf/common.sh@296 -- # local -ga x722 00:18:50.498 01:11:40 -- nvmf/common.sh@297 -- # mlx=() 00:18:50.498 01:11:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:50.498 01:11:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:50.498 01:11:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:50.498 01:11:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:50.498 01:11:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:50.498 01:11:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:50.498 01:11:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:50.499 01:11:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:50.499 01:11:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:50.499 01:11:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:50.499 01:11:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:50.499 01:11:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:50.499 01:11:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:50.499 01:11:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:50.499 01:11:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:50.499 01:11:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:50.499 01:11:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:50.499 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:50.499 01:11:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:50.499 01:11:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:50.499 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:50.499 01:11:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:50.499 01:11:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:50.499 01:11:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:50.499 01:11:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:50.499 01:11:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:50.499 01:11:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:50.499 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:50.499 01:11:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:50.499 01:11:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:50.499 01:11:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:50.499 01:11:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:50.499 01:11:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:50.499 01:11:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:50.499 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:50.499 01:11:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:50.499 01:11:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:50.499 01:11:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:50.499 01:11:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:50.499 01:11:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:50.499 01:11:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:50.499 01:11:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:50.499 01:11:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:50.499 01:11:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:50.499 01:11:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:50.499 01:11:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:50.499 01:11:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:50.499 01:11:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:50.499 01:11:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:50.499 01:11:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:50.499 01:11:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:50.499 01:11:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:50.499 01:11:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:50.499 01:11:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:50.499 01:11:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:50.499 01:11:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:50.499 01:11:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:50.499 01:11:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:50.499 01:11:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:50.499 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:50.499 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.250 ms 00:18:50.499 00:18:50.499 --- 10.0.0.2 ping statistics --- 00:18:50.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:50.499 rtt min/avg/max/mdev = 0.250/0.250/0.250/0.000 ms 00:18:50.499 01:11:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:50.499 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:50.499 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:18:50.499 00:18:50.499 --- 10.0.0.1 ping statistics --- 00:18:50.499 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:50.499 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:18:50.499 01:11:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:50.499 01:11:40 -- nvmf/common.sh@410 -- # return 0 00:18:50.499 01:11:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:50.499 01:11:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:50.499 01:11:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:50.499 01:11:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:50.499 01:11:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:50.499 01:11:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:50.499 01:11:40 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=1079152 00:18:50.499 01:11:40 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:50.499 01:11:40 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:50.499 01:11:40 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 1079152 00:18:50.499 01:11:40 -- common/autotest_common.sh@829 -- # '[' -z 1079152 ']' 00:18:50.499 01:11:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:50.499 01:11:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:50.499 01:11:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:50.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:50.499 01:11:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:50.499 01:11:40 -- common/autotest_common.sh@10 -- # set +x 00:18:51.434 01:11:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:51.434 01:11:41 -- common/autotest_common.sh@862 -- # return 0 00:18:51.434 01:11:41 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:51.434 01:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.434 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:18:51.434 01:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.434 01:11:41 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:51.434 01:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.434 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:18:51.434 Malloc0 00:18:51.434 01:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.434 01:11:41 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:51.434 01:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.434 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:18:51.434 01:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.434 01:11:41 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:51.434 01:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.435 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:18:51.435 01:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.435 01:11:41 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:51.435 01:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:51.435 01:11:41 -- common/autotest_common.sh@10 -- # set +x 00:18:51.435 01:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:51.435 01:11:41 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:51.435 01:11:41 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:23.505 Fuzzing completed. Shutting down the fuzz application 00:19:23.505 00:19:23.505 Dumping successful admin opcodes: 00:19:23.505 8, 9, 10, 24, 00:19:23.505 Dumping successful io opcodes: 00:19:23.505 0, 9, 00:19:23.505 NS: 0x200003aeff00 I/O qp, Total commands completed: 493593, total successful commands: 2837, random_seed: 1264287360 00:19:23.505 NS: 0x200003aeff00 admin qp, Total commands completed: 59088, total successful commands: 470, random_seed: 756935872 00:19:23.505 01:12:12 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:23.505 Fuzzing completed. Shutting down the fuzz application 00:19:23.505 00:19:23.505 Dumping successful admin opcodes: 00:19:23.505 24, 00:19:23.505 Dumping successful io opcodes: 00:19:23.505 00:19:23.505 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 1866871560 00:19:23.505 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 1867026296 00:19:23.505 01:12:13 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:23.505 01:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:23.505 01:12:13 -- common/autotest_common.sh@10 -- # set +x 00:19:23.505 01:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:23.505 01:12:13 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:23.505 01:12:13 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:23.505 01:12:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:23.505 01:12:13 -- nvmf/common.sh@116 -- # sync 00:19:23.505 01:12:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:23.505 01:12:13 -- nvmf/common.sh@119 -- # set +e 00:19:23.505 01:12:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:23.505 01:12:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:23.505 rmmod nvme_tcp 00:19:23.505 rmmod nvme_fabrics 00:19:23.505 rmmod nvme_keyring 00:19:23.505 01:12:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:23.505 01:12:13 -- nvmf/common.sh@123 -- # set -e 00:19:23.505 01:12:13 -- nvmf/common.sh@124 -- # return 0 00:19:23.505 01:12:13 -- nvmf/common.sh@477 -- # '[' -n 1079152 ']' 00:19:23.505 01:12:13 -- nvmf/common.sh@478 -- # killprocess 1079152 00:19:23.505 01:12:13 -- common/autotest_common.sh@936 -- # '[' -z 1079152 ']' 00:19:23.505 01:12:13 -- common/autotest_common.sh@940 -- # kill -0 1079152 00:19:23.505 01:12:13 -- common/autotest_common.sh@941 -- # uname 00:19:23.505 01:12:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:23.505 01:12:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1079152 00:19:23.505 01:12:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:23.505 01:12:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:23.505 01:12:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1079152' 00:19:23.505 killing process with pid 1079152 00:19:23.505 01:12:13 -- common/autotest_common.sh@955 -- # kill 1079152 00:19:23.505 01:12:13 -- common/autotest_common.sh@960 -- # wait 1079152 00:19:23.765 01:12:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:23.765 01:12:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:23.765 01:12:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:23.765 01:12:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:23.765 01:12:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:23.765 01:12:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.765 01:12:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.765 01:12:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.673 01:12:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:25.673 01:12:16 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:25.673 00:19:25.673 real 0m37.932s 00:19:25.673 user 0m53.130s 00:19:25.673 sys 0m14.740s 00:19:25.673 01:12:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:25.673 01:12:16 -- common/autotest_common.sh@10 -- # set +x 00:19:25.673 ************************************ 00:19:25.673 END TEST nvmf_fuzz 00:19:25.673 ************************************ 00:19:25.932 01:12:16 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:25.932 01:12:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:25.932 01:12:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:25.932 01:12:16 -- common/autotest_common.sh@10 -- # set +x 00:19:25.932 ************************************ 00:19:25.932 START TEST nvmf_multiconnection 00:19:25.932 ************************************ 00:19:25.932 01:12:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:25.932 * Looking for test storage... 00:19:25.932 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:25.932 01:12:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:25.932 01:12:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:25.932 01:12:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:25.932 01:12:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:25.932 01:12:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:25.932 01:12:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:25.932 01:12:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:25.932 01:12:16 -- scripts/common.sh@335 -- # IFS=.-: 00:19:25.932 01:12:16 -- scripts/common.sh@335 -- # read -ra ver1 00:19:25.932 01:12:16 -- scripts/common.sh@336 -- # IFS=.-: 00:19:25.932 01:12:16 -- scripts/common.sh@336 -- # read -ra ver2 00:19:25.932 01:12:16 -- scripts/common.sh@337 -- # local 'op=<' 00:19:25.932 01:12:16 -- scripts/common.sh@339 -- # ver1_l=2 00:19:25.932 01:12:16 -- scripts/common.sh@340 -- # ver2_l=1 00:19:25.932 01:12:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:25.932 01:12:16 -- scripts/common.sh@343 -- # case "$op" in 00:19:25.932 01:12:16 -- scripts/common.sh@344 -- # : 1 00:19:25.932 01:12:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:25.932 01:12:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:25.932 01:12:16 -- scripts/common.sh@364 -- # decimal 1 00:19:25.932 01:12:16 -- scripts/common.sh@352 -- # local d=1 00:19:25.932 01:12:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:25.932 01:12:16 -- scripts/common.sh@354 -- # echo 1 00:19:25.932 01:12:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:25.932 01:12:16 -- scripts/common.sh@365 -- # decimal 2 00:19:25.932 01:12:16 -- scripts/common.sh@352 -- # local d=2 00:19:25.932 01:12:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:25.932 01:12:16 -- scripts/common.sh@354 -- # echo 2 00:19:25.932 01:12:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:25.933 01:12:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:25.933 01:12:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:25.933 01:12:16 -- scripts/common.sh@367 -- # return 0 00:19:25.933 01:12:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:25.933 01:12:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:25.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.933 --rc genhtml_branch_coverage=1 00:19:25.933 --rc genhtml_function_coverage=1 00:19:25.933 --rc genhtml_legend=1 00:19:25.933 --rc geninfo_all_blocks=1 00:19:25.933 --rc geninfo_unexecuted_blocks=1 00:19:25.933 00:19:25.933 ' 00:19:25.933 01:12:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:25.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.933 --rc genhtml_branch_coverage=1 00:19:25.933 --rc genhtml_function_coverage=1 00:19:25.933 --rc genhtml_legend=1 00:19:25.933 --rc geninfo_all_blocks=1 00:19:25.933 --rc geninfo_unexecuted_blocks=1 00:19:25.933 00:19:25.933 ' 00:19:25.933 01:12:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:25.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.933 --rc genhtml_branch_coverage=1 00:19:25.933 --rc genhtml_function_coverage=1 00:19:25.933 --rc genhtml_legend=1 00:19:25.933 --rc geninfo_all_blocks=1 00:19:25.933 --rc geninfo_unexecuted_blocks=1 00:19:25.933 00:19:25.933 ' 00:19:25.933 01:12:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:25.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:25.933 --rc genhtml_branch_coverage=1 00:19:25.933 --rc genhtml_function_coverage=1 00:19:25.933 --rc genhtml_legend=1 00:19:25.933 --rc geninfo_all_blocks=1 00:19:25.933 --rc geninfo_unexecuted_blocks=1 00:19:25.933 00:19:25.933 ' 00:19:25.933 01:12:16 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:25.933 01:12:16 -- nvmf/common.sh@7 -- # uname -s 00:19:25.933 01:12:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:25.933 01:12:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:25.933 01:12:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:25.933 01:12:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:25.933 01:12:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:25.933 01:12:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:25.933 01:12:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:25.933 01:12:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:25.933 01:12:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:25.933 01:12:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:25.933 01:12:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.933 01:12:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:25.933 01:12:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:25.933 01:12:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:25.933 01:12:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:25.933 01:12:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:25.933 01:12:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:25.933 01:12:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:25.933 01:12:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:25.933 01:12:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.933 01:12:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.933 01:12:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.933 01:12:16 -- paths/export.sh@5 -- # export PATH 00:19:25.933 01:12:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:25.933 01:12:16 -- nvmf/common.sh@46 -- # : 0 00:19:25.933 01:12:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:25.933 01:12:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:25.933 01:12:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:25.933 01:12:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:25.933 01:12:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:25.933 01:12:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:25.933 01:12:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:25.933 01:12:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:25.933 01:12:16 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:25.933 01:12:16 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:25.933 01:12:16 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:25.933 01:12:16 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:25.933 01:12:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:25.933 01:12:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:25.933 01:12:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:25.933 01:12:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:25.933 01:12:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:25.933 01:12:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.933 01:12:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.933 01:12:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:25.933 01:12:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:25.933 01:12:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:25.933 01:12:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:25.933 01:12:16 -- common/autotest_common.sh@10 -- # set +x 00:19:27.835 01:12:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:27.835 01:12:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:27.835 01:12:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:27.835 01:12:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:27.835 01:12:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:27.835 01:12:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:27.835 01:12:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:27.835 01:12:18 -- nvmf/common.sh@294 -- # net_devs=() 00:19:27.835 01:12:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:27.835 01:12:18 -- nvmf/common.sh@295 -- # e810=() 00:19:27.835 01:12:18 -- nvmf/common.sh@295 -- # local -ga e810 00:19:27.835 01:12:18 -- nvmf/common.sh@296 -- # x722=() 00:19:27.835 01:12:18 -- nvmf/common.sh@296 -- # local -ga x722 00:19:27.835 01:12:18 -- nvmf/common.sh@297 -- # mlx=() 00:19:27.835 01:12:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:27.835 01:12:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:27.835 01:12:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:27.835 01:12:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:27.835 01:12:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:27.835 01:12:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.835 01:12:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:27.835 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:27.835 01:12:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:27.835 01:12:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:27.835 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:27.835 01:12:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:27.835 01:12:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:28.094 01:12:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:28.094 01:12:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:28.094 01:12:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:28.094 01:12:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:28.094 01:12:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:28.094 01:12:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:28.094 01:12:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:28.094 01:12:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:28.094 01:12:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:28.094 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:28.094 01:12:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:28.094 01:12:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:28.094 01:12:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:28.094 01:12:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:28.094 01:12:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:28.094 01:12:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:28.094 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:28.094 01:12:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:28.094 01:12:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:28.094 01:12:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:28.094 01:12:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:28.094 01:12:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:28.094 01:12:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:28.094 01:12:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:28.094 01:12:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:28.094 01:12:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:28.094 01:12:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:28.095 01:12:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:28.095 01:12:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:28.095 01:12:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:28.095 01:12:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:28.095 01:12:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:28.095 01:12:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:28.095 01:12:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:28.095 01:12:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:28.095 01:12:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:28.095 01:12:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:28.095 01:12:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:28.095 01:12:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:28.095 01:12:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:28.095 01:12:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:28.095 01:12:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:28.095 01:12:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:28.095 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:28.095 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:19:28.095 00:19:28.095 --- 10.0.0.2 ping statistics --- 00:19:28.095 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.095 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:19:28.095 01:12:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:28.095 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:28.095 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:19:28.095 00:19:28.095 --- 10.0.0.1 ping statistics --- 00:19:28.095 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:28.095 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:19:28.095 01:12:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:28.095 01:12:18 -- nvmf/common.sh@410 -- # return 0 00:19:28.095 01:12:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:28.095 01:12:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:28.095 01:12:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:28.095 01:12:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:28.095 01:12:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:28.095 01:12:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:28.095 01:12:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:28.095 01:12:18 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:28.095 01:12:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:28.095 01:12:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:28.095 01:12:18 -- common/autotest_common.sh@10 -- # set +x 00:19:28.095 01:12:18 -- nvmf/common.sh@469 -- # nvmfpid=1085749 00:19:28.095 01:12:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:28.095 01:12:18 -- nvmf/common.sh@470 -- # waitforlisten 1085749 00:19:28.095 01:12:18 -- common/autotest_common.sh@829 -- # '[' -z 1085749 ']' 00:19:28.095 01:12:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:28.095 01:12:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:28.095 01:12:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:28.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:28.095 01:12:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:28.095 01:12:18 -- common/autotest_common.sh@10 -- # set +x 00:19:28.095 [2024-11-26 01:12:18.589279] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:28.095 [2024-11-26 01:12:18.589344] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:28.095 EAL: No free 2048 kB hugepages reported on node 1 00:19:28.355 [2024-11-26 01:12:18.660363] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:28.355 [2024-11-26 01:12:18.781541] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:28.355 [2024-11-26 01:12:18.781713] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:28.355 [2024-11-26 01:12:18.781734] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:28.355 [2024-11-26 01:12:18.781749] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:28.355 [2024-11-26 01:12:18.781807] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:28.355 [2024-11-26 01:12:18.781850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:28.355 [2024-11-26 01:12:18.781876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:28.355 [2024-11-26 01:12:18.781880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:29.293 01:12:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:29.293 01:12:19 -- common/autotest_common.sh@862 -- # return 0 00:19:29.293 01:12:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:29.293 01:12:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:29.293 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.293 01:12:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:29.293 01:12:19 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:29.293 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.293 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.293 [2024-11-26 01:12:19.679584] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:29.293 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.293 01:12:19 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:29.293 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.293 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 Malloc1 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 [2024-11-26 01:12:19.737364] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.294 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 Malloc2 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.294 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 Malloc3 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.294 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.294 01:12:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:29.294 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.294 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.553 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 Malloc4 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.553 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 Malloc5 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.553 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 Malloc6 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:19 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.553 01:12:19 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:29.553 01:12:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:19 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 Malloc7 00:19:29.553 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:20 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:29.553 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:20 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:29.553 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:20 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:29.553 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.553 01:12:20 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.553 01:12:20 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:29.553 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.553 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.553 Malloc8 00:19:29.554 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.554 01:12:20 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:29.554 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.554 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.554 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.554 01:12:20 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:29.554 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.554 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.554 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.554 01:12:20 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:29.554 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.554 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.812 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.812 01:12:20 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.812 01:12:20 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:29.812 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.812 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.812 Malloc9 00:19:29.812 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.812 01:12:20 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:29.812 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.812 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.812 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.812 01:12:20 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:29.812 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.812 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.813 01:12:20 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 Malloc10 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.813 01:12:20 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 Malloc11 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:29.813 01:12:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:29.813 01:12:20 -- common/autotest_common.sh@10 -- # set +x 00:19:29.813 01:12:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:29.813 01:12:20 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:29.813 01:12:20 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:29.813 01:12:20 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:30.753 01:12:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:30.753 01:12:20 -- common/autotest_common.sh@1187 -- # local i=0 00:19:30.753 01:12:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:30.753 01:12:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:30.753 01:12:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:32.732 01:12:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:32.732 01:12:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:32.732 01:12:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:32.732 01:12:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:32.732 01:12:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:32.732 01:12:22 -- common/autotest_common.sh@1197 -- # return 0 00:19:32.732 01:12:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:32.733 01:12:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:33.299 01:12:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:33.299 01:12:23 -- common/autotest_common.sh@1187 -- # local i=0 00:19:33.299 01:12:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:33.299 01:12:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:33.299 01:12:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:35.206 01:12:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:35.206 01:12:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:35.206 01:12:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:35.206 01:12:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:35.206 01:12:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:35.206 01:12:25 -- common/autotest_common.sh@1197 -- # return 0 00:19:35.206 01:12:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:35.206 01:12:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:35.775 01:12:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:35.775 01:12:26 -- common/autotest_common.sh@1187 -- # local i=0 00:19:35.775 01:12:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:35.775 01:12:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:35.775 01:12:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:38.310 01:12:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:38.310 01:12:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:38.310 01:12:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:38.310 01:12:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:38.310 01:12:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:38.310 01:12:28 -- common/autotest_common.sh@1197 -- # return 0 00:19:38.310 01:12:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:38.310 01:12:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:38.571 01:12:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:38.571 01:12:28 -- common/autotest_common.sh@1187 -- # local i=0 00:19:38.571 01:12:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:38.571 01:12:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:38.571 01:12:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:40.479 01:12:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:40.479 01:12:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:40.479 01:12:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:40.479 01:12:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:40.479 01:12:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:40.479 01:12:30 -- common/autotest_common.sh@1197 -- # return 0 00:19:40.479 01:12:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:40.479 01:12:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:41.413 01:12:31 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:41.413 01:12:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:41.413 01:12:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:41.413 01:12:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:41.413 01:12:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:43.322 01:12:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:43.322 01:12:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:43.322 01:12:33 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:43.322 01:12:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:43.322 01:12:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:43.322 01:12:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:43.322 01:12:33 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:43.322 01:12:33 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:44.257 01:12:34 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:44.257 01:12:34 -- common/autotest_common.sh@1187 -- # local i=0 00:19:44.257 01:12:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:44.257 01:12:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:44.257 01:12:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:46.164 01:12:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:46.164 01:12:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:46.164 01:12:36 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:46.164 01:12:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:46.165 01:12:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:46.165 01:12:36 -- common/autotest_common.sh@1197 -- # return 0 00:19:46.165 01:12:36 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:46.165 01:12:36 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:47.103 01:12:37 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:47.103 01:12:37 -- common/autotest_common.sh@1187 -- # local i=0 00:19:47.103 01:12:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:47.103 01:12:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:47.103 01:12:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:49.011 01:12:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:49.011 01:12:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:49.011 01:12:39 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:49.011 01:12:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:49.011 01:12:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:49.011 01:12:39 -- common/autotest_common.sh@1197 -- # return 0 00:19:49.011 01:12:39 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:49.011 01:12:39 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:49.948 01:12:40 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:49.948 01:12:40 -- common/autotest_common.sh@1187 -- # local i=0 00:19:49.948 01:12:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:49.948 01:12:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:49.948 01:12:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:51.850 01:12:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:51.850 01:12:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:51.850 01:12:42 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:51.850 01:12:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:51.850 01:12:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:51.850 01:12:42 -- common/autotest_common.sh@1197 -- # return 0 00:19:51.850 01:12:42 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:51.850 01:12:42 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:52.783 01:12:43 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:52.783 01:12:43 -- common/autotest_common.sh@1187 -- # local i=0 00:19:52.783 01:12:43 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:52.783 01:12:43 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:52.783 01:12:43 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:54.683 01:12:45 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:54.683 01:12:45 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:54.683 01:12:45 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:19:54.683 01:12:45 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:54.683 01:12:45 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:54.683 01:12:45 -- common/autotest_common.sh@1197 -- # return 0 00:19:54.683 01:12:45 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:54.683 01:12:45 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:19:55.619 01:12:45 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:19:55.619 01:12:45 -- common/autotest_common.sh@1187 -- # local i=0 00:19:55.619 01:12:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:55.619 01:12:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:55.619 01:12:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:57.516 01:12:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:57.516 01:12:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:57.516 01:12:47 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:19:57.516 01:12:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:57.516 01:12:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:57.516 01:12:47 -- common/autotest_common.sh@1197 -- # return 0 00:19:57.516 01:12:47 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:57.516 01:12:47 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:19:58.449 01:12:48 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:19:58.449 01:12:48 -- common/autotest_common.sh@1187 -- # local i=0 00:19:58.449 01:12:48 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:58.449 01:12:48 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:58.449 01:12:48 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:00.349 01:12:50 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:00.349 01:12:50 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:00.349 01:12:50 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:00.349 01:12:50 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:00.349 01:12:50 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:00.349 01:12:50 -- common/autotest_common.sh@1197 -- # return 0 00:20:00.349 01:12:50 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:00.349 [global] 00:20:00.349 thread=1 00:20:00.349 invalidate=1 00:20:00.349 rw=read 00:20:00.349 time_based=1 00:20:00.349 runtime=10 00:20:00.349 ioengine=libaio 00:20:00.349 direct=1 00:20:00.349 bs=262144 00:20:00.349 iodepth=64 00:20:00.349 norandommap=1 00:20:00.349 numjobs=1 00:20:00.349 00:20:00.349 [job0] 00:20:00.349 filename=/dev/nvme0n1 00:20:00.349 [job1] 00:20:00.349 filename=/dev/nvme10n1 00:20:00.349 [job2] 00:20:00.349 filename=/dev/nvme1n1 00:20:00.349 [job3] 00:20:00.349 filename=/dev/nvme2n1 00:20:00.349 [job4] 00:20:00.349 filename=/dev/nvme3n1 00:20:00.349 [job5] 00:20:00.349 filename=/dev/nvme4n1 00:20:00.349 [job6] 00:20:00.349 filename=/dev/nvme5n1 00:20:00.349 [job7] 00:20:00.349 filename=/dev/nvme6n1 00:20:00.349 [job8] 00:20:00.349 filename=/dev/nvme7n1 00:20:00.349 [job9] 00:20:00.349 filename=/dev/nvme8n1 00:20:00.349 [job10] 00:20:00.349 filename=/dev/nvme9n1 00:20:00.608 Could not set queue depth (nvme0n1) 00:20:00.608 Could not set queue depth (nvme10n1) 00:20:00.608 Could not set queue depth (nvme1n1) 00:20:00.608 Could not set queue depth (nvme2n1) 00:20:00.608 Could not set queue depth (nvme3n1) 00:20:00.608 Could not set queue depth (nvme4n1) 00:20:00.608 Could not set queue depth (nvme5n1) 00:20:00.608 Could not set queue depth (nvme6n1) 00:20:00.608 Could not set queue depth (nvme7n1) 00:20:00.608 Could not set queue depth (nvme8n1) 00:20:00.608 Could not set queue depth (nvme9n1) 00:20:00.608 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:00.608 fio-3.35 00:20:00.608 Starting 11 threads 00:20:12.836 00:20:12.836 job0: (groupid=0, jobs=1): err= 0: pid=1090264: Tue Nov 26 01:13:01 2024 00:20:12.836 read: IOPS=767, BW=192MiB/s (201MB/s)(1930MiB/10055msec) 00:20:12.836 slat (usec): min=8, max=128272, avg=826.91, stdev=3490.76 00:20:12.836 clat (msec): min=3, max=202, avg=82.47, stdev=34.78 00:20:12.836 lat (msec): min=3, max=269, avg=83.30, stdev=35.17 00:20:12.836 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 11], 5.00th=[ 25], 10.00th=[ 36], 20.00th=[ 55], 00:20:12.837 | 30.00th=[ 65], 40.00th=[ 73], 50.00th=[ 82], 60.00th=[ 90], 00:20:12.837 | 70.00th=[ 100], 80.00th=[ 111], 90.00th=[ 128], 95.00th=[ 142], 00:20:12.837 | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 199], 99.95th=[ 203], 00:20:12.837 | 99.99th=[ 203] 00:20:12.837 bw ( KiB/s): min=148480, max=278016, per=9.94%, avg=196013.35, stdev=37226.14, samples=20 00:20:12.837 iops : min= 580, max= 1086, avg=765.65, stdev=145.42, samples=20 00:20:12.837 lat (msec) : 4=0.05%, 10=0.93%, 20=2.64%, 50=13.42%, 100=53.15% 00:20:12.837 lat (msec) : 250=29.81% 00:20:12.837 cpu : usr=0.33%, sys=1.93%, ctx=1574, majf=0, minf=4097 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=7720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job1: (groupid=0, jobs=1): err= 0: pid=1090265: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=640, BW=160MiB/s (168MB/s)(1612MiB/10061msec) 00:20:12.837 slat (usec): min=9, max=122570, avg=627.55, stdev=3331.09 00:20:12.837 clat (usec): min=1781, max=374440, avg=99186.16, stdev=49272.53 00:20:12.837 lat (usec): min=1804, max=374471, avg=99813.71, stdev=49631.25 00:20:12.837 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 11], 5.00th=[ 33], 10.00th=[ 46], 20.00th=[ 64], 00:20:12.837 | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 93], 60.00th=[ 106], 00:20:12.837 | 70.00th=[ 116], 80.00th=[ 130], 90.00th=[ 150], 95.00th=[ 194], 00:20:12.837 | 99.00th=[ 279], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 363], 00:20:12.837 | 99.99th=[ 376] 00:20:12.837 bw ( KiB/s): min=86528, max=234496, per=8.29%, avg=163358.45, stdev=44782.87, samples=20 00:20:12.837 iops : min= 338, max= 916, avg=638.20, stdev=174.84, samples=20 00:20:12.837 lat (msec) : 2=0.03%, 4=0.26%, 10=0.61%, 20=1.30%, 50=9.48% 00:20:12.837 lat (msec) : 100=44.24%, 250=42.65%, 500=1.43% 00:20:12.837 cpu : usr=0.29%, sys=1.76%, ctx=1605, majf=0, minf=4097 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=6446,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job2: (groupid=0, jobs=1): err= 0: pid=1090272: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=670, BW=168MiB/s (176MB/s)(1691MiB/10081msec) 00:20:12.837 slat (usec): min=8, max=121222, avg=994.49, stdev=4385.28 00:20:12.837 clat (usec): min=826, max=384779, avg=94332.53, stdev=56813.06 00:20:12.837 lat (usec): min=844, max=466647, avg=95327.02, stdev=57506.58 00:20:12.837 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 9], 5.00th=[ 26], 10.00th=[ 40], 20.00th=[ 49], 00:20:12.837 | 30.00th=[ 58], 40.00th=[ 73], 50.00th=[ 87], 60.00th=[ 97], 00:20:12.837 | 70.00th=[ 110], 80.00th=[ 128], 90.00th=[ 165], 95.00th=[ 188], 00:20:12.837 | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 355], 99.95th=[ 355], 00:20:12.837 | 99.99th=[ 384] 00:20:12.837 bw ( KiB/s): min=63361, max=311296, per=8.70%, avg=171513.65, stdev=68441.76, samples=20 00:20:12.837 iops : min= 247, max= 1216, avg=669.95, stdev=267.39, samples=20 00:20:12.837 lat (usec) : 1000=0.01% 00:20:12.837 lat (msec) : 2=0.13%, 4=0.44%, 10=0.58%, 20=2.66%, 50=17.74% 00:20:12.837 lat (msec) : 100=40.87%, 250=34.56%, 500=3.00% 00:20:12.837 cpu : usr=0.27%, sys=1.95%, ctx=1399, majf=0, minf=4097 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=6763,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job3: (groupid=0, jobs=1): err= 0: pid=1090273: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=530, BW=133MiB/s (139MB/s)(1337MiB/10084msec) 00:20:12.837 slat (usec): min=13, max=147834, avg=1819.42, stdev=6086.80 00:20:12.837 clat (msec): min=3, max=423, avg=118.72, stdev=56.01 00:20:12.837 lat (msec): min=3, max=432, avg=120.54, stdev=57.01 00:20:12.837 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 21], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 80], 00:20:12.837 | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 120], 00:20:12.837 | 70.00th=[ 131], 80.00th=[ 150], 90.00th=[ 184], 95.00th=[ 232], 00:20:12.837 | 99.00th=[ 355], 99.50th=[ 363], 99.90th=[ 376], 99.95th=[ 422], 00:20:12.837 | 99.99th=[ 422] 00:20:12.837 bw ( KiB/s): min=43008, max=237056, per=6.86%, avg=135280.20, stdev=49395.73, samples=20 00:20:12.837 iops : min= 168, max= 926, avg=528.40, stdev=192.93, samples=20 00:20:12.837 lat (msec) : 4=0.04%, 10=0.34%, 20=0.58%, 50=2.86%, 100=37.61% 00:20:12.837 lat (msec) : 250=55.17%, 500=3.40% 00:20:12.837 cpu : usr=0.22%, sys=2.05%, ctx=1010, majf=0, minf=3721 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=5349,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job4: (groupid=0, jobs=1): err= 0: pid=1090274: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=1061, BW=265MiB/s (278MB/s)(2674MiB/10081msec) 00:20:12.837 slat (usec): min=9, max=122820, avg=732.19, stdev=2898.78 00:20:12.837 clat (msec): min=2, max=227, avg=59.53, stdev=39.37 00:20:12.837 lat (msec): min=2, max=228, avg=60.26, stdev=39.61 00:20:12.837 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 10], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 31], 00:20:12.837 | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], 00:20:12.837 | 70.00th=[ 66], 80.00th=[ 87], 90.00th=[ 109], 95.00th=[ 136], 00:20:12.837 | 99.00th=[ 205], 99.50th=[ 211], 99.90th=[ 222], 99.95th=[ 222], 00:20:12.837 | 99.99th=[ 226] 00:20:12.837 bw ( KiB/s): min=94720, max=478720, per=13.81%, avg=272226.55, stdev=119758.31, samples=20 00:20:12.837 iops : min= 370, max= 1870, avg=1063.35, stdev=467.84, samples=20 00:20:12.837 lat (msec) : 4=0.27%, 10=0.74%, 20=1.97%, 50=51.39%, 100=31.22% 00:20:12.837 lat (msec) : 250=14.41% 00:20:12.837 cpu : usr=0.63%, sys=3.30%, ctx=1872, majf=0, minf=4097 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=10697,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job5: (groupid=0, jobs=1): err= 0: pid=1090277: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=538, BW=135MiB/s (141MB/s)(1357MiB/10084msec) 00:20:12.837 slat (usec): min=9, max=84837, avg=1127.65, stdev=4732.66 00:20:12.837 clat (usec): min=1600, max=371799, avg=117692.71, stdev=60107.03 00:20:12.837 lat (usec): min=1617, max=414612, avg=118820.36, stdev=60858.53 00:20:12.837 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 14], 5.00th=[ 34], 10.00th=[ 45], 20.00th=[ 74], 00:20:12.837 | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 122], 00:20:12.837 | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 190], 95.00th=[ 226], 00:20:12.837 | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 368], 99.95th=[ 372], 00:20:12.837 | 99.99th=[ 372] 00:20:12.837 bw ( KiB/s): min=52224, max=214444, per=6.97%, avg=137320.95, stdev=46252.43, samples=20 00:20:12.837 iops : min= 204, max= 837, avg=536.35, stdev=180.58, samples=20 00:20:12.837 lat (msec) : 2=0.04%, 4=0.11%, 10=0.52%, 20=1.23%, 50=9.25% 00:20:12.837 lat (msec) : 100=32.67%, 250=52.31%, 500=3.87% 00:20:12.837 cpu : usr=0.28%, sys=1.53%, ctx=1298, majf=0, minf=4097 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=5427,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job6: (groupid=0, jobs=1): err= 0: pid=1090278: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=638, BW=160MiB/s (167MB/s)(1605MiB/10045msec) 00:20:12.837 slat (usec): min=8, max=166023, avg=756.23, stdev=5031.38 00:20:12.837 clat (msec): min=3, max=506, avg=99.34, stdev=61.92 00:20:12.837 lat (msec): min=3, max=506, avg=100.09, stdev=62.68 00:20:12.837 clat percentiles (msec): 00:20:12.837 | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 25], 20.00th=[ 50], 00:20:12.837 | 30.00th=[ 68], 40.00th=[ 82], 50.00th=[ 93], 60.00th=[ 107], 00:20:12.837 | 70.00th=[ 118], 80.00th=[ 136], 90.00th=[ 171], 95.00th=[ 218], 00:20:12.837 | 99.00th=[ 317], 99.50th=[ 334], 99.90th=[ 363], 99.95th=[ 368], 00:20:12.837 | 99.99th=[ 506] 00:20:12.837 bw ( KiB/s): min=63361, max=251904, per=8.25%, avg=162672.55, stdev=54391.39, samples=20 00:20:12.837 iops : min= 247, max= 984, avg=635.40, stdev=212.51, samples=20 00:20:12.837 lat (msec) : 4=0.28%, 10=2.37%, 20=5.86%, 50=12.25%, 100=33.83% 00:20:12.837 lat (msec) : 250=41.63%, 500=3.76%, 750=0.03% 00:20:12.837 cpu : usr=0.32%, sys=1.69%, ctx=1535, majf=0, minf=4097 00:20:12.837 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:12.837 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.837 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.837 issued rwts: total=6418,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.837 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.837 job7: (groupid=0, jobs=1): err= 0: pid=1090279: Tue Nov 26 01:13:01 2024 00:20:12.837 read: IOPS=683, BW=171MiB/s (179MB/s)(1721MiB/10079msec) 00:20:12.837 slat (usec): min=9, max=95377, avg=1226.39, stdev=4741.47 00:20:12.837 clat (msec): min=4, max=405, avg=92.39, stdev=65.00 00:20:12.837 lat (msec): min=4, max=405, avg=93.62, stdev=66.03 00:20:12.837 clat percentiles (msec): 00:20:12.838 | 1.00th=[ 18], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 39], 00:20:12.838 | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 73], 60.00th=[ 92], 00:20:12.838 | 70.00th=[ 115], 80.00th=[ 138], 90.00th=[ 184], 95.00th=[ 211], 00:20:12.838 | 99.00th=[ 317], 99.50th=[ 351], 99.90th=[ 380], 99.95th=[ 380], 00:20:12.838 | 99.99th=[ 405] 00:20:12.838 bw ( KiB/s): min=45988, max=408064, per=8.86%, avg=174638.60, stdev=106565.29, samples=20 00:20:12.838 iops : min= 179, max= 1594, avg=682.15, stdev=416.31, samples=20 00:20:12.838 lat (msec) : 10=0.38%, 20=0.77%, 50=36.94%, 100=25.53%, 250=33.41% 00:20:12.838 lat (msec) : 500=2.98% 00:20:12.838 cpu : usr=0.29%, sys=2.27%, ctx=1240, majf=0, minf=4097 00:20:12.838 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:12.838 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.838 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.838 issued rwts: total=6885,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.838 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.838 job8: (groupid=0, jobs=1): err= 0: pid=1090282: Tue Nov 26 01:13:01 2024 00:20:12.838 read: IOPS=924, BW=231MiB/s (242MB/s)(2330MiB/10083msec) 00:20:12.838 slat (usec): min=9, max=93503, avg=890.91, stdev=3077.79 00:20:12.838 clat (usec): min=1851, max=214052, avg=68287.11, stdev=40174.34 00:20:12.838 lat (usec): min=1920, max=214070, avg=69178.01, stdev=40557.33 00:20:12.838 clat percentiles (msec): 00:20:12.838 | 1.00th=[ 14], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 29], 00:20:12.838 | 30.00th=[ 32], 40.00th=[ 46], 50.00th=[ 62], 60.00th=[ 79], 00:20:12.838 | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 124], 95.00th=[ 140], 00:20:12.838 | 99.00th=[ 178], 99.50th=[ 186], 99.90th=[ 205], 99.95th=[ 209], 00:20:12.838 | 99.99th=[ 215] 00:20:12.838 bw ( KiB/s): min=124416, max=555008, per=12.02%, avg=236953.35, stdev=119898.36, samples=20 00:20:12.838 iops : min= 486, max= 2168, avg=925.55, stdev=468.38, samples=20 00:20:12.838 lat (msec) : 2=0.01%, 4=0.01%, 10=0.57%, 20=1.35%, 50=40.79% 00:20:12.838 lat (msec) : 100=34.54%, 250=22.73% 00:20:12.838 cpu : usr=0.52%, sys=3.01%, ctx=1775, majf=0, minf=4097 00:20:12.838 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:20:12.838 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.838 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.838 issued rwts: total=9320,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.838 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.838 job9: (groupid=0, jobs=1): err= 0: pid=1090283: Tue Nov 26 01:13:01 2024 00:20:12.838 read: IOPS=658, BW=165MiB/s (173MB/s)(1655MiB/10060msec) 00:20:12.838 slat (usec): min=9, max=49688, avg=1398.44, stdev=4021.74 00:20:12.838 clat (msec): min=14, max=181, avg=95.77, stdev=26.99 00:20:12.838 lat (msec): min=14, max=181, avg=97.17, stdev=27.45 00:20:12.838 clat percentiles (msec): 00:20:12.838 | 1.00th=[ 32], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 73], 00:20:12.838 | 30.00th=[ 81], 40.00th=[ 87], 50.00th=[ 94], 60.00th=[ 102], 00:20:12.838 | 70.00th=[ 111], 80.00th=[ 121], 90.00th=[ 132], 95.00th=[ 142], 00:20:12.838 | 99.00th=[ 155], 99.50th=[ 161], 99.90th=[ 167], 99.95th=[ 180], 00:20:12.838 | 99.99th=[ 182] 00:20:12.838 bw ( KiB/s): min=120320, max=254976, per=8.52%, avg=167866.30, stdev=35151.03, samples=20 00:20:12.838 iops : min= 470, max= 996, avg=655.70, stdev=137.29, samples=20 00:20:12.838 lat (msec) : 20=0.12%, 50=3.58%, 100=54.27%, 250=42.03% 00:20:12.838 cpu : usr=0.42%, sys=2.23%, ctx=1222, majf=0, minf=4097 00:20:12.838 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:12.838 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.838 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.838 issued rwts: total=6621,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.838 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.838 job10: (groupid=0, jobs=1): err= 0: pid=1090284: Tue Nov 26 01:13:01 2024 00:20:12.838 read: IOPS=595, BW=149MiB/s (156MB/s)(1501MiB/10084msec) 00:20:12.838 slat (usec): min=9, max=227912, avg=1109.13, stdev=5257.19 00:20:12.838 clat (msec): min=6, max=430, avg=106.29, stdev=46.39 00:20:12.838 lat (msec): min=6, max=430, avg=107.40, stdev=46.95 00:20:12.838 clat percentiles (msec): 00:20:12.838 | 1.00th=[ 14], 5.00th=[ 32], 10.00th=[ 46], 20.00th=[ 70], 00:20:12.838 | 30.00th=[ 86], 40.00th=[ 100], 50.00th=[ 107], 60.00th=[ 113], 00:20:12.838 | 70.00th=[ 123], 80.00th=[ 138], 90.00th=[ 163], 95.00th=[ 184], 00:20:12.838 | 99.00th=[ 288], 99.50th=[ 305], 99.90th=[ 321], 99.95th=[ 326], 00:20:12.838 | 99.99th=[ 430] 00:20:12.838 bw ( KiB/s): min=111104, max=225280, per=7.72%, avg=152088.05, stdev=31973.68, samples=20 00:20:12.838 iops : min= 434, max= 880, avg=594.05, stdev=124.89, samples=20 00:20:12.838 lat (msec) : 10=0.25%, 20=1.75%, 50=9.86%, 100=29.16%, 250=57.93% 00:20:12.838 lat (msec) : 500=1.05% 00:20:12.838 cpu : usr=0.20%, sys=1.84%, ctx=1285, majf=0, minf=4097 00:20:12.838 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:12.838 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:12.838 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:12.838 issued rwts: total=6004,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:12.838 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:12.838 00:20:12.838 Run status group 0 (all jobs): 00:20:12.838 READ: bw=1925MiB/s (2019MB/s), 133MiB/s-265MiB/s (139MB/s-278MB/s), io=19.0GiB (20.4GB), run=10045-10084msec 00:20:12.838 00:20:12.838 Disk stats (read/write): 00:20:12.838 nvme0n1: ios=15218/0, merge=0/0, ticks=1245179/0, in_queue=1245179, util=97.28% 00:20:12.838 nvme10n1: ios=12640/0, merge=0/0, ticks=1249505/0, in_queue=1249505, util=97.51% 00:20:12.838 nvme1n1: ios=13311/0, merge=0/0, ticks=1242923/0, in_queue=1242923, util=97.75% 00:20:12.838 nvme2n1: ios=10509/0, merge=0/0, ticks=1233439/0, in_queue=1233439, util=97.90% 00:20:12.838 nvme3n1: ios=21198/0, merge=0/0, ticks=1237691/0, in_queue=1237691, util=97.98% 00:20:12.838 nvme4n1: ios=10675/0, merge=0/0, ticks=1240989/0, in_queue=1240989, util=98.29% 00:20:12.838 nvme5n1: ios=12614/0, merge=0/0, ticks=1247637/0, in_queue=1247637, util=98.42% 00:20:12.838 nvme6n1: ios=13585/0, merge=0/0, ticks=1234183/0, in_queue=1234183, util=98.54% 00:20:12.838 nvme7n1: ios=18450/0, merge=0/0, ticks=1237216/0, in_queue=1237216, util=98.94% 00:20:12.838 nvme8n1: ios=13035/0, merge=0/0, ticks=1238698/0, in_queue=1238698, util=99.10% 00:20:12.838 nvme9n1: ios=11786/0, merge=0/0, ticks=1239477/0, in_queue=1239477, util=99.24% 00:20:12.838 01:13:01 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:12.838 [global] 00:20:12.838 thread=1 00:20:12.838 invalidate=1 00:20:12.838 rw=randwrite 00:20:12.838 time_based=1 00:20:12.838 runtime=10 00:20:12.838 ioengine=libaio 00:20:12.838 direct=1 00:20:12.838 bs=262144 00:20:12.838 iodepth=64 00:20:12.838 norandommap=1 00:20:12.838 numjobs=1 00:20:12.838 00:20:12.838 [job0] 00:20:12.838 filename=/dev/nvme0n1 00:20:12.838 [job1] 00:20:12.838 filename=/dev/nvme10n1 00:20:12.838 [job2] 00:20:12.838 filename=/dev/nvme1n1 00:20:12.838 [job3] 00:20:12.838 filename=/dev/nvme2n1 00:20:12.838 [job4] 00:20:12.838 filename=/dev/nvme3n1 00:20:12.838 [job5] 00:20:12.838 filename=/dev/nvme4n1 00:20:12.838 [job6] 00:20:12.838 filename=/dev/nvme5n1 00:20:12.838 [job7] 00:20:12.838 filename=/dev/nvme6n1 00:20:12.838 [job8] 00:20:12.838 filename=/dev/nvme7n1 00:20:12.838 [job9] 00:20:12.838 filename=/dev/nvme8n1 00:20:12.838 [job10] 00:20:12.838 filename=/dev/nvme9n1 00:20:12.838 Could not set queue depth (nvme0n1) 00:20:12.838 Could not set queue depth (nvme10n1) 00:20:12.838 Could not set queue depth (nvme1n1) 00:20:12.838 Could not set queue depth (nvme2n1) 00:20:12.838 Could not set queue depth (nvme3n1) 00:20:12.838 Could not set queue depth (nvme4n1) 00:20:12.838 Could not set queue depth (nvme5n1) 00:20:12.838 Could not set queue depth (nvme6n1) 00:20:12.838 Could not set queue depth (nvme7n1) 00:20:12.838 Could not set queue depth (nvme8n1) 00:20:12.838 Could not set queue depth (nvme9n1) 00:20:12.838 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:12.838 fio-3.35 00:20:12.838 Starting 11 threads 00:20:22.820 00:20:22.820 job0: (groupid=0, jobs=1): err= 0: pid=1091328: Tue Nov 26 01:13:12 2024 00:20:22.820 write: IOPS=464, BW=116MiB/s (122MB/s)(1189MiB/10233msec); 0 zone resets 00:20:22.820 slat (usec): min=25, max=84975, avg=1915.35, stdev=4218.53 00:20:22.820 clat (usec): min=1498, max=545183, avg=135662.22, stdev=61520.40 00:20:22.820 lat (usec): min=1539, max=545236, avg=137577.57, stdev=62209.58 00:20:22.820 clat percentiles (msec): 00:20:22.820 | 1.00th=[ 41], 5.00th=[ 77], 10.00th=[ 83], 20.00th=[ 90], 00:20:22.820 | 30.00th=[ 95], 40.00th=[ 111], 50.00th=[ 122], 60.00th=[ 132], 00:20:22.820 | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 259], 00:20:22.820 | 99.00th=[ 326], 99.50th=[ 380], 99.90th=[ 514], 99.95th=[ 514], 00:20:22.820 | 99.99th=[ 542] 00:20:22.820 bw ( KiB/s): min=53248, max=178176, per=8.48%, avg=120132.70, stdev=36914.88, samples=20 00:20:22.820 iops : min= 208, max= 696, avg=469.25, stdev=144.17, samples=20 00:20:22.820 lat (msec) : 2=0.04%, 4=0.17%, 10=0.04%, 20=0.19%, 50=0.88% 00:20:22.820 lat (msec) : 100=32.16%, 250=60.99%, 500=5.40%, 750=0.13% 00:20:22.820 cpu : usr=1.48%, sys=1.44%, ctx=1529, majf=0, minf=1 00:20:22.820 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:22.820 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.820 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.820 issued rwts: total=0,4755,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.820 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.820 job1: (groupid=0, jobs=1): err= 0: pid=1091329: Tue Nov 26 01:13:12 2024 00:20:22.820 write: IOPS=577, BW=144MiB/s (151MB/s)(1478MiB/10238msec); 0 zone resets 00:20:22.820 slat (usec): min=25, max=84568, avg=1551.18, stdev=4015.20 00:20:22.820 clat (usec): min=960, max=435899, avg=109193.43, stdev=80554.80 00:20:22.820 lat (usec): min=1043, max=435991, avg=110744.61, stdev=81513.60 00:20:22.820 clat percentiles (msec): 00:20:22.820 | 1.00th=[ 38], 5.00th=[ 40], 10.00th=[ 41], 20.00th=[ 43], 00:20:22.820 | 30.00th=[ 46], 40.00th=[ 74], 50.00th=[ 85], 60.00th=[ 97], 00:20:22.820 | 70.00th=[ 114], 80.00th=[ 169], 90.00th=[ 241], 95.00th=[ 279], 00:20:22.820 | 99.00th=[ 359], 99.50th=[ 363], 99.90th=[ 426], 99.95th=[ 426], 00:20:22.820 | 99.99th=[ 435] 00:20:22.820 bw ( KiB/s): min=49152, max=393728, per=10.57%, avg=149664.35, stdev=102167.97, samples=20 00:20:22.820 iops : min= 192, max= 1538, avg=584.60, stdev=399.12, samples=20 00:20:22.820 lat (usec) : 1000=0.02% 00:20:22.820 lat (msec) : 2=0.15%, 4=0.08%, 10=0.12%, 20=0.03%, 50=32.59% 00:20:22.820 lat (msec) : 100=28.38%, 250=30.02%, 500=8.61% 00:20:22.820 cpu : usr=1.69%, sys=2.04%, ctx=1741, majf=0, minf=1 00:20:22.820 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:22.820 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.820 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.820 issued rwts: total=0,5910,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.820 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.820 job2: (groupid=0, jobs=1): err= 0: pid=1091330: Tue Nov 26 01:13:12 2024 00:20:22.820 write: IOPS=576, BW=144MiB/s (151MB/s)(1476MiB/10237msec); 0 zone resets 00:20:22.820 slat (usec): min=20, max=39572, avg=1417.01, stdev=3615.58 00:20:22.820 clat (usec): min=1362, max=492632, avg=109426.56, stdev=74638.32 00:20:22.820 lat (usec): min=1472, max=492696, avg=110843.57, stdev=75706.40 00:20:22.820 clat percentiles (msec): 00:20:22.820 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 36], 20.00th=[ 42], 00:20:22.820 | 30.00th=[ 58], 40.00th=[ 81], 50.00th=[ 91], 60.00th=[ 106], 00:20:22.820 | 70.00th=[ 128], 80.00th=[ 188], 90.00th=[ 226], 95.00th=[ 249], 00:20:22.820 | 99.00th=[ 279], 99.50th=[ 363], 99.90th=[ 481], 99.95th=[ 481], 00:20:22.820 | 99.99th=[ 493] 00:20:22.820 bw ( KiB/s): min=63488, max=376320, per=10.56%, avg=149529.60, stdev=89396.66, samples=20 00:20:22.820 iops : min= 248, max= 1470, avg=584.10, stdev=349.21, samples=20 00:20:22.820 lat (msec) : 2=0.07%, 4=0.44%, 10=1.91%, 20=3.47%, 50=21.37% 00:20:22.820 lat (msec) : 100=27.69%, 250=40.61%, 500=4.44% 00:20:22.820 cpu : usr=1.75%, sys=1.93%, ctx=2630, majf=0, minf=1 00:20:22.820 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:22.820 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.820 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.820 issued rwts: total=0,5905,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.820 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.820 job3: (groupid=0, jobs=1): err= 0: pid=1091342: Tue Nov 26 01:13:12 2024 00:20:22.820 write: IOPS=363, BW=90.9MiB/s (95.4MB/s)(931MiB/10231msec); 0 zone resets 00:20:22.820 slat (usec): min=26, max=54694, avg=2025.25, stdev=4974.14 00:20:22.820 clat (msec): min=5, max=501, avg=173.70, stdev=75.15 00:20:22.820 lat (msec): min=5, max=501, avg=175.72, stdev=76.22 00:20:22.820 clat percentiles (msec): 00:20:22.820 | 1.00th=[ 21], 5.00th=[ 45], 10.00th=[ 70], 20.00th=[ 106], 00:20:22.820 | 30.00th=[ 134], 40.00th=[ 163], 50.00th=[ 180], 60.00th=[ 203], 00:20:22.820 | 70.00th=[ 213], 80.00th=[ 234], 90.00th=[ 262], 95.00th=[ 284], 00:20:22.820 | 99.00th=[ 338], 99.50th=[ 426], 99.90th=[ 489], 99.95th=[ 502], 00:20:22.820 | 99.99th=[ 502] 00:20:22.820 bw ( KiB/s): min=59392, max=172376, per=6.62%, avg=93687.60, stdev=29750.55, samples=20 00:20:22.820 iops : min= 232, max= 673, avg=365.95, stdev=116.17, samples=20 00:20:22.820 lat (msec) : 10=0.16%, 20=0.83%, 50=5.32%, 100=12.92%, 250=67.09% 00:20:22.820 lat (msec) : 500=13.62%, 750=0.05% 00:20:22.821 cpu : usr=1.36%, sys=1.22%, ctx=1825, majf=0, minf=1 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,3722,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job4: (groupid=0, jobs=1): err= 0: pid=1091343: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=419, BW=105MiB/s (110MB/s)(1061MiB/10110msec); 0 zone resets 00:20:22.821 slat (usec): min=21, max=116628, avg=1945.68, stdev=5224.93 00:20:22.821 clat (msec): min=2, max=378, avg=150.42, stdev=75.75 00:20:22.821 lat (msec): min=3, max=378, avg=152.36, stdev=76.65 00:20:22.821 clat percentiles (msec): 00:20:22.821 | 1.00th=[ 10], 5.00th=[ 21], 10.00th=[ 42], 20.00th=[ 90], 00:20:22.821 | 30.00th=[ 103], 40.00th=[ 128], 50.00th=[ 150], 60.00th=[ 171], 00:20:22.821 | 70.00th=[ 199], 80.00th=[ 211], 90.00th=[ 253], 95.00th=[ 275], 00:20:22.821 | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 368], 99.95th=[ 368], 00:20:22.821 | 99.99th=[ 380] 00:20:22.821 bw ( KiB/s): min=65024, max=175616, per=7.56%, avg=107016.15, stdev=32957.40, samples=20 00:20:22.821 iops : min= 254, max= 686, avg=418.00, stdev=128.77, samples=20 00:20:22.821 lat (msec) : 4=0.09%, 10=1.06%, 20=3.77%, 50=6.39%, 100=17.53% 00:20:22.821 lat (msec) : 250=60.90%, 500=10.25% 00:20:22.821 cpu : usr=1.25%, sys=1.50%, ctx=1909, majf=0, minf=1 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,4243,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job5: (groupid=0, jobs=1): err= 0: pid=1091344: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=517, BW=129MiB/s (136MB/s)(1309MiB/10120msec); 0 zone resets 00:20:22.821 slat (usec): min=16, max=84018, avg=1367.64, stdev=3708.11 00:20:22.821 clat (usec): min=1495, max=341691, avg=122260.63, stdev=67750.45 00:20:22.821 lat (usec): min=1769, max=346313, avg=123628.27, stdev=68411.99 00:20:22.821 clat percentiles (msec): 00:20:22.821 | 1.00th=[ 4], 5.00th=[ 23], 10.00th=[ 43], 20.00th=[ 77], 00:20:22.821 | 30.00th=[ 82], 40.00th=[ 96], 50.00th=[ 112], 60.00th=[ 124], 00:20:22.821 | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 232], 95.00th=[ 266], 00:20:22.821 | 99.00th=[ 300], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 338], 00:20:22.821 | 99.99th=[ 342] 00:20:22.821 bw ( KiB/s): min=62589, max=215040, per=9.35%, avg=132460.65, stdev=38050.70, samples=20 00:20:22.821 iops : min= 244, max= 840, avg=517.40, stdev=148.68, samples=20 00:20:22.821 lat (msec) : 2=0.13%, 4=0.99%, 10=1.87%, 20=1.47%, 50=7.58% 00:20:22.821 lat (msec) : 100=30.32%, 250=50.79%, 500=6.84% 00:20:22.821 cpu : usr=1.69%, sys=1.80%, ctx=2653, majf=0, minf=2 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,5237,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job6: (groupid=0, jobs=1): err= 0: pid=1091345: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=527, BW=132MiB/s (138MB/s)(1351MiB/10236msec); 0 zone resets 00:20:22.821 slat (usec): min=15, max=59661, avg=1141.39, stdev=3308.20 00:20:22.821 clat (usec): min=939, max=527736, avg=120044.51, stdev=68017.27 00:20:22.821 lat (usec): min=1010, max=527829, avg=121185.90, stdev=68622.84 00:20:22.821 clat percentiles (msec): 00:20:22.821 | 1.00th=[ 5], 5.00th=[ 14], 10.00th=[ 24], 20.00th=[ 45], 00:20:22.821 | 30.00th=[ 93], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 140], 00:20:22.821 | 70.00th=[ 148], 80.00th=[ 165], 90.00th=[ 192], 95.00th=[ 220], 00:20:22.821 | 99.00th=[ 326], 99.50th=[ 409], 99.90th=[ 460], 99.95th=[ 460], 00:20:22.821 | 99.99th=[ 527] 00:20:22.821 bw ( KiB/s): min=86016, max=211968, per=9.65%, avg=136704.00, stdev=29405.59, samples=20 00:20:22.821 iops : min= 336, max= 828, avg=534.00, stdev=114.87, samples=20 00:20:22.821 lat (usec) : 1000=0.02% 00:20:22.821 lat (msec) : 2=0.20%, 4=0.59%, 10=2.28%, 20=5.07%, 50=12.90% 00:20:22.821 lat (msec) : 100=10.99%, 250=65.72%, 500=2.20%, 750=0.02% 00:20:22.821 cpu : usr=1.47%, sys=2.03%, ctx=3316, majf=0, minf=2 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,5403,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job7: (groupid=0, jobs=1): err= 0: pid=1091346: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=541, BW=135MiB/s (142MB/s)(1360MiB/10040msec); 0 zone resets 00:20:22.821 slat (usec): min=14, max=55178, avg=1251.93, stdev=3164.48 00:20:22.821 clat (usec): min=950, max=225307, avg=116814.21, stdev=49299.31 00:20:22.821 lat (usec): min=983, max=225352, avg=118066.14, stdev=49789.58 00:20:22.821 clat percentiles (msec): 00:20:22.821 | 1.00th=[ 8], 5.00th=[ 27], 10.00th=[ 44], 20.00th=[ 75], 00:20:22.821 | 30.00th=[ 93], 40.00th=[ 112], 50.00th=[ 121], 60.00th=[ 138], 00:20:22.821 | 70.00th=[ 148], 80.00th=[ 161], 90.00th=[ 176], 95.00th=[ 190], 00:20:22.821 | 99.00th=[ 211], 99.50th=[ 215], 99.90th=[ 222], 99.95th=[ 224], 00:20:22.821 | 99.99th=[ 226] 00:20:22.821 bw ( KiB/s): min=94720, max=287232, per=9.72%, avg=137689.15, stdev=43657.71, samples=20 00:20:22.821 iops : min= 370, max= 1122, avg=537.80, stdev=170.55, samples=20 00:20:22.821 lat (usec) : 1000=0.04% 00:20:22.821 lat (msec) : 2=0.17%, 4=0.42%, 10=0.74%, 20=2.39%, 50=10.15% 00:20:22.821 lat (msec) : 100=19.08%, 250=67.03% 00:20:22.821 cpu : usr=1.72%, sys=1.86%, ctx=2799, majf=0, minf=1 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,5441,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job8: (groupid=0, jobs=1): err= 0: pid=1091347: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=554, BW=139MiB/s (145MB/s)(1419MiB/10239msec); 0 zone resets 00:20:22.821 slat (usec): min=22, max=52107, avg=1560.42, stdev=3463.48 00:20:22.821 clat (usec): min=939, max=427123, avg=113776.04, stdev=55246.37 00:20:22.821 lat (usec): min=969, max=427158, avg=115336.45, stdev=55872.25 00:20:22.821 clat percentiles (msec): 00:20:22.821 | 1.00th=[ 8], 5.00th=[ 39], 10.00th=[ 44], 20.00th=[ 59], 00:20:22.821 | 30.00th=[ 80], 40.00th=[ 94], 50.00th=[ 122], 60.00th=[ 136], 00:20:22.821 | 70.00th=[ 144], 80.00th=[ 155], 90.00th=[ 174], 95.00th=[ 197], 00:20:22.821 | 99.00th=[ 255], 99.50th=[ 342], 99.90th=[ 414], 99.95th=[ 414], 00:20:22.821 | 99.99th=[ 426] 00:20:22.821 bw ( KiB/s): min=81920, max=286720, per=10.15%, avg=143667.20, stdev=52958.67, samples=20 00:20:22.821 iops : min= 320, max= 1120, avg=561.20, stdev=206.87, samples=20 00:20:22.821 lat (usec) : 1000=0.02% 00:20:22.821 lat (msec) : 2=0.12%, 4=0.51%, 10=0.53%, 20=1.34%, 50=14.13% 00:20:22.821 lat (msec) : 100=24.95%, 250=57.37%, 500=1.02% 00:20:22.821 cpu : usr=1.81%, sys=1.95%, ctx=2182, majf=0, minf=1 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,5675,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job9: (groupid=0, jobs=1): err= 0: pid=1091348: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=484, BW=121MiB/s (127MB/s)(1227MiB/10120msec); 0 zone resets 00:20:22.821 slat (usec): min=13, max=124785, avg=1488.18, stdev=4279.09 00:20:22.821 clat (usec): min=779, max=380603, avg=130476.21, stdev=82381.69 00:20:22.821 lat (usec): min=814, max=383402, avg=131964.39, stdev=83348.12 00:20:22.821 clat percentiles (usec): 00:20:22.821 | 1.00th=[ 1893], 5.00th=[ 8586], 10.00th=[ 19792], 20.00th=[ 56886], 00:20:22.821 | 30.00th=[ 78119], 40.00th=[104334], 50.00th=[114820], 60.00th=[145753], 00:20:22.821 | 70.00th=[175113], 80.00th=[208667], 90.00th=[227541], 95.00th=[283116], 00:20:22.821 | 99.00th=[350225], 99.50th=[371196], 99.90th=[379585], 99.95th=[379585], 00:20:22.821 | 99.99th=[379585] 00:20:22.821 bw ( KiB/s): min=57344, max=247808, per=8.76%, avg=123991.45, stdev=51847.80, samples=20 00:20:22.821 iops : min= 224, max= 968, avg=484.30, stdev=202.55, samples=20 00:20:22.821 lat (usec) : 1000=0.12% 00:20:22.821 lat (msec) : 2=0.96%, 4=1.61%, 10=3.00%, 20=4.40%, 50=8.13% 00:20:22.821 lat (msec) : 100=17.77%, 250=56.14%, 500=7.87% 00:20:22.821 cpu : usr=1.48%, sys=1.53%, ctx=2724, majf=0, minf=1 00:20:22.821 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:22.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.821 issued rwts: total=0,4906,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.821 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.821 job10: (groupid=0, jobs=1): err= 0: pid=1091349: Tue Nov 26 01:13:12 2024 00:20:22.821 write: IOPS=537, BW=134MiB/s (141MB/s)(1359MiB/10121msec); 0 zone resets 00:20:22.821 slat (usec): min=17, max=139485, avg=1492.42, stdev=4847.32 00:20:22.821 clat (usec): min=756, max=372531, avg=117546.76, stdev=80743.70 00:20:22.821 lat (usec): min=830, max=372575, avg=119039.18, stdev=81809.51 00:20:22.821 clat percentiles (usec): 00:20:22.821 | 1.00th=[ 1762], 5.00th=[ 6849], 10.00th=[ 16909], 20.00th=[ 54789], 00:20:22.821 | 30.00th=[ 80217], 40.00th=[ 90702], 50.00th=[ 99091], 60.00th=[112722], 00:20:22.821 | 70.00th=[135267], 80.00th=[175113], 90.00th=[240124], 95.00th=[291505], 00:20:22.821 | 99.00th=[354419], 99.50th=[354419], 99.90th=[362808], 99.95th=[367002], 00:20:22.821 | 99.99th=[371196] 00:20:22.821 bw ( KiB/s): min=53248, max=357376, per=9.71%, avg=137555.15, stdev=73860.83, samples=20 00:20:22.821 iops : min= 208, max= 1396, avg=537.30, stdev=288.55, samples=20 00:20:22.821 lat (usec) : 1000=0.22% 00:20:22.821 lat (msec) : 2=1.16%, 4=1.73%, 10=3.96%, 20=3.40%, 50=8.48% 00:20:22.822 lat (msec) : 100=31.49%, 250=40.97%, 500=8.59% 00:20:22.822 cpu : usr=1.62%, sys=1.92%, ctx=2662, majf=0, minf=1 00:20:22.822 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:22.822 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:22.822 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:22.822 issued rwts: total=0,5436,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:22.822 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:22.822 00:20:22.822 Run status group 0 (all jobs): 00:20:22.822 WRITE: bw=1383MiB/s (1450MB/s), 90.9MiB/s-144MiB/s (95.4MB/s-151MB/s), io=13.8GiB (14.8GB), run=10040-10239msec 00:20:22.822 00:20:22.822 Disk stats (read/write): 00:20:22.822 nvme0n1: ios=48/9481, merge=0/0, ticks=1510/1235231, in_queue=1236741, util=99.66% 00:20:22.822 nvme10n1: ios=52/11784, merge=0/0, ticks=3179/1232875, in_queue=1236054, util=100.00% 00:20:22.822 nvme1n1: ios=41/11778, merge=0/0, ticks=589/1238547, in_queue=1239136, util=100.00% 00:20:22.822 nvme2n1: ios=51/7417, merge=0/0, ticks=1833/1239271, in_queue=1241104, util=100.00% 00:20:22.822 nvme3n1: ios=38/8288, merge=0/0, ticks=1261/1206418, in_queue=1207679, util=100.00% 00:20:22.822 nvme4n1: ios=48/10312, merge=0/0, ticks=200/1220753, in_queue=1220953, util=99.94% 00:20:22.822 nvme5n1: ios=20/10774, merge=0/0, ticks=225/1248608, in_queue=1248833, util=98.45% 00:20:22.822 nvme6n1: ios=0/10588, merge=0/0, ticks=0/1227831, in_queue=1227831, util=98.46% 00:20:22.822 nvme7n1: ios=41/11313, merge=0/0, ticks=886/1236071, in_queue=1236957, util=100.00% 00:20:22.822 nvme8n1: ios=0/9650, merge=0/0, ticks=0/1216255, in_queue=1216255, util=98.99% 00:20:22.822 nvme9n1: ios=44/10711, merge=0/0, ticks=1975/1188546, in_queue=1190521, util=100.00% 00:20:22.822 01:13:12 -- target/multiconnection.sh@36 -- # sync 00:20:22.822 01:13:12 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:22.822 01:13:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:22.822 01:13:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:22.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:22.822 01:13:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:22.822 01:13:12 -- common/autotest_common.sh@1208 -- # local i=0 00:20:22.822 01:13:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:22.822 01:13:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:22.822 01:13:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:22.822 01:13:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:22.822 01:13:12 -- common/autotest_common.sh@1220 -- # return 0 00:20:22.822 01:13:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:22.822 01:13:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:22.822 01:13:12 -- common/autotest_common.sh@10 -- # set +x 00:20:22.822 01:13:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:22.822 01:13:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:22.822 01:13:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:22.822 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:22.822 01:13:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:22.822 01:13:13 -- common/autotest_common.sh@1208 -- # local i=0 00:20:22.822 01:13:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:22.822 01:13:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:22.822 01:13:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:22.822 01:13:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:22.822 01:13:13 -- common/autotest_common.sh@1220 -- # return 0 00:20:22.822 01:13:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:22.822 01:13:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:22.822 01:13:13 -- common/autotest_common.sh@10 -- # set +x 00:20:22.822 01:13:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:22.822 01:13:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:22.822 01:13:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:22.822 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:23.080 01:13:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:23.080 01:13:13 -- common/autotest_common.sh@1208 -- # local i=0 00:20:23.080 01:13:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:23.080 01:13:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:23.080 01:13:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:23.080 01:13:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:23.080 01:13:13 -- common/autotest_common.sh@1220 -- # return 0 00:20:23.080 01:13:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:23.080 01:13:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.080 01:13:13 -- common/autotest_common.sh@10 -- # set +x 00:20:23.081 01:13:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.081 01:13:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:23.081 01:13:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:23.340 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:23.340 01:13:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:23.340 01:13:13 -- common/autotest_common.sh@1208 -- # local i=0 00:20:23.340 01:13:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:23.340 01:13:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:23.340 01:13:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:23.340 01:13:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:23.340 01:13:13 -- common/autotest_common.sh@1220 -- # return 0 00:20:23.340 01:13:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:23.340 01:13:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.340 01:13:13 -- common/autotest_common.sh@10 -- # set +x 00:20:23.340 01:13:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.340 01:13:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:23.340 01:13:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:23.601 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:23.601 01:13:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:23.601 01:13:13 -- common/autotest_common.sh@1208 -- # local i=0 00:20:23.601 01:13:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:23.601 01:13:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:23.601 01:13:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:23.601 01:13:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:23.601 01:13:13 -- common/autotest_common.sh@1220 -- # return 0 00:20:23.601 01:13:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:23.601 01:13:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.601 01:13:13 -- common/autotest_common.sh@10 -- # set +x 00:20:23.601 01:13:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.601 01:13:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:23.601 01:13:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:23.601 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:23.601 01:13:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:23.601 01:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:20:23.601 01:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:23.601 01:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:23.601 01:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:23.601 01:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:23.601 01:13:14 -- common/autotest_common.sh@1220 -- # return 0 00:20:23.601 01:13:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:23.601 01:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:23.601 01:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:23.601 01:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:23.601 01:13:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:23.601 01:13:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:23.860 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:23.860 01:13:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:23.860 01:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:20:24.118 01:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:24.118 01:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:24.118 01:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:24.118 01:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:24.118 01:13:14 -- common/autotest_common.sh@1220 -- # return 0 00:20:24.118 01:13:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:24.118 01:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.118 01:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:24.118 01:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.118 01:13:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.118 01:13:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:24.118 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:24.118 01:13:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:24.118 01:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:20:24.118 01:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:24.118 01:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:24.118 01:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:24.118 01:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:24.118 01:13:14 -- common/autotest_common.sh@1220 -- # return 0 00:20:24.118 01:13:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:24.118 01:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.118 01:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:24.118 01:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.118 01:13:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.118 01:13:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:24.378 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:24.378 01:13:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:24.378 01:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:20:24.378 01:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:24.379 01:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:24.379 01:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:24.379 01:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:24.379 01:13:14 -- common/autotest_common.sh@1220 -- # return 0 00:20:24.379 01:13:14 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:24.379 01:13:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.379 01:13:14 -- common/autotest_common.sh@10 -- # set +x 00:20:24.379 01:13:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.379 01:13:14 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.379 01:13:14 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:24.638 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:24.638 01:13:14 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:24.638 01:13:14 -- common/autotest_common.sh@1208 -- # local i=0 00:20:24.638 01:13:14 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:24.638 01:13:14 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:24.638 01:13:14 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:24.638 01:13:14 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:24.638 01:13:15 -- common/autotest_common.sh@1220 -- # return 0 00:20:24.638 01:13:15 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:24.638 01:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.638 01:13:15 -- common/autotest_common.sh@10 -- # set +x 00:20:24.638 01:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.638 01:13:15 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:24.638 01:13:15 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:24.638 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:24.638 01:13:15 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:24.638 01:13:15 -- common/autotest_common.sh@1208 -- # local i=0 00:20:24.638 01:13:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:24.638 01:13:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:24.638 01:13:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:24.638 01:13:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:24.638 01:13:15 -- common/autotest_common.sh@1220 -- # return 0 00:20:24.638 01:13:15 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:24.638 01:13:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:24.638 01:13:15 -- common/autotest_common.sh@10 -- # set +x 00:20:24.638 01:13:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:24.638 01:13:15 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:24.638 01:13:15 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:24.638 01:13:15 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:24.638 01:13:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:24.638 01:13:15 -- nvmf/common.sh@116 -- # sync 00:20:24.638 01:13:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:24.638 01:13:15 -- nvmf/common.sh@119 -- # set +e 00:20:24.638 01:13:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:24.638 01:13:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:24.638 rmmod nvme_tcp 00:20:24.638 rmmod nvme_fabrics 00:20:24.638 rmmod nvme_keyring 00:20:24.898 01:13:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:24.899 01:13:15 -- nvmf/common.sh@123 -- # set -e 00:20:24.899 01:13:15 -- nvmf/common.sh@124 -- # return 0 00:20:24.899 01:13:15 -- nvmf/common.sh@477 -- # '[' -n 1085749 ']' 00:20:24.899 01:13:15 -- nvmf/common.sh@478 -- # killprocess 1085749 00:20:24.899 01:13:15 -- common/autotest_common.sh@936 -- # '[' -z 1085749 ']' 00:20:24.899 01:13:15 -- common/autotest_common.sh@940 -- # kill -0 1085749 00:20:24.899 01:13:15 -- common/autotest_common.sh@941 -- # uname 00:20:24.899 01:13:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:24.899 01:13:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1085749 00:20:24.899 01:13:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:24.899 01:13:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:24.899 01:13:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1085749' 00:20:24.899 killing process with pid 1085749 00:20:24.899 01:13:15 -- common/autotest_common.sh@955 -- # kill 1085749 00:20:24.899 01:13:15 -- common/autotest_common.sh@960 -- # wait 1085749 00:20:25.465 01:13:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:25.465 01:13:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:25.465 01:13:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:25.465 01:13:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:25.465 01:13:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:25.465 01:13:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:25.465 01:13:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:25.465 01:13:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:27.369 01:13:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:27.369 00:20:27.369 real 1m1.639s 00:20:27.369 user 3m23.327s 00:20:27.369 sys 0m25.977s 00:20:27.369 01:13:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:27.369 01:13:17 -- common/autotest_common.sh@10 -- # set +x 00:20:27.369 ************************************ 00:20:27.369 END TEST nvmf_multiconnection 00:20:27.369 ************************************ 00:20:27.369 01:13:17 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:27.369 01:13:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:27.369 01:13:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:27.369 01:13:17 -- common/autotest_common.sh@10 -- # set +x 00:20:27.369 ************************************ 00:20:27.369 START TEST nvmf_initiator_timeout 00:20:27.369 ************************************ 00:20:27.369 01:13:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:27.628 * Looking for test storage... 00:20:27.628 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:27.628 01:13:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:27.628 01:13:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:27.628 01:13:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:27.628 01:13:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:27.628 01:13:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:27.628 01:13:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:27.628 01:13:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:27.628 01:13:18 -- scripts/common.sh@335 -- # IFS=.-: 00:20:27.628 01:13:18 -- scripts/common.sh@335 -- # read -ra ver1 00:20:27.628 01:13:18 -- scripts/common.sh@336 -- # IFS=.-: 00:20:27.628 01:13:18 -- scripts/common.sh@336 -- # read -ra ver2 00:20:27.628 01:13:18 -- scripts/common.sh@337 -- # local 'op=<' 00:20:27.628 01:13:18 -- scripts/common.sh@339 -- # ver1_l=2 00:20:27.628 01:13:18 -- scripts/common.sh@340 -- # ver2_l=1 00:20:27.628 01:13:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:27.628 01:13:18 -- scripts/common.sh@343 -- # case "$op" in 00:20:27.628 01:13:18 -- scripts/common.sh@344 -- # : 1 00:20:27.628 01:13:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:27.628 01:13:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:27.628 01:13:18 -- scripts/common.sh@364 -- # decimal 1 00:20:27.628 01:13:18 -- scripts/common.sh@352 -- # local d=1 00:20:27.628 01:13:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:27.628 01:13:18 -- scripts/common.sh@354 -- # echo 1 00:20:27.628 01:13:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:27.628 01:13:18 -- scripts/common.sh@365 -- # decimal 2 00:20:27.628 01:13:18 -- scripts/common.sh@352 -- # local d=2 00:20:27.628 01:13:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:27.628 01:13:18 -- scripts/common.sh@354 -- # echo 2 00:20:27.628 01:13:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:27.628 01:13:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:27.628 01:13:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:27.628 01:13:18 -- scripts/common.sh@367 -- # return 0 00:20:27.628 01:13:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:27.628 01:13:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:27.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:27.628 --rc genhtml_branch_coverage=1 00:20:27.628 --rc genhtml_function_coverage=1 00:20:27.628 --rc genhtml_legend=1 00:20:27.628 --rc geninfo_all_blocks=1 00:20:27.628 --rc geninfo_unexecuted_blocks=1 00:20:27.628 00:20:27.628 ' 00:20:27.628 01:13:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:27.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:27.628 --rc genhtml_branch_coverage=1 00:20:27.628 --rc genhtml_function_coverage=1 00:20:27.628 --rc genhtml_legend=1 00:20:27.628 --rc geninfo_all_blocks=1 00:20:27.628 --rc geninfo_unexecuted_blocks=1 00:20:27.628 00:20:27.628 ' 00:20:27.628 01:13:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:27.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:27.628 --rc genhtml_branch_coverage=1 00:20:27.628 --rc genhtml_function_coverage=1 00:20:27.628 --rc genhtml_legend=1 00:20:27.628 --rc geninfo_all_blocks=1 00:20:27.628 --rc geninfo_unexecuted_blocks=1 00:20:27.628 00:20:27.628 ' 00:20:27.628 01:13:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:27.628 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:27.628 --rc genhtml_branch_coverage=1 00:20:27.628 --rc genhtml_function_coverage=1 00:20:27.628 --rc genhtml_legend=1 00:20:27.628 --rc geninfo_all_blocks=1 00:20:27.628 --rc geninfo_unexecuted_blocks=1 00:20:27.628 00:20:27.628 ' 00:20:27.628 01:13:18 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:27.628 01:13:18 -- nvmf/common.sh@7 -- # uname -s 00:20:27.628 01:13:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:27.628 01:13:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:27.628 01:13:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:27.628 01:13:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:27.628 01:13:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:27.628 01:13:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:27.628 01:13:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:27.628 01:13:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:27.628 01:13:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:27.628 01:13:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:27.628 01:13:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:27.628 01:13:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:27.628 01:13:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:27.628 01:13:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:27.628 01:13:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:27.628 01:13:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:27.628 01:13:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:27.628 01:13:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:27.628 01:13:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:27.628 01:13:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:27.628 01:13:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:27.628 01:13:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:27.628 01:13:18 -- paths/export.sh@5 -- # export PATH 00:20:27.628 01:13:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:27.628 01:13:18 -- nvmf/common.sh@46 -- # : 0 00:20:27.628 01:13:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:27.628 01:13:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:27.628 01:13:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:27.628 01:13:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:27.628 01:13:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:27.628 01:13:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:27.628 01:13:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:27.628 01:13:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:27.628 01:13:18 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:27.628 01:13:18 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:27.628 01:13:18 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:27.628 01:13:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:27.628 01:13:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:27.628 01:13:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:27.628 01:13:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:27.628 01:13:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:27.628 01:13:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:27.628 01:13:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:27.628 01:13:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:27.628 01:13:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:27.628 01:13:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:27.628 01:13:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:27.628 01:13:18 -- common/autotest_common.sh@10 -- # set +x 00:20:29.550 01:13:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:29.550 01:13:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:29.550 01:13:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:29.550 01:13:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:29.550 01:13:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:29.550 01:13:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:29.550 01:13:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:29.550 01:13:20 -- nvmf/common.sh@294 -- # net_devs=() 00:20:29.550 01:13:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:29.550 01:13:20 -- nvmf/common.sh@295 -- # e810=() 00:20:29.550 01:13:20 -- nvmf/common.sh@295 -- # local -ga e810 00:20:29.550 01:13:20 -- nvmf/common.sh@296 -- # x722=() 00:20:29.550 01:13:20 -- nvmf/common.sh@296 -- # local -ga x722 00:20:29.550 01:13:20 -- nvmf/common.sh@297 -- # mlx=() 00:20:29.550 01:13:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:29.550 01:13:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:29.550 01:13:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:29.550 01:13:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:29.550 01:13:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:29.550 01:13:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:29.550 01:13:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:29.550 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:29.550 01:13:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:29.550 01:13:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:29.550 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:29.550 01:13:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:29.550 01:13:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:29.550 01:13:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:29.550 01:13:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:29.550 01:13:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:29.550 01:13:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:29.550 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:29.550 01:13:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:29.550 01:13:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:29.550 01:13:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:29.550 01:13:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:29.550 01:13:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:29.550 01:13:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:29.550 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:29.550 01:13:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:29.550 01:13:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:29.550 01:13:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:29.550 01:13:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:29.550 01:13:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:29.550 01:13:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:29.550 01:13:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:29.550 01:13:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:29.550 01:13:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:29.550 01:13:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:29.550 01:13:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:29.550 01:13:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:29.550 01:13:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:29.550 01:13:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:29.550 01:13:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:29.550 01:13:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:29.550 01:13:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:29.550 01:13:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:29.810 01:13:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:29.810 01:13:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:29.810 01:13:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:29.810 01:13:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:29.810 01:13:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:29.810 01:13:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:29.810 01:13:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:29.810 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:29.810 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:20:29.810 00:20:29.810 --- 10.0.0.2 ping statistics --- 00:20:29.810 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:29.810 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:20:29.810 01:13:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:29.810 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:29.810 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:20:29.810 00:20:29.810 --- 10.0.0.1 ping statistics --- 00:20:29.810 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:29.810 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:20:29.810 01:13:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:29.810 01:13:20 -- nvmf/common.sh@410 -- # return 0 00:20:29.810 01:13:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:29.810 01:13:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:29.810 01:13:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:29.810 01:13:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:29.810 01:13:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:29.810 01:13:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:29.810 01:13:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:29.810 01:13:20 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:29.810 01:13:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:29.810 01:13:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:29.810 01:13:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.810 01:13:20 -- nvmf/common.sh@469 -- # nvmfpid=1094748 00:20:29.810 01:13:20 -- nvmf/common.sh@470 -- # waitforlisten 1094748 00:20:29.810 01:13:20 -- common/autotest_common.sh@829 -- # '[' -z 1094748 ']' 00:20:29.810 01:13:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:29.810 01:13:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:29.810 01:13:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:29.810 01:13:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:29.810 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:29.810 01:13:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:29.810 01:13:20 -- common/autotest_common.sh@10 -- # set +x 00:20:29.810 [2024-11-26 01:13:20.241016] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:29.810 [2024-11-26 01:13:20.241113] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:29.810 EAL: No free 2048 kB hugepages reported on node 1 00:20:29.810 [2024-11-26 01:13:20.309128] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:30.071 [2024-11-26 01:13:20.430962] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:30.071 [2024-11-26 01:13:20.431139] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:30.071 [2024-11-26 01:13:20.431169] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:30.071 [2024-11-26 01:13:20.431183] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:30.071 [2024-11-26 01:13:20.431253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:30.071 [2024-11-26 01:13:20.431311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:30.071 [2024-11-26 01:13:20.431363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:30.071 [2024-11-26 01:13:20.431366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:31.006 01:13:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:31.006 01:13:21 -- common/autotest_common.sh@862 -- # return 0 00:20:31.006 01:13:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:31.006 01:13:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 01:13:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:31.006 01:13:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 Malloc0 00:20:31.006 01:13:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:31.006 01:13:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 Delay0 00:20:31.006 01:13:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:31.006 01:13:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 [2024-11-26 01:13:21.261007] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:31.006 01:13:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:31.006 01:13:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 01:13:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:31.006 01:13:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 01:13:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:31.006 01:13:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.006 01:13:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.006 [2024-11-26 01:13:21.289322] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:31.006 01:13:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.006 01:13:21 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:31.574 01:13:21 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:31.574 01:13:21 -- common/autotest_common.sh@1187 -- # local i=0 00:20:31.574 01:13:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:31.574 01:13:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:31.575 01:13:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:33.480 01:13:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:33.480 01:13:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:33.480 01:13:23 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:33.480 01:13:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:33.480 01:13:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:33.480 01:13:23 -- common/autotest_common.sh@1197 -- # return 0 00:20:33.480 01:13:23 -- target/initiator_timeout.sh@35 -- # fio_pid=1095321 00:20:33.480 01:13:23 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:33.480 01:13:23 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:33.480 [global] 00:20:33.480 thread=1 00:20:33.480 invalidate=1 00:20:33.480 rw=write 00:20:33.480 time_based=1 00:20:33.480 runtime=60 00:20:33.480 ioengine=libaio 00:20:33.480 direct=1 00:20:33.480 bs=4096 00:20:33.480 iodepth=1 00:20:33.480 norandommap=0 00:20:33.480 numjobs=1 00:20:33.480 00:20:33.480 verify_dump=1 00:20:33.480 verify_backlog=512 00:20:33.480 verify_state_save=0 00:20:33.480 do_verify=1 00:20:33.480 verify=crc32c-intel 00:20:33.480 [job0] 00:20:33.480 filename=/dev/nvme0n1 00:20:33.480 Could not set queue depth (nvme0n1) 00:20:33.738 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:33.738 fio-3.35 00:20:33.738 Starting 1 thread 00:20:37.028 01:13:26 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:37.028 01:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.028 01:13:26 -- common/autotest_common.sh@10 -- # set +x 00:20:37.028 true 00:20:37.028 01:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.028 01:13:26 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:37.028 01:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.028 01:13:26 -- common/autotest_common.sh@10 -- # set +x 00:20:37.028 true 00:20:37.028 01:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.028 01:13:26 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:37.028 01:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.028 01:13:26 -- common/autotest_common.sh@10 -- # set +x 00:20:37.028 true 00:20:37.028 01:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.028 01:13:26 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:37.028 01:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.028 01:13:26 -- common/autotest_common.sh@10 -- # set +x 00:20:37.028 true 00:20:37.028 01:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.028 01:13:26 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:39.563 01:13:29 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:39.563 01:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:39.563 01:13:29 -- common/autotest_common.sh@10 -- # set +x 00:20:39.563 true 00:20:39.563 01:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:39.563 01:13:29 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:39.563 01:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:39.563 01:13:29 -- common/autotest_common.sh@10 -- # set +x 00:20:39.564 true 00:20:39.564 01:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:39.564 01:13:29 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:39.564 01:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:39.564 01:13:29 -- common/autotest_common.sh@10 -- # set +x 00:20:39.564 true 00:20:39.564 01:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:39.564 01:13:29 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:39.564 01:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:39.564 01:13:29 -- common/autotest_common.sh@10 -- # set +x 00:20:39.564 true 00:20:39.564 01:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:39.564 01:13:29 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:39.564 01:13:29 -- target/initiator_timeout.sh@54 -- # wait 1095321 00:21:35.821 00:21:35.821 job0: (groupid=0, jobs=1): err= 0: pid=1095394: Tue Nov 26 01:14:24 2024 00:21:35.821 read: IOPS=87, BW=352KiB/s (360kB/s)(20.6MiB/60001msec) 00:21:35.821 slat (usec): min=5, max=12592, avg=20.24, stdev=214.70 00:21:35.821 clat (usec): min=237, max=41297k, avg=11081.87, stdev=568761.55 00:21:35.821 lat (usec): min=244, max=41297k, avg=11102.11, stdev=568761.80 00:21:35.821 clat percentiles (usec): 00:21:35.821 | 1.00th=[ 258], 5.00th=[ 269], 10.00th=[ 277], 00:21:35.821 | 20.00th=[ 285], 30.00th=[ 293], 40.00th=[ 302], 00:21:35.821 | 50.00th=[ 310], 60.00th=[ 318], 70.00th=[ 334], 00:21:35.821 | 80.00th=[ 371], 90.00th=[ 486], 95.00th=[ 41157], 00:21:35.821 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:21:35.821 | 99.95th=[ 43779], 99.99th=[17112761] 00:21:35.821 write: IOPS=93, BW=375KiB/s (384kB/s)(22.0MiB/60001msec); 0 zone resets 00:21:35.821 slat (usec): min=6, max=28202, avg=22.33, stdev=375.69 00:21:35.821 clat (usec): min=176, max=1192, avg=227.60, stdev=47.10 00:21:35.821 lat (usec): min=184, max=28459, avg=249.94, stdev=379.81 00:21:35.821 clat percentiles (usec): 00:21:35.821 | 1.00th=[ 184], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 196], 00:21:35.821 | 30.00th=[ 202], 40.00th=[ 206], 50.00th=[ 212], 60.00th=[ 223], 00:21:35.821 | 70.00th=[ 235], 80.00th=[ 247], 90.00th=[ 277], 95.00th=[ 326], 00:21:35.821 | 99.00th=[ 420], 99.50th=[ 441], 99.90th=[ 461], 99.95th=[ 465], 00:21:35.821 | 99.99th=[ 1188] 00:21:35.821 bw ( KiB/s): min= 352, max= 7480, per=100.00%, avg=3862.40, stdev=1955.39, samples=10 00:21:35.821 iops : min= 88, max= 1870, avg=965.60, stdev=488.85, samples=10 00:21:35.821 lat (usec) : 250=42.51%, 500=53.53%, 750=0.48%, 1000=0.03% 00:21:35.821 lat (msec) : 2=0.02%, 50=3.43%, >=2000=0.01% 00:21:35.821 cpu : usr=0.20%, sys=0.39%, ctx=10912, majf=0, minf=1 00:21:35.821 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:35.821 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:35.821 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:35.821 issued rwts: total=5273,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:35.821 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:35.821 00:21:35.821 Run status group 0 (all jobs): 00:21:35.821 READ: bw=352KiB/s (360kB/s), 352KiB/s-352KiB/s (360kB/s-360kB/s), io=20.6MiB (21.6MB), run=60001-60001msec 00:21:35.821 WRITE: bw=375KiB/s (384kB/s), 375KiB/s-375KiB/s (384kB/s-384kB/s), io=22.0MiB (23.1MB), run=60001-60001msec 00:21:35.821 00:21:35.821 Disk stats (read/write): 00:21:35.821 nvme0n1: ios=5172/5492, merge=0/0, ticks=18382/1214, in_queue=19596, util=99.82% 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:35.821 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:35.821 01:14:24 -- common/autotest_common.sh@1208 -- # local i=0 00:21:35.821 01:14:24 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:35.821 01:14:24 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:35.821 01:14:24 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:35.821 01:14:24 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:35.821 01:14:24 -- common/autotest_common.sh@1220 -- # return 0 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:35.821 nvmf hotplug test: fio successful as expected 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:35.821 01:14:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:35.821 01:14:24 -- common/autotest_common.sh@10 -- # set +x 00:21:35.821 01:14:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:35.821 01:14:24 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:35.821 01:14:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:35.821 01:14:24 -- nvmf/common.sh@116 -- # sync 00:21:35.821 01:14:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:35.821 01:14:24 -- nvmf/common.sh@119 -- # set +e 00:21:35.821 01:14:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:35.821 01:14:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:35.821 rmmod nvme_tcp 00:21:35.821 rmmod nvme_fabrics 00:21:35.821 rmmod nvme_keyring 00:21:35.821 01:14:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:35.821 01:14:24 -- nvmf/common.sh@123 -- # set -e 00:21:35.821 01:14:24 -- nvmf/common.sh@124 -- # return 0 00:21:35.821 01:14:24 -- nvmf/common.sh@477 -- # '[' -n 1094748 ']' 00:21:35.821 01:14:24 -- nvmf/common.sh@478 -- # killprocess 1094748 00:21:35.821 01:14:24 -- common/autotest_common.sh@936 -- # '[' -z 1094748 ']' 00:21:35.821 01:14:24 -- common/autotest_common.sh@940 -- # kill -0 1094748 00:21:35.821 01:14:24 -- common/autotest_common.sh@941 -- # uname 00:21:35.821 01:14:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:35.821 01:14:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1094748 00:21:35.821 01:14:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:35.821 01:14:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:35.821 01:14:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1094748' 00:21:35.821 killing process with pid 1094748 00:21:35.821 01:14:24 -- common/autotest_common.sh@955 -- # kill 1094748 00:21:35.821 01:14:24 -- common/autotest_common.sh@960 -- # wait 1094748 00:21:35.821 01:14:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:35.821 01:14:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:35.821 01:14:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:35.821 01:14:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:35.821 01:14:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:35.821 01:14:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:35.821 01:14:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:35.821 01:14:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:36.389 01:14:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:36.389 00:21:36.389 real 1m8.983s 00:21:36.389 user 4m13.450s 00:21:36.389 sys 0m6.894s 00:21:36.389 01:14:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:36.389 01:14:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.389 ************************************ 00:21:36.389 END TEST nvmf_initiator_timeout 00:21:36.389 ************************************ 00:21:36.389 01:14:26 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:36.389 01:14:26 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:36.389 01:14:26 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:36.389 01:14:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:36.389 01:14:26 -- common/autotest_common.sh@10 -- # set +x 00:21:38.978 01:14:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:38.978 01:14:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:38.978 01:14:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:38.978 01:14:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:38.978 01:14:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:38.978 01:14:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:38.978 01:14:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:38.978 01:14:28 -- nvmf/common.sh@294 -- # net_devs=() 00:21:38.978 01:14:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:38.978 01:14:28 -- nvmf/common.sh@295 -- # e810=() 00:21:38.978 01:14:28 -- nvmf/common.sh@295 -- # local -ga e810 00:21:38.978 01:14:28 -- nvmf/common.sh@296 -- # x722=() 00:21:38.978 01:14:28 -- nvmf/common.sh@296 -- # local -ga x722 00:21:38.978 01:14:28 -- nvmf/common.sh@297 -- # mlx=() 00:21:38.978 01:14:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:38.978 01:14:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:38.978 01:14:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:38.978 01:14:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:38.978 01:14:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:38.978 01:14:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:38.978 01:14:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:38.978 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:38.978 01:14:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:38.978 01:14:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:38.978 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:38.978 01:14:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:38.978 01:14:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:38.978 01:14:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:38.978 01:14:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:38.978 01:14:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:38.978 01:14:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:38.978 01:14:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:38.978 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:38.978 01:14:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:38.978 01:14:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:38.978 01:14:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:38.978 01:14:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:38.978 01:14:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:38.978 01:14:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:38.978 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:38.978 01:14:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:38.978 01:14:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:38.978 01:14:28 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:38.978 01:14:28 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:38.978 01:14:28 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:38.978 01:14:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:38.978 01:14:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:38.978 01:14:28 -- common/autotest_common.sh@10 -- # set +x 00:21:38.978 ************************************ 00:21:38.978 START TEST nvmf_perf_adq 00:21:38.978 ************************************ 00:21:38.978 01:14:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:38.978 * Looking for test storage... 00:21:38.978 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:38.978 01:14:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:38.978 01:14:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:38.978 01:14:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:38.978 01:14:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:38.978 01:14:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:38.978 01:14:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:38.978 01:14:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:38.978 01:14:29 -- scripts/common.sh@335 -- # IFS=.-: 00:21:38.978 01:14:29 -- scripts/common.sh@335 -- # read -ra ver1 00:21:38.978 01:14:29 -- scripts/common.sh@336 -- # IFS=.-: 00:21:38.978 01:14:29 -- scripts/common.sh@336 -- # read -ra ver2 00:21:38.978 01:14:29 -- scripts/common.sh@337 -- # local 'op=<' 00:21:38.978 01:14:29 -- scripts/common.sh@339 -- # ver1_l=2 00:21:38.978 01:14:29 -- scripts/common.sh@340 -- # ver2_l=1 00:21:38.978 01:14:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:38.978 01:14:29 -- scripts/common.sh@343 -- # case "$op" in 00:21:38.978 01:14:29 -- scripts/common.sh@344 -- # : 1 00:21:38.978 01:14:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:38.978 01:14:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:38.978 01:14:29 -- scripts/common.sh@364 -- # decimal 1 00:21:38.978 01:14:29 -- scripts/common.sh@352 -- # local d=1 00:21:38.978 01:14:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:38.978 01:14:29 -- scripts/common.sh@354 -- # echo 1 00:21:38.978 01:14:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:38.978 01:14:29 -- scripts/common.sh@365 -- # decimal 2 00:21:38.978 01:14:29 -- scripts/common.sh@352 -- # local d=2 00:21:38.978 01:14:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:38.978 01:14:29 -- scripts/common.sh@354 -- # echo 2 00:21:38.978 01:14:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:38.978 01:14:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:38.978 01:14:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:38.979 01:14:29 -- scripts/common.sh@367 -- # return 0 00:21:38.979 01:14:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:38.979 01:14:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:38.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.979 --rc genhtml_branch_coverage=1 00:21:38.979 --rc genhtml_function_coverage=1 00:21:38.979 --rc genhtml_legend=1 00:21:38.979 --rc geninfo_all_blocks=1 00:21:38.979 --rc geninfo_unexecuted_blocks=1 00:21:38.979 00:21:38.979 ' 00:21:38.979 01:14:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:38.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.979 --rc genhtml_branch_coverage=1 00:21:38.979 --rc genhtml_function_coverage=1 00:21:38.979 --rc genhtml_legend=1 00:21:38.979 --rc geninfo_all_blocks=1 00:21:38.979 --rc geninfo_unexecuted_blocks=1 00:21:38.979 00:21:38.979 ' 00:21:38.979 01:14:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:38.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.979 --rc genhtml_branch_coverage=1 00:21:38.979 --rc genhtml_function_coverage=1 00:21:38.979 --rc genhtml_legend=1 00:21:38.979 --rc geninfo_all_blocks=1 00:21:38.979 --rc geninfo_unexecuted_blocks=1 00:21:38.979 00:21:38.979 ' 00:21:38.979 01:14:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:38.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:38.979 --rc genhtml_branch_coverage=1 00:21:38.979 --rc genhtml_function_coverage=1 00:21:38.979 --rc genhtml_legend=1 00:21:38.979 --rc geninfo_all_blocks=1 00:21:38.979 --rc geninfo_unexecuted_blocks=1 00:21:38.979 00:21:38.979 ' 00:21:38.979 01:14:29 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:38.979 01:14:29 -- nvmf/common.sh@7 -- # uname -s 00:21:38.979 01:14:29 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:38.979 01:14:29 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:38.979 01:14:29 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:38.979 01:14:29 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:38.979 01:14:29 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:38.979 01:14:29 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:38.979 01:14:29 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:38.979 01:14:29 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:38.979 01:14:29 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:38.979 01:14:29 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:38.979 01:14:29 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:38.979 01:14:29 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:38.979 01:14:29 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:38.979 01:14:29 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:38.979 01:14:29 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:38.979 01:14:29 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:38.979 01:14:29 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:38.979 01:14:29 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:38.979 01:14:29 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:38.979 01:14:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.979 01:14:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.979 01:14:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.979 01:14:29 -- paths/export.sh@5 -- # export PATH 00:21:38.979 01:14:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:38.979 01:14:29 -- nvmf/common.sh@46 -- # : 0 00:21:38.979 01:14:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:38.979 01:14:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:38.979 01:14:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:38.979 01:14:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:38.979 01:14:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:38.979 01:14:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:38.979 01:14:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:38.979 01:14:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:38.979 01:14:29 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:38.979 01:14:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:38.979 01:14:29 -- common/autotest_common.sh@10 -- # set +x 00:21:40.886 01:14:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:40.886 01:14:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:40.886 01:14:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:40.886 01:14:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:40.886 01:14:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:40.886 01:14:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:40.886 01:14:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:40.886 01:14:30 -- nvmf/common.sh@294 -- # net_devs=() 00:21:40.886 01:14:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:40.886 01:14:30 -- nvmf/common.sh@295 -- # e810=() 00:21:40.886 01:14:30 -- nvmf/common.sh@295 -- # local -ga e810 00:21:40.886 01:14:30 -- nvmf/common.sh@296 -- # x722=() 00:21:40.886 01:14:30 -- nvmf/common.sh@296 -- # local -ga x722 00:21:40.886 01:14:30 -- nvmf/common.sh@297 -- # mlx=() 00:21:40.886 01:14:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:40.886 01:14:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:40.886 01:14:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:40.886 01:14:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:40.886 01:14:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:40.886 01:14:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.886 01:14:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:40.886 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:40.886 01:14:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:40.886 01:14:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:40.886 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:40.886 01:14:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:40.886 01:14:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:40.886 01:14:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.886 01:14:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.886 01:14:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.886 01:14:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.886 01:14:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:40.886 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:40.886 01:14:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.886 01:14:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:40.886 01:14:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:40.886 01:14:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:40.886 01:14:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:40.886 01:14:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:40.886 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:40.886 01:14:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:40.886 01:14:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:40.886 01:14:30 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:40.886 01:14:30 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:40.886 01:14:30 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:40.886 01:14:30 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:40.886 01:14:30 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:41.454 01:14:31 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:43.992 01:14:34 -- target/perf_adq.sh@54 -- # sleep 5 00:21:49.275 01:14:39 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:49.275 01:14:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:49.275 01:14:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:49.275 01:14:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:49.275 01:14:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:49.275 01:14:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:49.275 01:14:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:49.275 01:14:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:49.275 01:14:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:49.275 01:14:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:49.275 01:14:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:49.275 01:14:39 -- common/autotest_common.sh@10 -- # set +x 00:21:49.275 01:14:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:49.275 01:14:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:49.275 01:14:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:49.275 01:14:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:49.275 01:14:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:49.275 01:14:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:49.275 01:14:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:49.275 01:14:39 -- nvmf/common.sh@294 -- # net_devs=() 00:21:49.275 01:14:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:49.275 01:14:39 -- nvmf/common.sh@295 -- # e810=() 00:21:49.275 01:14:39 -- nvmf/common.sh@295 -- # local -ga e810 00:21:49.275 01:14:39 -- nvmf/common.sh@296 -- # x722=() 00:21:49.275 01:14:39 -- nvmf/common.sh@296 -- # local -ga x722 00:21:49.275 01:14:39 -- nvmf/common.sh@297 -- # mlx=() 00:21:49.275 01:14:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:49.275 01:14:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:49.275 01:14:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:49.275 01:14:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:49.275 01:14:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:49.275 01:14:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.275 01:14:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:49.275 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:49.275 01:14:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:49.275 01:14:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:49.275 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:49.275 01:14:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:49.275 01:14:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.275 01:14:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.275 01:14:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.275 01:14:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.275 01:14:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:49.275 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:49.275 01:14:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.275 01:14:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:49.275 01:14:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:49.275 01:14:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:49.275 01:14:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:49.275 01:14:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:49.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:49.275 01:14:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:49.275 01:14:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:49.275 01:14:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:49.275 01:14:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:49.275 01:14:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:49.275 01:14:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:49.275 01:14:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:49.275 01:14:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:49.275 01:14:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:49.275 01:14:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:49.275 01:14:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:49.275 01:14:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:49.275 01:14:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:49.275 01:14:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:49.275 01:14:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:49.275 01:14:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:49.275 01:14:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:49.275 01:14:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:49.275 01:14:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:49.275 01:14:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:49.275 01:14:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:49.275 01:14:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:49.275 01:14:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:49.275 01:14:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:49.275 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:49.275 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.248 ms 00:21:49.275 00:21:49.275 --- 10.0.0.2 ping statistics --- 00:21:49.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.275 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:21:49.275 01:14:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:49.275 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:49.275 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.109 ms 00:21:49.275 00:21:49.275 --- 10.0.0.1 ping statistics --- 00:21:49.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:49.275 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:21:49.275 01:14:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:49.275 01:14:39 -- nvmf/common.sh@410 -- # return 0 00:21:49.275 01:14:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:49.275 01:14:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:49.275 01:14:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:49.275 01:14:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:49.275 01:14:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:49.275 01:14:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:49.275 01:14:39 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:49.275 01:14:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:49.275 01:14:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:49.275 01:14:39 -- common/autotest_common.sh@10 -- # set +x 00:21:49.275 01:14:39 -- nvmf/common.sh@469 -- # nvmfpid=1107316 00:21:49.275 01:14:39 -- nvmf/common.sh@470 -- # waitforlisten 1107316 00:21:49.275 01:14:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:49.275 01:14:39 -- common/autotest_common.sh@829 -- # '[' -z 1107316 ']' 00:21:49.275 01:14:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:49.276 01:14:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:49.276 01:14:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:49.276 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:49.276 01:14:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:49.276 01:14:39 -- common/autotest_common.sh@10 -- # set +x 00:21:49.276 [2024-11-26 01:14:39.244170] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:49.276 [2024-11-26 01:14:39.244244] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:49.276 EAL: No free 2048 kB hugepages reported on node 1 00:21:49.276 [2024-11-26 01:14:39.313673] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:49.276 [2024-11-26 01:14:39.434292] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:49.276 [2024-11-26 01:14:39.434451] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:49.276 [2024-11-26 01:14:39.434471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:49.276 [2024-11-26 01:14:39.434485] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:49.276 [2024-11-26 01:14:39.434543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:49.276 [2024-11-26 01:14:39.434598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:49.276 [2024-11-26 01:14:39.434654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:49.276 [2024-11-26 01:14:39.434657] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:49.842 01:14:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:49.842 01:14:40 -- common/autotest_common.sh@862 -- # return 0 00:21:49.842 01:14:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:49.842 01:14:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:49.842 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:49.842 01:14:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:49.842 01:14:40 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:49.842 01:14:40 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:49.842 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.842 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:49.842 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.842 01:14:40 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:49.842 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.842 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:49.842 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.842 01:14:40 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:49.842 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.842 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:49.842 [2024-11-26 01:14:40.342537] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:49.842 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.842 01:14:40 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:49.842 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.842 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:50.101 Malloc1 00:21:50.101 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.101 01:14:40 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:50.101 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.101 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:50.101 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.101 01:14:40 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:50.101 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.101 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:50.101 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.101 01:14:40 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:50.101 01:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:50.101 01:14:40 -- common/autotest_common.sh@10 -- # set +x 00:21:50.101 [2024-11-26 01:14:40.395409] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:50.101 01:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:50.101 01:14:40 -- target/perf_adq.sh@73 -- # perfpid=1107483 00:21:50.101 01:14:40 -- target/perf_adq.sh@74 -- # sleep 2 00:21:50.101 01:14:40 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:50.101 EAL: No free 2048 kB hugepages reported on node 1 00:21:52.007 01:14:42 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:52.007 01:14:42 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:52.007 01:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:52.007 01:14:42 -- target/perf_adq.sh@76 -- # wc -l 00:21:52.007 01:14:42 -- common/autotest_common.sh@10 -- # set +x 00:21:52.007 01:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:52.007 01:14:42 -- target/perf_adq.sh@76 -- # count=4 00:21:52.007 01:14:42 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:52.007 01:14:42 -- target/perf_adq.sh@81 -- # wait 1107483 00:22:00.123 Initializing NVMe Controllers 00:22:00.123 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:00.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:00.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:00.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:00.123 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:00.123 Initialization complete. Launching workers. 00:22:00.123 ======================================================== 00:22:00.123 Latency(us) 00:22:00.123 Device Information : IOPS MiB/s Average min max 00:22:00.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11020.00 43.05 5808.86 1390.60 10130.37 00:22:00.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11266.50 44.01 5680.87 1747.72 9517.67 00:22:00.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11053.50 43.18 5789.98 1262.03 9859.29 00:22:00.123 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10790.00 42.15 5930.89 1937.61 10231.32 00:22:00.123 ======================================================== 00:22:00.123 Total : 44130.00 172.38 5801.29 1262.03 10231.32 00:22:00.123 00:22:00.123 01:14:50 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:00.123 01:14:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:00.123 01:14:50 -- nvmf/common.sh@116 -- # sync 00:22:00.123 01:14:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:00.123 01:14:50 -- nvmf/common.sh@119 -- # set +e 00:22:00.123 01:14:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:00.123 01:14:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:00.123 rmmod nvme_tcp 00:22:00.123 rmmod nvme_fabrics 00:22:00.123 rmmod nvme_keyring 00:22:00.123 01:14:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:00.123 01:14:50 -- nvmf/common.sh@123 -- # set -e 00:22:00.123 01:14:50 -- nvmf/common.sh@124 -- # return 0 00:22:00.123 01:14:50 -- nvmf/common.sh@477 -- # '[' -n 1107316 ']' 00:22:00.123 01:14:50 -- nvmf/common.sh@478 -- # killprocess 1107316 00:22:00.123 01:14:50 -- common/autotest_common.sh@936 -- # '[' -z 1107316 ']' 00:22:00.123 01:14:50 -- common/autotest_common.sh@940 -- # kill -0 1107316 00:22:00.123 01:14:50 -- common/autotest_common.sh@941 -- # uname 00:22:00.123 01:14:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:00.123 01:14:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1107316 00:22:00.123 01:14:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:00.123 01:14:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:00.123 01:14:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1107316' 00:22:00.123 killing process with pid 1107316 00:22:00.123 01:14:50 -- common/autotest_common.sh@955 -- # kill 1107316 00:22:00.123 01:14:50 -- common/autotest_common.sh@960 -- # wait 1107316 00:22:00.691 01:14:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:00.691 01:14:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:00.691 01:14:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:00.691 01:14:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:00.691 01:14:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:00.691 01:14:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:00.691 01:14:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:00.691 01:14:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:02.594 01:14:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:02.594 01:14:52 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:02.594 01:14:52 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:03.159 01:14:53 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:05.692 01:14:56 -- target/perf_adq.sh@54 -- # sleep 5 00:22:10.969 01:15:01 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:10.970 01:15:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:10.970 01:15:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:10.970 01:15:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:10.970 01:15:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:10.970 01:15:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:10.970 01:15:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:10.970 01:15:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:10.970 01:15:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:10.970 01:15:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:10.970 01:15:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:10.970 01:15:01 -- common/autotest_common.sh@10 -- # set +x 00:22:10.970 01:15:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:10.970 01:15:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:10.970 01:15:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:10.970 01:15:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:10.970 01:15:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:10.970 01:15:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:10.970 01:15:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:10.970 01:15:01 -- nvmf/common.sh@294 -- # net_devs=() 00:22:10.970 01:15:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:10.970 01:15:01 -- nvmf/common.sh@295 -- # e810=() 00:22:10.970 01:15:01 -- nvmf/common.sh@295 -- # local -ga e810 00:22:10.970 01:15:01 -- nvmf/common.sh@296 -- # x722=() 00:22:10.970 01:15:01 -- nvmf/common.sh@296 -- # local -ga x722 00:22:10.970 01:15:01 -- nvmf/common.sh@297 -- # mlx=() 00:22:10.970 01:15:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:10.970 01:15:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:10.970 01:15:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:10.970 01:15:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:10.970 01:15:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:10.970 01:15:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:10.970 01:15:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:10.970 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:10.970 01:15:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:10.970 01:15:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:10.970 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:10.970 01:15:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:10.970 01:15:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:10.970 01:15:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:10.970 01:15:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:10.970 01:15:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:10.970 01:15:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:10.970 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:10.970 01:15:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:10.970 01:15:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:10.970 01:15:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:10.970 01:15:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:10.970 01:15:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:10.970 01:15:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:10.970 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:10.970 01:15:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:10.970 01:15:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:10.970 01:15:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:10.970 01:15:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:10.970 01:15:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:10.970 01:15:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:10.970 01:15:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:10.970 01:15:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:10.970 01:15:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:10.970 01:15:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:10.970 01:15:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:10.970 01:15:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:10.970 01:15:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:10.970 01:15:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:10.970 01:15:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:10.970 01:15:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:10.970 01:15:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:10.970 01:15:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:10.970 01:15:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:10.970 01:15:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:10.970 01:15:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:10.970 01:15:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:10.970 01:15:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:10.970 01:15:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:10.970 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:10.970 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.260 ms 00:22:10.970 00:22:10.970 --- 10.0.0.2 ping statistics --- 00:22:10.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:10.970 rtt min/avg/max/mdev = 0.260/0.260/0.260/0.000 ms 00:22:10.970 01:15:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:10.970 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:10.970 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:22:10.970 00:22:10.970 --- 10.0.0.1 ping statistics --- 00:22:10.970 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:10.970 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:22:10.970 01:15:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:10.970 01:15:01 -- nvmf/common.sh@410 -- # return 0 00:22:10.970 01:15:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:10.970 01:15:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:10.970 01:15:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:10.970 01:15:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:10.970 01:15:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:10.970 01:15:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:10.970 01:15:01 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:10.970 01:15:01 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:10.970 01:15:01 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:10.970 01:15:01 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:10.970 net.core.busy_poll = 1 00:22:10.970 01:15:01 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:10.970 net.core.busy_read = 1 00:22:10.970 01:15:01 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:10.971 01:15:01 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:10.971 01:15:01 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:10.971 01:15:01 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:10.971 01:15:01 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:10.971 01:15:01 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:10.971 01:15:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:10.971 01:15:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:10.971 01:15:01 -- common/autotest_common.sh@10 -- # set +x 00:22:10.971 01:15:01 -- nvmf/common.sh@469 -- # nvmfpid=1110260 00:22:10.971 01:15:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:10.971 01:15:01 -- nvmf/common.sh@470 -- # waitforlisten 1110260 00:22:10.971 01:15:01 -- common/autotest_common.sh@829 -- # '[' -z 1110260 ']' 00:22:10.971 01:15:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:10.971 01:15:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:10.971 01:15:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:10.971 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:10.971 01:15:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:10.971 01:15:01 -- common/autotest_common.sh@10 -- # set +x 00:22:10.971 [2024-11-26 01:15:01.439826] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:10.971 [2024-11-26 01:15:01.439915] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:10.971 EAL: No free 2048 kB hugepages reported on node 1 00:22:11.229 [2024-11-26 01:15:01.509863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:11.229 [2024-11-26 01:15:01.628226] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:11.229 [2024-11-26 01:15:01.628382] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:11.229 [2024-11-26 01:15:01.628403] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:11.229 [2024-11-26 01:15:01.628418] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:11.229 [2024-11-26 01:15:01.628503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:11.229 [2024-11-26 01:15:01.628576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:11.229 [2024-11-26 01:15:01.628724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:11.229 [2024-11-26 01:15:01.628729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:12.165 01:15:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:12.165 01:15:02 -- common/autotest_common.sh@862 -- # return 0 00:22:12.165 01:15:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:12.165 01:15:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 01:15:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:12.165 01:15:02 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:12.165 01:15:02 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 [2024-11-26 01:15:02.565641] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 Malloc1 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:12.165 01:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:12.165 01:15:02 -- common/autotest_common.sh@10 -- # set +x 00:22:12.165 [2024-11-26 01:15:02.619049] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:12.165 01:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:12.165 01:15:02 -- target/perf_adq.sh@94 -- # perfpid=1110446 00:22:12.165 01:15:02 -- target/perf_adq.sh@95 -- # sleep 2 00:22:12.165 01:15:02 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:12.165 EAL: No free 2048 kB hugepages reported on node 1 00:22:14.700 01:15:04 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:14.700 01:15:04 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:14.700 01:15:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.700 01:15:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.700 01:15:04 -- target/perf_adq.sh@97 -- # wc -l 00:22:14.700 01:15:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.700 01:15:04 -- target/perf_adq.sh@97 -- # count=2 00:22:14.700 01:15:04 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:14.700 01:15:04 -- target/perf_adq.sh@103 -- # wait 1110446 00:22:22.839 Initializing NVMe Controllers 00:22:22.839 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:22.839 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:22.839 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:22.839 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:22.839 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:22.839 Initialization complete. Launching workers. 00:22:22.839 ======================================================== 00:22:22.839 Latency(us) 00:22:22.839 Device Information : IOPS MiB/s Average min max 00:22:22.839 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5046.00 19.71 12690.91 1681.75 60478.47 00:22:22.839 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 14329.10 55.97 4475.50 1086.70 46068.35 00:22:22.839 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5277.20 20.61 12157.67 1755.21 58658.71 00:22:22.839 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5060.80 19.77 12654.19 1486.06 59161.59 00:22:22.839 ======================================================== 00:22:22.839 Total : 29713.10 116.07 8628.08 1086.70 60478.47 00:22:22.839 00:22:22.839 01:15:12 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:22.839 01:15:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:22.839 01:15:12 -- nvmf/common.sh@116 -- # sync 00:22:22.839 01:15:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:22.839 01:15:12 -- nvmf/common.sh@119 -- # set +e 00:22:22.839 01:15:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:22.839 01:15:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:22.839 rmmod nvme_tcp 00:22:22.839 rmmod nvme_fabrics 00:22:22.839 rmmod nvme_keyring 00:22:22.839 01:15:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:22.839 01:15:12 -- nvmf/common.sh@123 -- # set -e 00:22:22.839 01:15:12 -- nvmf/common.sh@124 -- # return 0 00:22:22.839 01:15:12 -- nvmf/common.sh@477 -- # '[' -n 1110260 ']' 00:22:22.839 01:15:12 -- nvmf/common.sh@478 -- # killprocess 1110260 00:22:22.839 01:15:12 -- common/autotest_common.sh@936 -- # '[' -z 1110260 ']' 00:22:22.839 01:15:12 -- common/autotest_common.sh@940 -- # kill -0 1110260 00:22:22.839 01:15:12 -- common/autotest_common.sh@941 -- # uname 00:22:22.839 01:15:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:22.839 01:15:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1110260 00:22:22.839 01:15:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:22.839 01:15:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:22.839 01:15:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1110260' 00:22:22.839 killing process with pid 1110260 00:22:22.839 01:15:12 -- common/autotest_common.sh@955 -- # kill 1110260 00:22:22.839 01:15:12 -- common/autotest_common.sh@960 -- # wait 1110260 00:22:22.839 01:15:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:22.839 01:15:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:22.839 01:15:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:22.839 01:15:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:22.839 01:15:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:22.839 01:15:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:22.839 01:15:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:22.839 01:15:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:24.743 01:15:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:24.743 01:15:15 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:24.743 00:22:24.743 real 0m46.320s 00:22:24.743 user 2m45.604s 00:22:24.743 sys 0m9.416s 00:22:24.743 01:15:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:24.743 01:15:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.743 ************************************ 00:22:24.743 END TEST nvmf_perf_adq 00:22:24.743 ************************************ 00:22:24.743 01:15:15 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:24.743 01:15:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:24.743 01:15:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:24.743 01:15:15 -- common/autotest_common.sh@10 -- # set +x 00:22:24.743 ************************************ 00:22:24.743 START TEST nvmf_shutdown 00:22:24.743 ************************************ 00:22:24.743 01:15:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:25.003 * Looking for test storage... 00:22:25.003 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:25.003 01:15:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:25.003 01:15:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:25.003 01:15:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:25.003 01:15:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:25.003 01:15:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:25.003 01:15:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:25.003 01:15:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:25.003 01:15:15 -- scripts/common.sh@335 -- # IFS=.-: 00:22:25.003 01:15:15 -- scripts/common.sh@335 -- # read -ra ver1 00:22:25.003 01:15:15 -- scripts/common.sh@336 -- # IFS=.-: 00:22:25.003 01:15:15 -- scripts/common.sh@336 -- # read -ra ver2 00:22:25.003 01:15:15 -- scripts/common.sh@337 -- # local 'op=<' 00:22:25.003 01:15:15 -- scripts/common.sh@339 -- # ver1_l=2 00:22:25.003 01:15:15 -- scripts/common.sh@340 -- # ver2_l=1 00:22:25.003 01:15:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:25.003 01:15:15 -- scripts/common.sh@343 -- # case "$op" in 00:22:25.003 01:15:15 -- scripts/common.sh@344 -- # : 1 00:22:25.003 01:15:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:25.003 01:15:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:25.003 01:15:15 -- scripts/common.sh@364 -- # decimal 1 00:22:25.003 01:15:15 -- scripts/common.sh@352 -- # local d=1 00:22:25.003 01:15:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:25.003 01:15:15 -- scripts/common.sh@354 -- # echo 1 00:22:25.003 01:15:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:25.003 01:15:15 -- scripts/common.sh@365 -- # decimal 2 00:22:25.003 01:15:15 -- scripts/common.sh@352 -- # local d=2 00:22:25.003 01:15:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:25.003 01:15:15 -- scripts/common.sh@354 -- # echo 2 00:22:25.003 01:15:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:25.003 01:15:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:25.003 01:15:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:25.003 01:15:15 -- scripts/common.sh@367 -- # return 0 00:22:25.003 01:15:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:25.003 01:15:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:25.003 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.003 --rc genhtml_branch_coverage=1 00:22:25.003 --rc genhtml_function_coverage=1 00:22:25.003 --rc genhtml_legend=1 00:22:25.003 --rc geninfo_all_blocks=1 00:22:25.003 --rc geninfo_unexecuted_blocks=1 00:22:25.003 00:22:25.003 ' 00:22:25.003 01:15:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:25.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.004 --rc genhtml_branch_coverage=1 00:22:25.004 --rc genhtml_function_coverage=1 00:22:25.004 --rc genhtml_legend=1 00:22:25.004 --rc geninfo_all_blocks=1 00:22:25.004 --rc geninfo_unexecuted_blocks=1 00:22:25.004 00:22:25.004 ' 00:22:25.004 01:15:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:25.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.004 --rc genhtml_branch_coverage=1 00:22:25.004 --rc genhtml_function_coverage=1 00:22:25.004 --rc genhtml_legend=1 00:22:25.004 --rc geninfo_all_blocks=1 00:22:25.004 --rc geninfo_unexecuted_blocks=1 00:22:25.004 00:22:25.004 ' 00:22:25.004 01:15:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:25.004 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:25.004 --rc genhtml_branch_coverage=1 00:22:25.004 --rc genhtml_function_coverage=1 00:22:25.004 --rc genhtml_legend=1 00:22:25.004 --rc geninfo_all_blocks=1 00:22:25.004 --rc geninfo_unexecuted_blocks=1 00:22:25.004 00:22:25.004 ' 00:22:25.004 01:15:15 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:25.004 01:15:15 -- nvmf/common.sh@7 -- # uname -s 00:22:25.004 01:15:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:25.004 01:15:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:25.004 01:15:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:25.004 01:15:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:25.004 01:15:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:25.004 01:15:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:25.004 01:15:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:25.004 01:15:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:25.004 01:15:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:25.004 01:15:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:25.004 01:15:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.004 01:15:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:25.004 01:15:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:25.004 01:15:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:25.004 01:15:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:25.004 01:15:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:25.004 01:15:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:25.004 01:15:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:25.004 01:15:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:25.004 01:15:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.004 01:15:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.004 01:15:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.004 01:15:15 -- paths/export.sh@5 -- # export PATH 00:22:25.004 01:15:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:25.004 01:15:15 -- nvmf/common.sh@46 -- # : 0 00:22:25.004 01:15:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:25.004 01:15:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:25.004 01:15:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:25.004 01:15:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:25.004 01:15:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:25.004 01:15:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:25.004 01:15:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:25.004 01:15:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:25.004 01:15:15 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:25.004 01:15:15 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:25.004 01:15:15 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:25.004 01:15:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:25.004 01:15:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:25.004 01:15:15 -- common/autotest_common.sh@10 -- # set +x 00:22:25.004 ************************************ 00:22:25.004 START TEST nvmf_shutdown_tc1 00:22:25.004 ************************************ 00:22:25.004 01:15:15 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:25.004 01:15:15 -- target/shutdown.sh@74 -- # starttarget 00:22:25.004 01:15:15 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:25.004 01:15:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:25.004 01:15:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:25.004 01:15:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:25.004 01:15:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:25.004 01:15:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:25.004 01:15:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:25.004 01:15:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:25.004 01:15:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:25.004 01:15:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:25.004 01:15:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:25.004 01:15:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:25.004 01:15:15 -- common/autotest_common.sh@10 -- # set +x 00:22:26.912 01:15:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:26.912 01:15:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:26.912 01:15:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:26.912 01:15:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:26.912 01:15:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:26.912 01:15:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:26.912 01:15:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:26.912 01:15:17 -- nvmf/common.sh@294 -- # net_devs=() 00:22:26.912 01:15:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:26.912 01:15:17 -- nvmf/common.sh@295 -- # e810=() 00:22:26.912 01:15:17 -- nvmf/common.sh@295 -- # local -ga e810 00:22:26.912 01:15:17 -- nvmf/common.sh@296 -- # x722=() 00:22:26.912 01:15:17 -- nvmf/common.sh@296 -- # local -ga x722 00:22:26.912 01:15:17 -- nvmf/common.sh@297 -- # mlx=() 00:22:26.912 01:15:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:26.912 01:15:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:26.913 01:15:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:26.913 01:15:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:26.913 01:15:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:26.913 01:15:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:26.913 01:15:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:26.913 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:26.913 01:15:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:26.913 01:15:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:26.913 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:26.913 01:15:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:26.913 01:15:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:26.913 01:15:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:26.913 01:15:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:26.913 01:15:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:26.913 01:15:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:26.913 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:26.913 01:15:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:26.913 01:15:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:26.913 01:15:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:26.913 01:15:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:26.913 01:15:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:26.913 01:15:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:26.913 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:26.913 01:15:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:26.913 01:15:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:26.913 01:15:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:26.913 01:15:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:26.913 01:15:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:26.913 01:15:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:26.913 01:15:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:26.913 01:15:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:26.913 01:15:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:26.913 01:15:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:26.913 01:15:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:26.913 01:15:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:26.913 01:15:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:26.913 01:15:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:26.913 01:15:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:26.913 01:15:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:26.913 01:15:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:26.913 01:15:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:26.913 01:15:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:26.913 01:15:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:26.913 01:15:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:26.913 01:15:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:27.172 01:15:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:27.172 01:15:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:27.172 01:15:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:27.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:27.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:22:27.172 00:22:27.172 --- 10.0.0.2 ping statistics --- 00:22:27.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.172 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:22:27.172 01:15:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:27.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:27.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:22:27.172 00:22:27.172 --- 10.0.0.1 ping statistics --- 00:22:27.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:27.172 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:22:27.172 01:15:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:27.172 01:15:17 -- nvmf/common.sh@410 -- # return 0 00:22:27.172 01:15:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:27.172 01:15:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:27.172 01:15:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:27.172 01:15:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:27.172 01:15:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:27.172 01:15:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:27.172 01:15:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:27.172 01:15:17 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:27.172 01:15:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:27.172 01:15:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:27.172 01:15:17 -- common/autotest_common.sh@10 -- # set +x 00:22:27.172 01:15:17 -- nvmf/common.sh@469 -- # nvmfpid=1114171 00:22:27.172 01:15:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:27.172 01:15:17 -- nvmf/common.sh@470 -- # waitforlisten 1114171 00:22:27.172 01:15:17 -- common/autotest_common.sh@829 -- # '[' -z 1114171 ']' 00:22:27.172 01:15:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:27.172 01:15:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:27.172 01:15:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:27.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:27.172 01:15:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:27.173 01:15:17 -- common/autotest_common.sh@10 -- # set +x 00:22:27.173 [2024-11-26 01:15:17.535640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:27.173 [2024-11-26 01:15:17.535737] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:27.173 EAL: No free 2048 kB hugepages reported on node 1 00:22:27.173 [2024-11-26 01:15:17.606169] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:27.433 [2024-11-26 01:15:17.720904] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:27.433 [2024-11-26 01:15:17.721078] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:27.433 [2024-11-26 01:15:17.721098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:27.433 [2024-11-26 01:15:17.721113] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:27.433 [2024-11-26 01:15:17.721208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:27.433 [2024-11-26 01:15:17.721328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:27.433 [2024-11-26 01:15:17.721395] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:27.433 [2024-11-26 01:15:17.721398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:28.001 01:15:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:28.001 01:15:18 -- common/autotest_common.sh@862 -- # return 0 00:22:28.001 01:15:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:28.001 01:15:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:28.001 01:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:28.001 01:15:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:28.001 01:15:18 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:28.001 01:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.001 01:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:28.001 [2024-11-26 01:15:18.524359] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:28.001 01:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.002 01:15:18 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:28.002 01:15:18 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:28.002 01:15:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:28.002 01:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:28.260 01:15:18 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:28.260 01:15:18 -- target/shutdown.sh@28 -- # cat 00:22:28.260 01:15:18 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:28.260 01:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:28.260 01:15:18 -- common/autotest_common.sh@10 -- # set +x 00:22:28.260 Malloc1 00:22:28.260 [2024-11-26 01:15:18.599655] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:28.260 Malloc2 00:22:28.260 Malloc3 00:22:28.260 Malloc4 00:22:28.260 Malloc5 00:22:28.519 Malloc6 00:22:28.519 Malloc7 00:22:28.519 Malloc8 00:22:28.519 Malloc9 00:22:28.519 Malloc10 00:22:28.519 01:15:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:28.519 01:15:19 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:28.519 01:15:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:28.519 01:15:19 -- common/autotest_common.sh@10 -- # set +x 00:22:28.786 01:15:19 -- target/shutdown.sh@78 -- # perfpid=1114481 00:22:28.786 01:15:19 -- target/shutdown.sh@79 -- # waitforlisten 1114481 /var/tmp/bdevperf.sock 00:22:28.786 01:15:19 -- common/autotest_common.sh@829 -- # '[' -z 1114481 ']' 00:22:28.786 01:15:19 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:28.786 01:15:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:28.786 01:15:19 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:28.786 01:15:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:28.786 01:15:19 -- nvmf/common.sh@520 -- # config=() 00:22:28.786 01:15:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:28.786 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:28.786 01:15:19 -- nvmf/common.sh@520 -- # local subsystem config 00:22:28.786 01:15:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:28.786 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.786 01:15:19 -- common/autotest_common.sh@10 -- # set +x 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.786 { 00:22:28.786 "params": { 00:22:28.786 "name": "Nvme$subsystem", 00:22:28.786 "trtype": "$TEST_TRANSPORT", 00:22:28.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.786 "adrfam": "ipv4", 00:22:28.786 "trsvcid": "$NVMF_PORT", 00:22:28.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.786 "hdgst": ${hdgst:-false}, 00:22:28.786 "ddgst": ${ddgst:-false} 00:22:28.786 }, 00:22:28.786 "method": "bdev_nvme_attach_controller" 00:22:28.786 } 00:22:28.786 EOF 00:22:28.786 )") 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.786 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.786 { 00:22:28.786 "params": { 00:22:28.786 "name": "Nvme$subsystem", 00:22:28.786 "trtype": "$TEST_TRANSPORT", 00:22:28.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.786 "adrfam": "ipv4", 00:22:28.786 "trsvcid": "$NVMF_PORT", 00:22:28.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.786 "hdgst": ${hdgst:-false}, 00:22:28.786 "ddgst": ${ddgst:-false} 00:22:28.786 }, 00:22:28.786 "method": "bdev_nvme_attach_controller" 00:22:28.786 } 00:22:28.786 EOF 00:22:28.786 )") 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.786 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.786 { 00:22:28.786 "params": { 00:22:28.786 "name": "Nvme$subsystem", 00:22:28.786 "trtype": "$TEST_TRANSPORT", 00:22:28.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.786 "adrfam": "ipv4", 00:22:28.786 "trsvcid": "$NVMF_PORT", 00:22:28.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.786 "hdgst": ${hdgst:-false}, 00:22:28.786 "ddgst": ${ddgst:-false} 00:22:28.786 }, 00:22:28.786 "method": "bdev_nvme_attach_controller" 00:22:28.786 } 00:22:28.786 EOF 00:22:28.786 )") 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.786 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.786 { 00:22:28.786 "params": { 00:22:28.786 "name": "Nvme$subsystem", 00:22:28.786 "trtype": "$TEST_TRANSPORT", 00:22:28.786 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.786 "adrfam": "ipv4", 00:22:28.786 "trsvcid": "$NVMF_PORT", 00:22:28.786 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.786 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.786 "hdgst": ${hdgst:-false}, 00:22:28.786 "ddgst": ${ddgst:-false} 00:22:28.786 }, 00:22:28.786 "method": "bdev_nvme_attach_controller" 00:22:28.786 } 00:22:28.786 EOF 00:22:28.786 )") 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.786 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.786 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.786 { 00:22:28.786 "params": { 00:22:28.786 "name": "Nvme$subsystem", 00:22:28.786 "trtype": "$TEST_TRANSPORT", 00:22:28.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "$NVMF_PORT", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.787 "hdgst": ${hdgst:-false}, 00:22:28.787 "ddgst": ${ddgst:-false} 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 } 00:22:28.787 EOF 00:22:28.787 )") 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.787 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.787 { 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme$subsystem", 00:22:28.787 "trtype": "$TEST_TRANSPORT", 00:22:28.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "$NVMF_PORT", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.787 "hdgst": ${hdgst:-false}, 00:22:28.787 "ddgst": ${ddgst:-false} 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 } 00:22:28.787 EOF 00:22:28.787 )") 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.787 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.787 { 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme$subsystem", 00:22:28.787 "trtype": "$TEST_TRANSPORT", 00:22:28.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "$NVMF_PORT", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.787 "hdgst": ${hdgst:-false}, 00:22:28.787 "ddgst": ${ddgst:-false} 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 } 00:22:28.787 EOF 00:22:28.787 )") 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.787 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.787 { 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme$subsystem", 00:22:28.787 "trtype": "$TEST_TRANSPORT", 00:22:28.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "$NVMF_PORT", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.787 "hdgst": ${hdgst:-false}, 00:22:28.787 "ddgst": ${ddgst:-false} 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 } 00:22:28.787 EOF 00:22:28.787 )") 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.787 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.787 { 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme$subsystem", 00:22:28.787 "trtype": "$TEST_TRANSPORT", 00:22:28.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "$NVMF_PORT", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.787 "hdgst": ${hdgst:-false}, 00:22:28.787 "ddgst": ${ddgst:-false} 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 } 00:22:28.787 EOF 00:22:28.787 )") 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.787 01:15:19 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:28.787 { 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme$subsystem", 00:22:28.787 "trtype": "$TEST_TRANSPORT", 00:22:28.787 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "$NVMF_PORT", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:28.787 "hdgst": ${hdgst:-false}, 00:22:28.787 "ddgst": ${ddgst:-false} 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 } 00:22:28.787 EOF 00:22:28.787 )") 00:22:28.787 01:15:19 -- nvmf/common.sh@542 -- # cat 00:22:28.787 01:15:19 -- nvmf/common.sh@544 -- # jq . 00:22:28.787 01:15:19 -- nvmf/common.sh@545 -- # IFS=, 00:22:28.787 01:15:19 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme1", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme2", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme3", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme4", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme5", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme6", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme7", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme8", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme9", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 },{ 00:22:28.787 "params": { 00:22:28.787 "name": "Nvme10", 00:22:28.787 "trtype": "tcp", 00:22:28.787 "traddr": "10.0.0.2", 00:22:28.787 "adrfam": "ipv4", 00:22:28.787 "trsvcid": "4420", 00:22:28.787 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:28.787 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:28.787 "hdgst": false, 00:22:28.787 "ddgst": false 00:22:28.787 }, 00:22:28.787 "method": "bdev_nvme_attach_controller" 00:22:28.787 }' 00:22:28.787 [2024-11-26 01:15:19.096880] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:28.787 [2024-11-26 01:15:19.096995] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:28.787 EAL: No free 2048 kB hugepages reported on node 1 00:22:28.787 [2024-11-26 01:15:19.159542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:28.787 [2024-11-26 01:15:19.268142] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:30.717 01:15:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:30.717 01:15:20 -- common/autotest_common.sh@862 -- # return 0 00:22:30.717 01:15:20 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:30.717 01:15:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:30.717 01:15:20 -- common/autotest_common.sh@10 -- # set +x 00:22:30.717 01:15:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:30.717 01:15:20 -- target/shutdown.sh@83 -- # kill -9 1114481 00:22:30.717 01:15:20 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:30.717 01:15:20 -- target/shutdown.sh@87 -- # sleep 1 00:22:31.649 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 1114481 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:31.649 01:15:21 -- target/shutdown.sh@88 -- # kill -0 1114171 00:22:31.649 01:15:21 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:31.649 01:15:21 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:31.649 01:15:21 -- nvmf/common.sh@520 -- # config=() 00:22:31.649 01:15:21 -- nvmf/common.sh@520 -- # local subsystem config 00:22:31.649 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.649 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.649 { 00:22:31.649 "params": { 00:22:31.649 "name": "Nvme$subsystem", 00:22:31.649 "trtype": "$TEST_TRANSPORT", 00:22:31.649 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.649 "adrfam": "ipv4", 00:22:31.649 "trsvcid": "$NVMF_PORT", 00:22:31.649 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.649 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.649 "hdgst": ${hdgst:-false}, 00:22:31.649 "ddgst": ${ddgst:-false} 00:22:31.649 }, 00:22:31.649 "method": "bdev_nvme_attach_controller" 00:22:31.649 } 00:22:31.649 EOF 00:22:31.649 )") 00:22:31.649 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.649 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.649 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.649 { 00:22:31.649 "params": { 00:22:31.649 "name": "Nvme$subsystem", 00:22:31.649 "trtype": "$TEST_TRANSPORT", 00:22:31.649 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.649 "adrfam": "ipv4", 00:22:31.649 "trsvcid": "$NVMF_PORT", 00:22:31.649 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.649 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.649 "hdgst": ${hdgst:-false}, 00:22:31.649 "ddgst": ${ddgst:-false} 00:22:31.649 }, 00:22:31.649 "method": "bdev_nvme_attach_controller" 00:22:31.649 } 00:22:31.649 EOF 00:22:31.649 )") 00:22:31.649 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.649 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:31.650 { 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme$subsystem", 00:22:31.650 "trtype": "$TEST_TRANSPORT", 00:22:31.650 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "$NVMF_PORT", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:31.650 "hdgst": ${hdgst:-false}, 00:22:31.650 "ddgst": ${ddgst:-false} 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 } 00:22:31.650 EOF 00:22:31.650 )") 00:22:31.650 01:15:21 -- nvmf/common.sh@542 -- # cat 00:22:31.650 01:15:21 -- nvmf/common.sh@544 -- # jq . 00:22:31.650 01:15:21 -- nvmf/common.sh@545 -- # IFS=, 00:22:31.650 01:15:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme1", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme2", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme3", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme4", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme5", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme6", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme7", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme8", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme9", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 },{ 00:22:31.650 "params": { 00:22:31.650 "name": "Nvme10", 00:22:31.650 "trtype": "tcp", 00:22:31.650 "traddr": "10.0.0.2", 00:22:31.650 "adrfam": "ipv4", 00:22:31.650 "trsvcid": "4420", 00:22:31.650 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:31.650 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:31.650 "hdgst": false, 00:22:31.650 "ddgst": false 00:22:31.650 }, 00:22:31.650 "method": "bdev_nvme_attach_controller" 00:22:31.650 }' 00:22:31.650 [2024-11-26 01:15:21.892240] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:31.650 [2024-11-26 01:15:21.892326] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1114794 ] 00:22:31.650 EAL: No free 2048 kB hugepages reported on node 1 00:22:31.650 [2024-11-26 01:15:21.957826] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:31.650 [2024-11-26 01:15:22.065772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:33.026 Running I/O for 1 seconds... 00:22:33.966 00:22:33.966 Latency(us) 00:22:33.966 [2024-11-26T00:15:24.501Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme1n1 : 1.06 390.54 24.41 0.00 0.00 158222.68 12913.02 145247.19 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme2n1 : 1.08 400.45 25.03 0.00 0.00 156276.91 14466.47 132819.63 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme3n1 : 1.08 401.22 25.08 0.00 0.00 154813.84 15340.28 115731.72 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme4n1 : 1.09 399.90 24.99 0.00 0.00 154282.97 15049.01 126605.84 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme5n1 : 1.09 398.59 24.91 0.00 0.00 153530.64 16602.45 126605.84 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme6n1 : 1.10 395.83 24.74 0.00 0.00 153316.54 18641.35 129712.73 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme7n1 : 1.10 393.97 24.62 0.00 0.00 154143.10 8689.59 125052.40 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme8n1 : 1.10 393.01 24.56 0.00 0.00 153325.21 9660.49 129712.73 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme9n1 : 1.11 396.98 24.81 0.00 0.00 150343.78 13883.92 123498.95 00:22:33.966 [2024-11-26T00:15:24.501Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:33.966 Verification LBA range: start 0x0 length 0x400 00:22:33.966 Nvme10n1 : 1.11 401.22 25.08 0.00 0.00 148527.29 5024.43 146800.64 00:22:33.966 [2024-11-26T00:15:24.501Z] =================================================================================================================== 00:22:33.966 [2024-11-26T00:15:24.501Z] Total : 3971.71 248.23 0.00 0.00 153641.48 5024.43 146800.64 00:22:34.225 01:15:24 -- target/shutdown.sh@93 -- # stoptarget 00:22:34.225 01:15:24 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:34.225 01:15:24 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:34.225 01:15:24 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:34.225 01:15:24 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:34.225 01:15:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:34.225 01:15:24 -- nvmf/common.sh@116 -- # sync 00:22:34.225 01:15:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:34.225 01:15:24 -- nvmf/common.sh@119 -- # set +e 00:22:34.225 01:15:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:34.225 01:15:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:34.225 rmmod nvme_tcp 00:22:34.225 rmmod nvme_fabrics 00:22:34.225 rmmod nvme_keyring 00:22:34.225 01:15:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:34.225 01:15:24 -- nvmf/common.sh@123 -- # set -e 00:22:34.225 01:15:24 -- nvmf/common.sh@124 -- # return 0 00:22:34.225 01:15:24 -- nvmf/common.sh@477 -- # '[' -n 1114171 ']' 00:22:34.225 01:15:24 -- nvmf/common.sh@478 -- # killprocess 1114171 00:22:34.225 01:15:24 -- common/autotest_common.sh@936 -- # '[' -z 1114171 ']' 00:22:34.225 01:15:24 -- common/autotest_common.sh@940 -- # kill -0 1114171 00:22:34.225 01:15:24 -- common/autotest_common.sh@941 -- # uname 00:22:34.225 01:15:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:34.225 01:15:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1114171 00:22:34.484 01:15:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:34.484 01:15:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:34.484 01:15:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1114171' 00:22:34.484 killing process with pid 1114171 00:22:34.484 01:15:24 -- common/autotest_common.sh@955 -- # kill 1114171 00:22:34.484 01:15:24 -- common/autotest_common.sh@960 -- # wait 1114171 00:22:35.051 01:15:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:35.051 01:15:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:35.051 01:15:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:35.051 01:15:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:35.051 01:15:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:35.051 01:15:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:35.051 01:15:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:35.051 01:15:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.960 01:15:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:36.960 00:22:36.960 real 0m11.937s 00:22:36.960 user 0m34.665s 00:22:36.960 sys 0m3.239s 00:22:36.960 01:15:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:36.960 01:15:27 -- common/autotest_common.sh@10 -- # set +x 00:22:36.960 ************************************ 00:22:36.960 END TEST nvmf_shutdown_tc1 00:22:36.960 ************************************ 00:22:36.960 01:15:27 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:36.960 01:15:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:36.960 01:15:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:36.960 01:15:27 -- common/autotest_common.sh@10 -- # set +x 00:22:36.960 ************************************ 00:22:36.960 START TEST nvmf_shutdown_tc2 00:22:36.960 ************************************ 00:22:36.960 01:15:27 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:36.960 01:15:27 -- target/shutdown.sh@98 -- # starttarget 00:22:36.960 01:15:27 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:36.960 01:15:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:36.960 01:15:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:36.960 01:15:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:36.960 01:15:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:36.960 01:15:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:36.960 01:15:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:36.960 01:15:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:36.960 01:15:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:36.960 01:15:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:36.960 01:15:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:36.960 01:15:27 -- common/autotest_common.sh@10 -- # set +x 00:22:36.960 01:15:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:36.960 01:15:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:36.960 01:15:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:36.960 01:15:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:36.960 01:15:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:36.960 01:15:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:36.960 01:15:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:36.960 01:15:27 -- nvmf/common.sh@294 -- # net_devs=() 00:22:36.960 01:15:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:36.960 01:15:27 -- nvmf/common.sh@295 -- # e810=() 00:22:36.960 01:15:27 -- nvmf/common.sh@295 -- # local -ga e810 00:22:36.960 01:15:27 -- nvmf/common.sh@296 -- # x722=() 00:22:36.960 01:15:27 -- nvmf/common.sh@296 -- # local -ga x722 00:22:36.960 01:15:27 -- nvmf/common.sh@297 -- # mlx=() 00:22:36.960 01:15:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:36.960 01:15:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:36.960 01:15:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:36.960 01:15:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:36.960 01:15:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:36.960 01:15:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.960 01:15:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:36.960 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:36.960 01:15:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:36.960 01:15:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:36.960 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:36.960 01:15:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:36.960 01:15:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.960 01:15:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.960 01:15:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.960 01:15:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.960 01:15:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:36.960 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:36.960 01:15:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.960 01:15:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:36.960 01:15:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:36.960 01:15:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:36.960 01:15:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:36.960 01:15:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:36.960 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:36.960 01:15:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:36.960 01:15:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:36.960 01:15:27 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:36.960 01:15:27 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:36.960 01:15:27 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:36.960 01:15:27 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:36.960 01:15:27 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:36.960 01:15:27 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:36.960 01:15:27 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:36.960 01:15:27 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:36.960 01:15:27 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:36.960 01:15:27 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:36.960 01:15:27 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:36.960 01:15:27 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:36.960 01:15:27 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:36.960 01:15:27 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:36.960 01:15:27 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:36.960 01:15:27 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:36.960 01:15:27 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:36.960 01:15:27 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:36.960 01:15:27 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:36.960 01:15:27 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:37.220 01:15:27 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:37.220 01:15:27 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:37.220 01:15:27 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:37.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:37.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:22:37.220 00:22:37.220 --- 10.0.0.2 ping statistics --- 00:22:37.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:37.220 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:22:37.220 01:15:27 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:37.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:37.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:22:37.220 00:22:37.220 --- 10.0.0.1 ping statistics --- 00:22:37.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:37.220 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:22:37.220 01:15:27 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:37.220 01:15:27 -- nvmf/common.sh@410 -- # return 0 00:22:37.220 01:15:27 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:37.220 01:15:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:37.220 01:15:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:37.220 01:15:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:37.220 01:15:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:37.220 01:15:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:37.220 01:15:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:37.220 01:15:27 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:37.220 01:15:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:37.220 01:15:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:37.220 01:15:27 -- common/autotest_common.sh@10 -- # set +x 00:22:37.220 01:15:27 -- nvmf/common.sh@469 -- # nvmfpid=1115575 00:22:37.220 01:15:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:37.220 01:15:27 -- nvmf/common.sh@470 -- # waitforlisten 1115575 00:22:37.220 01:15:27 -- common/autotest_common.sh@829 -- # '[' -z 1115575 ']' 00:22:37.220 01:15:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:37.220 01:15:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:37.220 01:15:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:37.220 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:37.220 01:15:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:37.220 01:15:27 -- common/autotest_common.sh@10 -- # set +x 00:22:37.220 [2024-11-26 01:15:27.595985] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:37.220 [2024-11-26 01:15:27.596065] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:37.220 EAL: No free 2048 kB hugepages reported on node 1 00:22:37.220 [2024-11-26 01:15:27.668904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:37.479 [2024-11-26 01:15:27.787496] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:37.479 [2024-11-26 01:15:27.787652] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:37.479 [2024-11-26 01:15:27.787671] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:37.479 [2024-11-26 01:15:27.787683] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:37.479 [2024-11-26 01:15:27.787781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:37.479 [2024-11-26 01:15:27.787899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:37.479 [2024-11-26 01:15:27.787969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:37.479 [2024-11-26 01:15:27.787966] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:38.416 01:15:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:38.416 01:15:28 -- common/autotest_common.sh@862 -- # return 0 00:22:38.416 01:15:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:38.416 01:15:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:38.416 01:15:28 -- common/autotest_common.sh@10 -- # set +x 00:22:38.416 01:15:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:38.416 01:15:28 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:38.416 01:15:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.416 01:15:28 -- common/autotest_common.sh@10 -- # set +x 00:22:38.416 [2024-11-26 01:15:28.663510] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:38.416 01:15:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.416 01:15:28 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:38.416 01:15:28 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:38.416 01:15:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:38.416 01:15:28 -- common/autotest_common.sh@10 -- # set +x 00:22:38.416 01:15:28 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:38.416 01:15:28 -- target/shutdown.sh@28 -- # cat 00:22:38.416 01:15:28 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:38.416 01:15:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:38.416 01:15:28 -- common/autotest_common.sh@10 -- # set +x 00:22:38.416 Malloc1 00:22:38.416 [2024-11-26 01:15:28.738478] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:38.416 Malloc2 00:22:38.416 Malloc3 00:22:38.416 Malloc4 00:22:38.416 Malloc5 00:22:38.674 Malloc6 00:22:38.674 Malloc7 00:22:38.674 Malloc8 00:22:38.674 Malloc9 00:22:38.674 Malloc10 00:22:38.674 01:15:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:38.674 01:15:29 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:38.674 01:15:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:38.674 01:15:29 -- common/autotest_common.sh@10 -- # set +x 00:22:38.674 01:15:29 -- target/shutdown.sh@102 -- # perfpid=1115844 00:22:38.674 01:15:29 -- target/shutdown.sh@103 -- # waitforlisten 1115844 /var/tmp/bdevperf.sock 00:22:38.674 01:15:29 -- common/autotest_common.sh@829 -- # '[' -z 1115844 ']' 00:22:38.674 01:15:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:38.674 01:15:29 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:38.674 01:15:29 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:38.674 01:15:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:38.674 01:15:29 -- nvmf/common.sh@520 -- # config=() 00:22:38.674 01:15:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:38.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:38.674 01:15:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:38.674 01:15:29 -- nvmf/common.sh@520 -- # local subsystem config 00:22:38.674 01:15:29 -- common/autotest_common.sh@10 -- # set +x 00:22:38.674 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.674 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.674 { 00:22:38.674 "params": { 00:22:38.674 "name": "Nvme$subsystem", 00:22:38.674 "trtype": "$TEST_TRANSPORT", 00:22:38.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.674 "adrfam": "ipv4", 00:22:38.674 "trsvcid": "$NVMF_PORT", 00:22:38.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.674 "hdgst": ${hdgst:-false}, 00:22:38.674 "ddgst": ${ddgst:-false} 00:22:38.674 }, 00:22:38.674 "method": "bdev_nvme_attach_controller" 00:22:38.674 } 00:22:38.674 EOF 00:22:38.674 )") 00:22:38.674 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.674 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.675 { 00:22:38.675 "params": { 00:22:38.675 "name": "Nvme$subsystem", 00:22:38.675 "trtype": "$TEST_TRANSPORT", 00:22:38.675 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.675 "adrfam": "ipv4", 00:22:38.675 "trsvcid": "$NVMF_PORT", 00:22:38.675 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.675 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.675 "hdgst": ${hdgst:-false}, 00:22:38.675 "ddgst": ${ddgst:-false} 00:22:38.675 }, 00:22:38.675 "method": "bdev_nvme_attach_controller" 00:22:38.675 } 00:22:38.675 EOF 00:22:38.675 )") 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.675 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.675 { 00:22:38.675 "params": { 00:22:38.675 "name": "Nvme$subsystem", 00:22:38.675 "trtype": "$TEST_TRANSPORT", 00:22:38.675 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.675 "adrfam": "ipv4", 00:22:38.675 "trsvcid": "$NVMF_PORT", 00:22:38.675 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.675 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.675 "hdgst": ${hdgst:-false}, 00:22:38.675 "ddgst": ${ddgst:-false} 00:22:38.675 }, 00:22:38.675 "method": "bdev_nvme_attach_controller" 00:22:38.675 } 00:22:38.675 EOF 00:22:38.675 )") 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.675 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.675 { 00:22:38.675 "params": { 00:22:38.675 "name": "Nvme$subsystem", 00:22:38.675 "trtype": "$TEST_TRANSPORT", 00:22:38.675 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.675 "adrfam": "ipv4", 00:22:38.675 "trsvcid": "$NVMF_PORT", 00:22:38.675 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.675 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.675 "hdgst": ${hdgst:-false}, 00:22:38.675 "ddgst": ${ddgst:-false} 00:22:38.675 }, 00:22:38.675 "method": "bdev_nvme_attach_controller" 00:22:38.675 } 00:22:38.675 EOF 00:22:38.675 )") 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.675 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.675 { 00:22:38.675 "params": { 00:22:38.675 "name": "Nvme$subsystem", 00:22:38.675 "trtype": "$TEST_TRANSPORT", 00:22:38.675 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.675 "adrfam": "ipv4", 00:22:38.675 "trsvcid": "$NVMF_PORT", 00:22:38.675 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.675 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.675 "hdgst": ${hdgst:-false}, 00:22:38.675 "ddgst": ${ddgst:-false} 00:22:38.675 }, 00:22:38.675 "method": "bdev_nvme_attach_controller" 00:22:38.675 } 00:22:38.675 EOF 00:22:38.675 )") 00:22:38.675 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.935 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.935 { 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme$subsystem", 00:22:38.935 "trtype": "$TEST_TRANSPORT", 00:22:38.935 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "$NVMF_PORT", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.935 "hdgst": ${hdgst:-false}, 00:22:38.935 "ddgst": ${ddgst:-false} 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 } 00:22:38.935 EOF 00:22:38.935 )") 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.935 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.935 { 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme$subsystem", 00:22:38.935 "trtype": "$TEST_TRANSPORT", 00:22:38.935 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "$NVMF_PORT", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.935 "hdgst": ${hdgst:-false}, 00:22:38.935 "ddgst": ${ddgst:-false} 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 } 00:22:38.935 EOF 00:22:38.935 )") 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.935 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.935 { 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme$subsystem", 00:22:38.935 "trtype": "$TEST_TRANSPORT", 00:22:38.935 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "$NVMF_PORT", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.935 "hdgst": ${hdgst:-false}, 00:22:38.935 "ddgst": ${ddgst:-false} 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 } 00:22:38.935 EOF 00:22:38.935 )") 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.935 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.935 { 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme$subsystem", 00:22:38.935 "trtype": "$TEST_TRANSPORT", 00:22:38.935 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "$NVMF_PORT", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.935 "hdgst": ${hdgst:-false}, 00:22:38.935 "ddgst": ${ddgst:-false} 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 } 00:22:38.935 EOF 00:22:38.935 )") 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.935 01:15:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:38.935 { 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme$subsystem", 00:22:38.935 "trtype": "$TEST_TRANSPORT", 00:22:38.935 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "$NVMF_PORT", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.935 "hdgst": ${hdgst:-false}, 00:22:38.935 "ddgst": ${ddgst:-false} 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 } 00:22:38.935 EOF 00:22:38.935 )") 00:22:38.935 01:15:29 -- nvmf/common.sh@542 -- # cat 00:22:38.935 01:15:29 -- nvmf/common.sh@544 -- # jq . 00:22:38.935 01:15:29 -- nvmf/common.sh@545 -- # IFS=, 00:22:38.935 01:15:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme1", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme2", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme3", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme4", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme5", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme6", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme7", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme8", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme9", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 },{ 00:22:38.935 "params": { 00:22:38.935 "name": "Nvme10", 00:22:38.935 "trtype": "tcp", 00:22:38.935 "traddr": "10.0.0.2", 00:22:38.935 "adrfam": "ipv4", 00:22:38.935 "trsvcid": "4420", 00:22:38.935 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:38.935 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:38.935 "hdgst": false, 00:22:38.935 "ddgst": false 00:22:38.935 }, 00:22:38.935 "method": "bdev_nvme_attach_controller" 00:22:38.935 }' 00:22:38.935 [2024-11-26 01:15:29.226955] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:38.935 [2024-11-26 01:15:29.227048] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1115844 ] 00:22:38.935 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.935 [2024-11-26 01:15:29.289623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:38.935 [2024-11-26 01:15:29.397710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:40.951 Running I/O for 10 seconds... 00:22:41.210 01:15:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:41.210 01:15:31 -- common/autotest_common.sh@862 -- # return 0 00:22:41.210 01:15:31 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:41.210 01:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.210 01:15:31 -- common/autotest_common.sh@10 -- # set +x 00:22:41.210 01:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.210 01:15:31 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:41.210 01:15:31 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:41.210 01:15:31 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:41.210 01:15:31 -- target/shutdown.sh@57 -- # local ret=1 00:22:41.210 01:15:31 -- target/shutdown.sh@58 -- # local i 00:22:41.210 01:15:31 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:41.210 01:15:31 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:41.469 01:15:31 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:41.469 01:15:31 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:41.469 01:15:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:41.469 01:15:31 -- common/autotest_common.sh@10 -- # set +x 00:22:41.469 01:15:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:41.469 01:15:31 -- target/shutdown.sh@60 -- # read_io_count=131 00:22:41.469 01:15:31 -- target/shutdown.sh@63 -- # '[' 131 -ge 100 ']' 00:22:41.469 01:15:31 -- target/shutdown.sh@64 -- # ret=0 00:22:41.469 01:15:31 -- target/shutdown.sh@65 -- # break 00:22:41.469 01:15:31 -- target/shutdown.sh@69 -- # return 0 00:22:41.469 01:15:31 -- target/shutdown.sh@109 -- # killprocess 1115844 00:22:41.469 01:15:31 -- common/autotest_common.sh@936 -- # '[' -z 1115844 ']' 00:22:41.469 01:15:31 -- common/autotest_common.sh@940 -- # kill -0 1115844 00:22:41.469 01:15:31 -- common/autotest_common.sh@941 -- # uname 00:22:41.469 01:15:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:41.469 01:15:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1115844 00:22:41.469 01:15:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:41.469 01:15:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:41.469 01:15:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1115844' 00:22:41.469 killing process with pid 1115844 00:22:41.469 01:15:31 -- common/autotest_common.sh@955 -- # kill 1115844 00:22:41.469 01:15:31 -- common/autotest_common.sh@960 -- # wait 1115844 00:22:41.469 Received shutdown signal, test time was about 0.592117 seconds 00:22:41.469 00:22:41.469 Latency(us) 00:22:41.469 [2024-11-26T00:15:32.004Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:41.469 [2024-11-26T00:15:32.004Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.469 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme1n1 : 0.59 389.58 24.35 0.00 0.00 157974.90 24855.13 171655.77 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme2n1 : 0.57 400.58 25.04 0.00 0.00 151249.76 26408.58 122722.23 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme3n1 : 0.57 399.60 24.98 0.00 0.00 149564.31 26214.40 121168.78 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme4n1 : 0.57 397.11 24.82 0.00 0.00 148259.55 27379.48 118838.61 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme5n1 : 0.58 389.86 24.37 0.00 0.00 149592.41 25049.32 128159.29 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme6n1 : 0.58 394.97 24.69 0.00 0.00 144930.37 27379.48 118838.61 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme7n1 : 0.58 393.31 24.58 0.00 0.00 143594.95 25826.04 119615.34 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme8n1 : 0.58 391.44 24.46 0.00 0.00 142262.09 26796.94 122722.23 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme9n1 : 0.59 388.49 24.28 0.00 0.00 140927.95 19223.89 124275.67 00:22:41.470 [2024-11-26T00:15:32.005Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:41.470 Verification LBA range: start 0x0 length 0x400 00:22:41.470 Nvme10n1 : 0.59 387.61 24.23 0.00 0.00 140093.74 25631.86 123498.95 00:22:41.470 [2024-11-26T00:15:32.005Z] =================================================================================================================== 00:22:41.470 [2024-11-26T00:15:32.005Z] Total : 3932.56 245.78 0.00 0.00 146854.76 19223.89 171655.77 00:22:41.728 01:15:32 -- target/shutdown.sh@112 -- # sleep 1 00:22:42.667 01:15:33 -- target/shutdown.sh@113 -- # kill -0 1115575 00:22:42.667 01:15:33 -- target/shutdown.sh@115 -- # stoptarget 00:22:42.667 01:15:33 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:42.667 01:15:33 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:42.667 01:15:33 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:42.928 01:15:33 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:42.928 01:15:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:42.928 01:15:33 -- nvmf/common.sh@116 -- # sync 00:22:42.928 01:15:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:42.928 01:15:33 -- nvmf/common.sh@119 -- # set +e 00:22:42.928 01:15:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:42.928 01:15:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:42.928 rmmod nvme_tcp 00:22:42.928 rmmod nvme_fabrics 00:22:42.928 rmmod nvme_keyring 00:22:42.928 01:15:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:42.928 01:15:33 -- nvmf/common.sh@123 -- # set -e 00:22:42.928 01:15:33 -- nvmf/common.sh@124 -- # return 0 00:22:42.928 01:15:33 -- nvmf/common.sh@477 -- # '[' -n 1115575 ']' 00:22:42.928 01:15:33 -- nvmf/common.sh@478 -- # killprocess 1115575 00:22:42.928 01:15:33 -- common/autotest_common.sh@936 -- # '[' -z 1115575 ']' 00:22:42.928 01:15:33 -- common/autotest_common.sh@940 -- # kill -0 1115575 00:22:42.928 01:15:33 -- common/autotest_common.sh@941 -- # uname 00:22:42.928 01:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:42.928 01:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1115575 00:22:42.928 01:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:42.928 01:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:42.928 01:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1115575' 00:22:42.928 killing process with pid 1115575 00:22:42.928 01:15:33 -- common/autotest_common.sh@955 -- # kill 1115575 00:22:42.928 01:15:33 -- common/autotest_common.sh@960 -- # wait 1115575 00:22:43.495 01:15:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:43.495 01:15:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:43.495 01:15:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:43.495 01:15:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:43.495 01:15:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:43.495 01:15:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.495 01:15:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.495 01:15:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.401 01:15:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:45.401 00:22:45.401 real 0m8.503s 00:22:45.401 user 0m27.197s 00:22:45.401 sys 0m1.482s 00:22:45.401 01:15:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.401 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:22:45.401 ************************************ 00:22:45.401 END TEST nvmf_shutdown_tc2 00:22:45.401 ************************************ 00:22:45.401 01:15:35 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:45.401 01:15:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:45.401 01:15:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.401 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:22:45.401 ************************************ 00:22:45.401 START TEST nvmf_shutdown_tc3 00:22:45.401 ************************************ 00:22:45.401 01:15:35 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:45.401 01:15:35 -- target/shutdown.sh@120 -- # starttarget 00:22:45.401 01:15:35 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:45.401 01:15:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:45.402 01:15:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.402 01:15:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:45.402 01:15:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:45.402 01:15:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:45.402 01:15:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.402 01:15:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.402 01:15:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.402 01:15:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:45.402 01:15:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:45.402 01:15:35 -- common/autotest_common.sh@10 -- # set +x 00:22:45.402 01:15:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:45.402 01:15:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:45.402 01:15:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:45.402 01:15:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:45.402 01:15:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:45.402 01:15:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:45.402 01:15:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:45.402 01:15:35 -- nvmf/common.sh@294 -- # net_devs=() 00:22:45.402 01:15:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:45.402 01:15:35 -- nvmf/common.sh@295 -- # e810=() 00:22:45.402 01:15:35 -- nvmf/common.sh@295 -- # local -ga e810 00:22:45.402 01:15:35 -- nvmf/common.sh@296 -- # x722=() 00:22:45.402 01:15:35 -- nvmf/common.sh@296 -- # local -ga x722 00:22:45.402 01:15:35 -- nvmf/common.sh@297 -- # mlx=() 00:22:45.402 01:15:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:45.402 01:15:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:45.402 01:15:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:45.402 01:15:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:45.402 01:15:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:45.402 01:15:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:45.402 01:15:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:45.402 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:45.402 01:15:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:45.402 01:15:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:45.402 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:45.402 01:15:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:45.402 01:15:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:45.402 01:15:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:45.402 01:15:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:45.402 01:15:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:45.402 01:15:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:45.402 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:45.402 01:15:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:45.402 01:15:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:45.402 01:15:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:45.402 01:15:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:45.402 01:15:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:45.402 01:15:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:45.402 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:45.402 01:15:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:45.402 01:15:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:45.402 01:15:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:45.402 01:15:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:45.402 01:15:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:45.402 01:15:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:45.402 01:15:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:45.402 01:15:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:45.402 01:15:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:45.402 01:15:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:45.402 01:15:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:45.402 01:15:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:45.402 01:15:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:45.402 01:15:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:45.402 01:15:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:45.402 01:15:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:45.402 01:15:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:45.402 01:15:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:45.660 01:15:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:45.660 01:15:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:45.660 01:15:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:45.660 01:15:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:45.660 01:15:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:45.660 01:15:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:45.660 01:15:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:45.660 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:45.660 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:22:45.660 00:22:45.660 --- 10.0.0.2 ping statistics --- 00:22:45.660 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:45.660 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:22:45.660 01:15:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:45.660 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:45.660 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.210 ms 00:22:45.660 00:22:45.660 --- 10.0.0.1 ping statistics --- 00:22:45.660 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:45.660 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:22:45.660 01:15:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:45.660 01:15:36 -- nvmf/common.sh@410 -- # return 0 00:22:45.660 01:15:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:45.660 01:15:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:45.660 01:15:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:45.660 01:15:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:45.660 01:15:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:45.660 01:15:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:45.660 01:15:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:45.660 01:15:36 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:45.660 01:15:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:45.660 01:15:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:45.660 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:22:45.660 01:15:36 -- nvmf/common.sh@469 -- # nvmfpid=1116821 00:22:45.660 01:15:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:45.660 01:15:36 -- nvmf/common.sh@470 -- # waitforlisten 1116821 00:22:45.660 01:15:36 -- common/autotest_common.sh@829 -- # '[' -z 1116821 ']' 00:22:45.660 01:15:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:45.660 01:15:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:45.660 01:15:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:45.660 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:45.660 01:15:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:45.660 01:15:36 -- common/autotest_common.sh@10 -- # set +x 00:22:45.919 [2024-11-26 01:15:36.207476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:45.920 [2024-11-26 01:15:36.207552] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:45.920 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.920 [2024-11-26 01:15:36.283176] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:45.920 [2024-11-26 01:15:36.403973] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:45.920 [2024-11-26 01:15:36.404132] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:45.920 [2024-11-26 01:15:36.404149] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:45.920 [2024-11-26 01:15:36.404161] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:45.920 [2024-11-26 01:15:36.404285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:45.920 [2024-11-26 01:15:36.404400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:45.920 [2024-11-26 01:15:36.404462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:45.920 [2024-11-26 01:15:36.404465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:46.857 01:15:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.857 01:15:37 -- common/autotest_common.sh@862 -- # return 0 00:22:46.857 01:15:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:46.857 01:15:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:46.857 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.857 01:15:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:46.857 01:15:37 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:46.857 01:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.857 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.857 [2024-11-26 01:15:37.277414] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:46.857 01:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.857 01:15:37 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:46.857 01:15:37 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:46.858 01:15:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:46.858 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.858 01:15:37 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.858 01:15:37 -- target/shutdown.sh@28 -- # cat 00:22:46.858 01:15:37 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:46.858 01:15:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.858 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:22:46.858 Malloc1 00:22:46.858 [2024-11-26 01:15:37.352417] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:46.858 Malloc2 00:22:47.116 Malloc3 00:22:47.116 Malloc4 00:22:47.116 Malloc5 00:22:47.116 Malloc6 00:22:47.116 Malloc7 00:22:47.375 Malloc8 00:22:47.375 Malloc9 00:22:47.375 Malloc10 00:22:47.375 01:15:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.375 01:15:37 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:47.375 01:15:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:47.375 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:22:47.375 01:15:37 -- target/shutdown.sh@124 -- # perfpid=1117017 00:22:47.375 01:15:37 -- target/shutdown.sh@125 -- # waitforlisten 1117017 /var/tmp/bdevperf.sock 00:22:47.375 01:15:37 -- common/autotest_common.sh@829 -- # '[' -z 1117017 ']' 00:22:47.375 01:15:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:47.375 01:15:37 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:47.375 01:15:37 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:47.375 01:15:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:47.375 01:15:37 -- nvmf/common.sh@520 -- # config=() 00:22:47.375 01:15:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:47.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:47.375 01:15:37 -- nvmf/common.sh@520 -- # local subsystem config 00:22:47.375 01:15:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- common/autotest_common.sh@10 -- # set +x 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.375 01:15:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.375 01:15:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.375 { 00:22:47.375 "params": { 00:22:47.375 "name": "Nvme$subsystem", 00:22:47.375 "trtype": "$TEST_TRANSPORT", 00:22:47.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.375 "adrfam": "ipv4", 00:22:47.375 "trsvcid": "$NVMF_PORT", 00:22:47.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.375 "hdgst": ${hdgst:-false}, 00:22:47.375 "ddgst": ${ddgst:-false} 00:22:47.375 }, 00:22:47.375 "method": "bdev_nvme_attach_controller" 00:22:47.375 } 00:22:47.375 EOF 00:22:47.375 )") 00:22:47.376 01:15:37 -- nvmf/common.sh@542 -- # cat 00:22:47.376 01:15:37 -- nvmf/common.sh@544 -- # jq . 00:22:47.376 01:15:37 -- nvmf/common.sh@545 -- # IFS=, 00:22:47.376 01:15:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme1", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme2", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme3", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme4", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme5", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme6", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme7", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme8", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme9", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 },{ 00:22:47.376 "params": { 00:22:47.376 "name": "Nvme10", 00:22:47.376 "trtype": "tcp", 00:22:47.376 "traddr": "10.0.0.2", 00:22:47.376 "adrfam": "ipv4", 00:22:47.376 "trsvcid": "4420", 00:22:47.376 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:47.376 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:47.376 "hdgst": false, 00:22:47.376 "ddgst": false 00:22:47.376 }, 00:22:47.376 "method": "bdev_nvme_attach_controller" 00:22:47.376 }' 00:22:47.376 [2024-11-26 01:15:37.856790] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.376 [2024-11-26 01:15:37.856866] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1117017 ] 00:22:47.376 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.635 [2024-11-26 01:15:37.920003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:47.635 [2024-11-26 01:15:38.028279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:49.539 Running I/O for 10 seconds... 00:22:50.123 01:15:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:50.123 01:15:40 -- common/autotest_common.sh@862 -- # return 0 00:22:50.123 01:15:40 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:50.123 01:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.123 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:22:50.123 01:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.123 01:15:40 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:50.123 01:15:40 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:50.123 01:15:40 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:50.123 01:15:40 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:50.123 01:15:40 -- target/shutdown.sh@57 -- # local ret=1 00:22:50.123 01:15:40 -- target/shutdown.sh@58 -- # local i 00:22:50.123 01:15:40 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:50.123 01:15:40 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:50.123 01:15:40 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:50.123 01:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.123 01:15:40 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:50.123 01:15:40 -- common/autotest_common.sh@10 -- # set +x 00:22:50.123 01:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.123 01:15:40 -- target/shutdown.sh@60 -- # read_io_count=211 00:22:50.123 01:15:40 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:22:50.123 01:15:40 -- target/shutdown.sh@64 -- # ret=0 00:22:50.123 01:15:40 -- target/shutdown.sh@65 -- # break 00:22:50.123 01:15:40 -- target/shutdown.sh@69 -- # return 0 00:22:50.123 01:15:40 -- target/shutdown.sh@134 -- # killprocess 1116821 00:22:50.123 01:15:40 -- common/autotest_common.sh@936 -- # '[' -z 1116821 ']' 00:22:50.123 01:15:40 -- common/autotest_common.sh@940 -- # kill -0 1116821 00:22:50.123 01:15:40 -- common/autotest_common.sh@941 -- # uname 00:22:50.123 01:15:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:50.123 01:15:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1116821 00:22:50.123 01:15:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:50.123 01:15:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:50.123 01:15:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1116821' 00:22:50.123 killing process with pid 1116821 00:22:50.123 01:15:40 -- common/autotest_common.sh@955 -- # kill 1116821 00:22:50.123 01:15:40 -- common/autotest_common.sh@960 -- # wait 1116821 00:22:50.123 [2024-11-26 01:15:40.470249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.123 [2024-11-26 01:15:40.470621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.470993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.471209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb2e0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.472985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473111] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.124 [2024-11-26 01:15:40.473147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.473599] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aedcd0 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.125 [2024-11-26 01:15:40.475475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475648] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.475919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeb790 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.477990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.126 [2024-11-26 01:15:40.478164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.478528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aebc40 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.479365] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479422] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479450] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479489] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc25590 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.479620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479744] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479772] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbef1b0 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.479819] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479855] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479882] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479909] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.479923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.479935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd93600 is same with the state(5) to be set 00:22:50.127 [2024-11-26 01:15:40.479989] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.480009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.480025] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.480049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.480063] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.480076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.127 [2024-11-26 01:15:40.480090] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.127 [2024-11-26 01:15:40.480103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.480116] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbccf70 is same with the state(5) to be set 00:22:50.128 [2024-11-26 01:15:40.483964] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.128 [2024-11-26 01:15:40.484100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.484980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.484996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.485011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.485027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.128 [2024-11-26 01:15:40.485042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.128 [2024-11-26 01:15:40.485058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37632 len:12[2024-11-26 01:15:40.485491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 01:15:40.485505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.129 [2024-11-26 01:15:40.485603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.129 [2024-11-26 01:15:40.485617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.129 [2024-11-26 01:15:40.485628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38400 len:1[2024-11-26 01:15:40.485696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with [2024-11-26 01:15:40.485798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:38784 len:1the state(5) to be set 00:22:50.130 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with [2024-11-26 01:15:40.485862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39040 len:12the state(5) to be set 00:22:50.130 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with [2024-11-26 01:15:40.485926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39296 len:12the state(5) to be set 00:22:50.130 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485941] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.485953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.485984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.485989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.486008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.486019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.486032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.486044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.486056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.486081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.486093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.130 [2024-11-26 01:15:40.486106] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.130 [2024-11-26 01:15:40.486117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.130 [2024-11-26 01:15:40.486129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with [2024-11-26 01:15:40.486130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40064 len:12the state(5) to be set 00:22:50.130 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.131 [2024-11-26 01:15:40.486143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.131 [2024-11-26 01:15:40.486155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.131 [2024-11-26 01:15:40.486168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 01:15:40.486180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.131 the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe1d870 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec0d0 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.486274] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe1d870 was disconnected and freed. reset controller. 00:22:50.131 [2024-11-26 01:15:40.486368] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.131 [2024-11-26 01:15:40.486449] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.131 [2024-11-26 01:15:40.487720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.487993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488132] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488204] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488402] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.131 [2024-11-26 01:15:40.488650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:50.132 [2024-11-26 01:15:40.488753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbccf70 (9): Bad file descriptor 00:22:50.132 [2024-11-26 01:15:40.488805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488903] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.488970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec580 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc25590 (9): Bad file descriptor 00:22:50.132 [2024-11-26 01:15:40.490986] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.490999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with [2024-11-26 01:15:40.491079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsthe state(5) to be set 00:22:50.132 id:0 cdw10:00000000 cdw11:00000000 00:22:50.132 [2024-11-26 01:15:40.491100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 01:15:40.491112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.132 the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491133] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.132 [2024-11-26 01:15:40.491143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.132 [2024-11-26 01:15:40.491156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491165] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.132 [2024-11-26 01:15:40.491168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.132 [2024-11-26 01:15:40.491181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with [2024-11-26 01:15:40.491194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsthe state(5) to be set 00:22:50.132 id:0 cdw10:00000000 cdw11:00000000 00:22:50.132 [2024-11-26 01:15:40.491209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with [2024-11-26 01:15:40.491210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cthe state(5) to be set 00:22:50.132 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.132 [2024-11-26 01:15:40.491223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd83150 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.132 [2024-11-26 01:15:40.491249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbef1b0 (9): Bad file descriptor 00:22:50.133 [2024-11-26 01:15:40.491261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with [2024-11-26 01:15:40.491285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd93600 (9): Bthe state(5) to be set 00:22:50.133 ad file descriptor 00:22:50.133 [2024-11-26 01:15:40.491302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491347] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-26 01:15:40.491353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:50.133 the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.133 [2024-11-26 01:15:40.491380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491385] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.133 [2024-11-26 01:15:40.491392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.133 [2024-11-26 01:15:40.491404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491414] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.133 [2024-11-26 01:15:40.491417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 c[2024-11-26 01:15:40.491429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.133 the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with [2024-11-26 01:15:40.491444] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsthe state(5) to be set 00:22:50.133 id:0 cdw10:00000000 cdw11:00000000 00:22:50.133 [2024-11-26 01:15:40.491456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.133 [2024-11-26 01:15:40.491469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbf8690 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.491586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeca30 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.492024] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.133 [2024-11-26 01:15:40.493051] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.133 [2024-11-26 01:15:40.493599] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.133 [2024-11-26 01:15:40.495287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.133 [2024-11-26 01:15:40.495663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.495991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.496153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aecec0 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.134 [2024-11-26 01:15:40.497443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128[2024-11-26 01:15:40.497515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497529] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-26 01:15:40.497640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with [2024-11-26 01:15:40.497763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128the state(5) to be set 00:22:50.135 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with [2024-11-26 01:15:40.497828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30592 len:12the state(5) to be set 00:22:50.135 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with [2024-11-26 01:15:40.497867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:30720 len:12the state(5) to be set 00:22:50.135 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with [2024-11-26 01:15:40.497901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31488 len:12the state(5) to be set 00:22:50.135 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.135 [2024-11-26 01:15:40.497939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.135 [2024-11-26 01:15:40.497948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.135 [2024-11-26 01:15:40.497951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.497963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.497964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.497975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.497979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.497999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498022] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35584 len:1[2024-11-26 01:15:40.498034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed370 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.498759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:36864 len:1the state(5) to be set 00:22:50.136 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.498796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36992 len:12the state(5) to be set 00:22:50.136 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 [2024-11-26 01:15:40.498811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.498813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:50.136 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.136 [2024-11-26 01:15:40.498826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:37120 len:1[2024-11-26 01:15:40.498839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.136 the state(5) to be set 00:22:50.136 [2024-11-26 01:15:40.498853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.498853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:50.136 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.498867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.498880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.498894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.498908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.498921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.498934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37504 len:12the state(5) to be set 00:22:50.137 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.498948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.498950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:50.137 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.498963] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.498975] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.498988] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.498999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37760 len:1[2024-11-26 01:15:40.499001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.499030] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with [2024-11-26 01:15:40.499030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:50.137 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aed820 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.499052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.137 [2024-11-26 01:15:40.499613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.137 [2024-11-26 01:15:40.499629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe24b80 is same with the state(5) to be set 00:22:50.137 [2024-11-26 01:15:40.499740] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe24b80 was disconnected and freed. reset controller. 00:22:50.137 [2024-11-26 01:15:40.501244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:50.137 [2024-11-26 01:15:40.501309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd7da60 (9): Bad file descriptor 00:22:50.137 [2024-11-26 01:15:40.501357] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:22:50.137 [2024-11-26 01:15:40.501377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbccf70 is same with the state(5) to be set 00:22:50.138 [2024-11-26 01:15:40.501438] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501474] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501508] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501548] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc1a490 is same with the state(5) to be set 00:22:50.138 [2024-11-26 01:15:40.501635] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501670] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501714] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501741] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd6e0a0 is same with the state(5) to be set 00:22:50.138 [2024-11-26 01:15:40.501812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501883] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501911] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:50.138 [2024-11-26 01:15:40.501952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.501965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd82c70 is same with the state(5) to be set 00:22:50.138 [2024-11-26 01:15:40.501994] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd83150 (9): Bad file descriptor 00:22:50.138 [2024-11-26 01:15:40.502046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbf8690 (9): Bad file descriptor 00:22:50.138 [2024-11-26 01:15:40.502287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbccf70 (9): Bad file descriptor 00:22:50.138 [2024-11-26 01:15:40.502362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.138 [2024-11-26 01:15:40.502871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.138 [2024-11-26 01:15:40.502887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.502901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.502917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.502931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.502947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.502961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.502976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.502990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.139 [2024-11-26 01:15:40.503855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.139 [2024-11-26 01:15:40.503870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.503886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.503900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.503916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.503930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.503949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.503964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.503982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.503997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.504373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.504387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe1eb30 is same with the state(5) to be set 00:22:50.140 [2024-11-26 01:15:40.505637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.140 [2024-11-26 01:15:40.505959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.140 [2024-11-26 01:15:40.505975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.141 [2024-11-26 01:15:40.506972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.141 [2024-11-26 01:15:40.506987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.507716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.507731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe1ff20 is same with the state(5) to be set 00:22:50.142 [2024-11-26 01:15:40.509464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.142 [2024-11-26 01:15:40.509832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.142 [2024-11-26 01:15:40.509848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.509862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.509878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.509893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.509908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.509923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.509940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.509954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.509970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.509994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.143 [2024-11-26 01:15:40.510848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.143 [2024-11-26 01:15:40.510867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.510881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.510898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.510913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.510929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.510943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.510959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.510988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.144 [2024-11-26 01:15:40.511517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.144 [2024-11-26 01:15:40.511532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4ea20 is same with the state(5) to be set 00:22:50.144 [2024-11-26 01:15:40.513249] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:50.144 [2024-11-26 01:15:40.513284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:50.144 [2024-11-26 01:15:40.513304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:50.144 [2024-11-26 01:15:40.513551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.144 [2024-11-26 01:15:40.513684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.144 [2024-11-26 01:15:40.513719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd7da60 with addr=10.0.0.2, port=4420 00:22:50.144 [2024-11-26 01:15:40.513736] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7da60 is same with the state(5) to be set 00:22:50.144 [2024-11-26 01:15:40.513753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:50.144 [2024-11-26 01:15:40.513766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:50.144 [2024-11-26 01:15:40.513782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:50.144 [2024-11-26 01:15:40.513844] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:50.144 [2024-11-26 01:15:40.513882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc1a490 (9): Bad file descriptor 00:22:50.144 [2024-11-26 01:15:40.513917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd6e0a0 (9): Bad file descriptor 00:22:50.144 [2024-11-26 01:15:40.513947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd82c70 (9): Bad file descriptor 00:22:50.144 [2024-11-26 01:15:40.514007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd7da60 (9): Bad file descriptor 00:22:50.144 [2024-11-26 01:15:40.514172] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.144 [2024-11-26 01:15:40.514242] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:50.144 [2024-11-26 01:15:40.514297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.144 [2024-11-26 01:15:40.514425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.144 [2024-11-26 01:15:40.514577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.144 [2024-11-26 01:15:40.514602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd93600 with addr=10.0.0.2, port=4420 00:22:50.145 [2024-11-26 01:15:40.514619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd93600 is same with the state(5) to be set 00:22:50.145 [2024-11-26 01:15:40.514730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.145 [2024-11-26 01:15:40.514836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.145 [2024-11-26 01:15:40.514862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbef1b0 with addr=10.0.0.2, port=4420 00:22:50.145 [2024-11-26 01:15:40.514879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbef1b0 is same with the state(5) to be set 00:22:50.145 [2024-11-26 01:15:40.514979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.145 [2024-11-26 01:15:40.515087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.145 [2024-11-26 01:15:40.515112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc25590 with addr=10.0.0.2, port=4420 00:22:50.145 [2024-11-26 01:15:40.515134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc25590 is same with the state(5) to be set 00:22:50.145 [2024-11-26 01:15:40.515743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.515970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.515986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.145 [2024-11-26 01:15:40.516714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.145 [2024-11-26 01:15:40.516731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.516975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.516989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.517801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.517816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe213b0 is same with the state(5) to be set 00:22:50.146 [2024-11-26 01:15:40.519047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.519075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.519095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.519112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.519134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.519148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.519165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.146 [2024-11-26 01:15:40.519180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.146 [2024-11-26 01:15:40.519195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.519972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.519998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.147 [2024-11-26 01:15:40.520478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.147 [2024-11-26 01:15:40.520496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.520972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.520997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.521014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.521028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.521044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.521060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.521076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.521094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.521110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.521124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.521140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe22000 is same with the state(5) to be set 00:22:50.148 [2024-11-26 01:15:40.522714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:50.148 [2024-11-26 01:15:40.522747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:50.148 [2024-11-26 01:15:40.522806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd93600 (9): Bad file descriptor 00:22:50.148 [2024-11-26 01:15:40.522830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbef1b0 (9): Bad file descriptor 00:22:50.148 [2024-11-26 01:15:40.522849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc25590 (9): Bad file descriptor 00:22:50.148 [2024-11-26 01:15:40.522866] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:50.148 [2024-11-26 01:15:40.522880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:50.148 [2024-11-26 01:15:40.522896] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:50.148 [2024-11-26 01:15:40.523043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.148 [2024-11-26 01:15:40.523210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.148 [2024-11-26 01:15:40.523381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.148 [2024-11-26 01:15:40.523407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbf8690 with addr=10.0.0.2, port=4420 00:22:50.148 [2024-11-26 01:15:40.523425] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbf8690 is same with the state(5) to be set 00:22:50.148 [2024-11-26 01:15:40.523508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.148 [2024-11-26 01:15:40.523607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.148 [2024-11-26 01:15:40.523632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd83150 with addr=10.0.0.2, port=4420 00:22:50.148 [2024-11-26 01:15:40.523648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd83150 is same with the state(5) to be set 00:22:50.148 [2024-11-26 01:15:40.523664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:50.148 [2024-11-26 01:15:40.523677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:50.148 [2024-11-26 01:15:40.523709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:50.148 [2024-11-26 01:15:40.523731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:50.148 [2024-11-26 01:15:40.523747] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:50.148 [2024-11-26 01:15:40.523760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:50.148 [2024-11-26 01:15:40.523778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:50.148 [2024-11-26 01:15:40.523792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:50.148 [2024-11-26 01:15:40.523806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:50.148 [2024-11-26 01:15:40.524400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.148 [2024-11-26 01:15:40.524422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.148 [2024-11-26 01:15:40.524434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.148 [2024-11-26 01:15:40.524451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbf8690 (9): Bad file descriptor 00:22:50.148 [2024-11-26 01:15:40.524470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd83150 (9): Bad file descriptor 00:22:50.148 [2024-11-26 01:15:40.524609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:50.148 [2024-11-26 01:15:40.524632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:50.148 [2024-11-26 01:15:40.524646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:50.148 [2024-11-26 01:15:40.524663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:50.148 [2024-11-26 01:15:40.524677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:50.148 [2024-11-26 01:15:40.524700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:50.148 [2024-11-26 01:15:40.524773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.524797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.524825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.524842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.524860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.524874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.148 [2024-11-26 01:15:40.524890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.148 [2024-11-26 01:15:40.524905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.524921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.524935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.524953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.524978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.524995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.525978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.525992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.526027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.526058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.526101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.526133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.526162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.149 [2024-11-26 01:15:40.526202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.149 [2024-11-26 01:15:40.526218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.526890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.526908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe235a0 is same with the state(5) to be set 00:22:50.150 [2024-11-26 01:15:40.528172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.150 [2024-11-26 01:15:40.528625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.150 [2024-11-26 01:15:40.528640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.528964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.528981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.151 [2024-11-26 01:15:40.529920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.151 [2024-11-26 01:15:40.529937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.529951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.529968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.529987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.530275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.530290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4bf30 is same with the state(5) to be set 00:22:50.152 [2024-11-26 01:15:40.531514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.531969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.531996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:50.152 [2024-11-26 01:15:40.532207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:50.152 [2024-11-26 01:15:40.532222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd4d440 is same with the state(5) to be set 00:22:50.152 [2024-11-26 01:15:40.533636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:50.152 [2024-11-26 01:15:40.533668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:50.152 [2024-11-26 01:15:40.533696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:50.152 [2024-11-26 01:15:40.533723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:50.152 [2024-11-26 01:15:40.533742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:50.152 [2024-11-26 01:15:40.533760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.152 [2024-11-26 01:15:40.533774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.152 [2024-11-26 01:15:40.533935] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:50.152 [2024-11-26 01:15:40.533962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:50.152 task offset: 34816 on job bdev=Nvme1n1 fails 00:22:50.152 00:22:50.152 Latency(us) 00:22:50.152 [2024-11-26T00:15:40.687Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:50.152 [2024-11-26T00:15:40.687Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.152 [2024-11-26T00:15:40.687Z] Job: Nvme1n1 ended in about 0.75 seconds with error 00:22:50.152 Verification LBA range: start 0x0 length 0x400 00:22:50.152 Nvme1n1 : 0.75 333.48 20.84 85.03 0.00 151920.85 75730.49 122722.23 00:22:50.152 [2024-11-26T00:15:40.687Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.152 [2024-11-26T00:15:40.687Z] Job: Nvme2n1 ended in about 0.77 seconds with error 00:22:50.152 Verification LBA range: start 0x0 length 0x400 00:22:50.152 Nvme2n1 : 0.77 325.99 20.37 83.12 0.00 153879.92 84274.44 121168.78 00:22:50.152 [2024-11-26T00:15:40.688Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme3n1 ended in about 0.77 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme3n1 : 0.77 324.59 20.29 82.76 0.00 152993.46 79225.74 121168.78 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme4n1 ended in about 0.78 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme4n1 : 0.78 320.42 20.03 81.70 0.00 153506.35 81167.55 121945.51 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme5n1 ended in about 0.79 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme5n1 : 0.79 319.07 19.94 81.36 0.00 152653.19 74953.77 121168.78 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme6n1 ended in about 0.79 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme6n1 : 0.79 316.75 19.80 80.77 0.00 152312.91 70681.79 121168.78 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme7n1 ended in about 0.77 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme7n1 : 0.77 327.87 20.49 83.60 0.00 145344.59 33981.63 123498.95 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme8n1 ended in about 0.80 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme8n1 : 0.80 315.42 19.71 80.42 0.00 149958.08 51263.72 125052.40 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme9n1 ended in about 0.80 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme9n1 : 0.80 314.72 19.67 26.33 0.00 165817.86 41554.68 127382.57 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:50.153 [2024-11-26T00:15:40.688Z] Job: Nvme10n1 ended in about 0.78 seconds with error 00:22:50.153 Verification LBA range: start 0x0 length 0x400 00:22:50.153 Nvme10n1 : 0.78 270.24 16.89 82.36 0.00 164632.67 55535.69 135149.80 00:22:50.153 [2024-11-26T00:15:40.688Z] =================================================================================================================== 00:22:50.153 [2024-11-26T00:15:40.688Z] Total : 3168.57 198.04 767.46 0.00 154002.33 33981.63 135149.80 00:22:50.153 [2024-11-26 01:15:40.559633] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:50.153 [2024-11-26 01:15:40.559737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:50.153 [2024-11-26 01:15:40.560035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbccf70 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.560203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbccf70 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.560300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd7da60 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.560466] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7da60 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.560553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc25590 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.560706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc25590 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.560804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.560940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbef1b0 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.560957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbef1b0 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.561052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.561156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.561184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd93600 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.561200] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd93600 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.562116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:50.153 [2024-11-26 01:15:40.562148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:50.153 [2024-11-26 01:15:40.562291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.562392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.562419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd6e0a0 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.562437] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd6e0a0 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.562532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.562634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.562661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd82c70 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.562678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd82c70 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.562782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.562873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.562899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xc1a490 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.562916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc1a490 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.562941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbccf70 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.562963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd7da60 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.562981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc25590 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.562998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbef1b0 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.563016] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd93600 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.563085] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:50.153 [2024-11-26 01:15:40.563110] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:50.153 [2024-11-26 01:15:40.563129] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:50.153 [2024-11-26 01:15:40.563155] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:50.153 [2024-11-26 01:15:40.563175] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:50.153 [2024-11-26 01:15:40.563624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.563728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.563756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd83150 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.563773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd83150 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.563860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.563952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:50.153 [2024-11-26 01:15:40.563978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xbf8690 with addr=10.0.0.2, port=4420 00:22:50.153 [2024-11-26 01:15:40.563994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xbf8690 is same with the state(5) to be set 00:22:50.153 [2024-11-26 01:15:40.564024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd6e0a0 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.564044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd82c70 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.564062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc1a490 (9): Bad file descriptor 00:22:50.153 [2024-11-26 01:15:40.564078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:50.153 [2024-11-26 01:15:40.564093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:50.153 [2024-11-26 01:15:40.564108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:50.153 [2024-11-26 01:15:40.564129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:50.153 [2024-11-26 01:15:40.564144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:50.153 [2024-11-26 01:15:40.564164] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:50.153 [2024-11-26 01:15:40.564181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:50.153 [2024-11-26 01:15:40.564196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:50.153 [2024-11-26 01:15:40.564210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:50.153 [2024-11-26 01:15:40.564226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:50.153 [2024-11-26 01:15:40.564240] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:50.154 [2024-11-26 01:15:40.564283] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd83150 (9): Bad file descriptor 00:22:50.154 [2024-11-26 01:15:40.564484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xbf8690 (9): Bad file descriptor 00:22:50.154 [2024-11-26 01:15:40.564504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:50.154 [2024-11-26 01:15:40.564517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:50.154 [2024-11-26 01:15:40.564562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:50.154 [2024-11-26 01:15:40.564605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:50.154 [2024-11-26 01:15:40.564744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:50.154 [2024-11-26 01:15:40.564795] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:50.154 [2024-11-26 01:15:40.564809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:50.154 [2024-11-26 01:15:40.564845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.154 [2024-11-26 01:15:40.564863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:50.721 01:15:41 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:50.721 01:15:41 -- target/shutdown.sh@138 -- # sleep 1 00:22:51.661 01:15:42 -- target/shutdown.sh@141 -- # kill -9 1117017 00:22:51.661 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (1117017) - No such process 00:22:51.661 01:15:42 -- target/shutdown.sh@141 -- # true 00:22:51.661 01:15:42 -- target/shutdown.sh@143 -- # stoptarget 00:22:51.661 01:15:42 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:51.661 01:15:42 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:51.661 01:15:42 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:51.661 01:15:42 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:51.661 01:15:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:51.661 01:15:42 -- nvmf/common.sh@116 -- # sync 00:22:51.661 01:15:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:51.661 01:15:42 -- nvmf/common.sh@119 -- # set +e 00:22:51.661 01:15:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:51.661 01:15:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:51.661 rmmod nvme_tcp 00:22:51.661 rmmod nvme_fabrics 00:22:51.661 rmmod nvme_keyring 00:22:51.661 01:15:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:51.661 01:15:42 -- nvmf/common.sh@123 -- # set -e 00:22:51.661 01:15:42 -- nvmf/common.sh@124 -- # return 0 00:22:51.661 01:15:42 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:51.661 01:15:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:51.661 01:15:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:51.661 01:15:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:51.661 01:15:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:51.661 01:15:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:51.661 01:15:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.661 01:15:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.661 01:15:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:54.199 01:15:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:54.199 00:22:54.199 real 0m8.244s 00:22:54.199 user 0m21.492s 00:22:54.199 sys 0m1.500s 00:22:54.199 01:15:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:54.199 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:22:54.199 ************************************ 00:22:54.199 END TEST nvmf_shutdown_tc3 00:22:54.199 ************************************ 00:22:54.199 01:15:44 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:22:54.199 00:22:54.199 real 0m28.909s 00:22:54.199 user 1m23.485s 00:22:54.199 sys 0m6.335s 00:22:54.199 01:15:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:54.199 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:22:54.199 ************************************ 00:22:54.199 END TEST nvmf_shutdown 00:22:54.199 ************************************ 00:22:54.199 01:15:44 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:22:54.199 01:15:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:54.199 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:22:54.199 01:15:44 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:22:54.199 01:15:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:54.199 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:22:54.199 01:15:44 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:22:54.199 01:15:44 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:54.199 01:15:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:54.199 01:15:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:54.199 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:22:54.199 ************************************ 00:22:54.199 START TEST nvmf_multicontroller 00:22:54.199 ************************************ 00:22:54.199 01:15:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:22:54.199 * Looking for test storage... 00:22:54.199 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:22:54.199 01:15:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:54.199 01:15:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:54.199 01:15:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:54.199 01:15:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:54.199 01:15:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:54.199 01:15:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:54.199 01:15:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:54.199 01:15:44 -- scripts/common.sh@335 -- # IFS=.-: 00:22:54.199 01:15:44 -- scripts/common.sh@335 -- # read -ra ver1 00:22:54.199 01:15:44 -- scripts/common.sh@336 -- # IFS=.-: 00:22:54.199 01:15:44 -- scripts/common.sh@336 -- # read -ra ver2 00:22:54.199 01:15:44 -- scripts/common.sh@337 -- # local 'op=<' 00:22:54.199 01:15:44 -- scripts/common.sh@339 -- # ver1_l=2 00:22:54.199 01:15:44 -- scripts/common.sh@340 -- # ver2_l=1 00:22:54.199 01:15:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:54.199 01:15:44 -- scripts/common.sh@343 -- # case "$op" in 00:22:54.199 01:15:44 -- scripts/common.sh@344 -- # : 1 00:22:54.199 01:15:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:54.199 01:15:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:54.199 01:15:44 -- scripts/common.sh@364 -- # decimal 1 00:22:54.199 01:15:44 -- scripts/common.sh@352 -- # local d=1 00:22:54.199 01:15:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:54.199 01:15:44 -- scripts/common.sh@354 -- # echo 1 00:22:54.199 01:15:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:54.199 01:15:44 -- scripts/common.sh@365 -- # decimal 2 00:22:54.199 01:15:44 -- scripts/common.sh@352 -- # local d=2 00:22:54.199 01:15:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:54.199 01:15:44 -- scripts/common.sh@354 -- # echo 2 00:22:54.199 01:15:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:54.199 01:15:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:54.199 01:15:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:54.199 01:15:44 -- scripts/common.sh@367 -- # return 0 00:22:54.199 01:15:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:54.199 01:15:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:54.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.200 --rc genhtml_branch_coverage=1 00:22:54.200 --rc genhtml_function_coverage=1 00:22:54.200 --rc genhtml_legend=1 00:22:54.200 --rc geninfo_all_blocks=1 00:22:54.200 --rc geninfo_unexecuted_blocks=1 00:22:54.200 00:22:54.200 ' 00:22:54.200 01:15:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:54.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.200 --rc genhtml_branch_coverage=1 00:22:54.200 --rc genhtml_function_coverage=1 00:22:54.200 --rc genhtml_legend=1 00:22:54.200 --rc geninfo_all_blocks=1 00:22:54.200 --rc geninfo_unexecuted_blocks=1 00:22:54.200 00:22:54.200 ' 00:22:54.200 01:15:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:54.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.200 --rc genhtml_branch_coverage=1 00:22:54.200 --rc genhtml_function_coverage=1 00:22:54.200 --rc genhtml_legend=1 00:22:54.200 --rc geninfo_all_blocks=1 00:22:54.200 --rc geninfo_unexecuted_blocks=1 00:22:54.200 00:22:54.200 ' 00:22:54.200 01:15:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:54.200 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:54.200 --rc genhtml_branch_coverage=1 00:22:54.200 --rc genhtml_function_coverage=1 00:22:54.200 --rc genhtml_legend=1 00:22:54.200 --rc geninfo_all_blocks=1 00:22:54.200 --rc geninfo_unexecuted_blocks=1 00:22:54.200 00:22:54.200 ' 00:22:54.200 01:15:44 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:54.200 01:15:44 -- nvmf/common.sh@7 -- # uname -s 00:22:54.200 01:15:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:54.200 01:15:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:54.200 01:15:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:54.200 01:15:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:54.200 01:15:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:54.200 01:15:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:54.200 01:15:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:54.200 01:15:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:54.200 01:15:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:54.200 01:15:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:54.200 01:15:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:54.200 01:15:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:54.200 01:15:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:54.200 01:15:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:54.200 01:15:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:54.200 01:15:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:54.200 01:15:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:54.200 01:15:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:54.200 01:15:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:54.200 01:15:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.200 01:15:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.200 01:15:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.200 01:15:44 -- paths/export.sh@5 -- # export PATH 00:22:54.200 01:15:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:54.200 01:15:44 -- nvmf/common.sh@46 -- # : 0 00:22:54.200 01:15:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:54.200 01:15:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:54.200 01:15:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:54.200 01:15:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:54.200 01:15:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:54.200 01:15:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:54.200 01:15:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:54.200 01:15:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:54.200 01:15:44 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:54.200 01:15:44 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:54.200 01:15:44 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:22:54.200 01:15:44 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:22:54.200 01:15:44 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:22:54.200 01:15:44 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:22:54.200 01:15:44 -- host/multicontroller.sh@23 -- # nvmftestinit 00:22:54.200 01:15:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:54.200 01:15:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:54.200 01:15:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:54.200 01:15:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:54.200 01:15:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:54.200 01:15:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:54.200 01:15:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:54.200 01:15:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:54.200 01:15:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:54.200 01:15:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:54.200 01:15:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:54.200 01:15:44 -- common/autotest_common.sh@10 -- # set +x 00:22:56.109 01:15:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:56.109 01:15:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:56.109 01:15:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:56.109 01:15:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:56.109 01:15:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:56.109 01:15:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:56.109 01:15:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:56.109 01:15:46 -- nvmf/common.sh@294 -- # net_devs=() 00:22:56.109 01:15:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:56.109 01:15:46 -- nvmf/common.sh@295 -- # e810=() 00:22:56.109 01:15:46 -- nvmf/common.sh@295 -- # local -ga e810 00:22:56.109 01:15:46 -- nvmf/common.sh@296 -- # x722=() 00:22:56.109 01:15:46 -- nvmf/common.sh@296 -- # local -ga x722 00:22:56.109 01:15:46 -- nvmf/common.sh@297 -- # mlx=() 00:22:56.109 01:15:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:56.109 01:15:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:56.109 01:15:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:56.109 01:15:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:56.109 01:15:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:56.109 01:15:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.109 01:15:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:56.109 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:56.109 01:15:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:56.109 01:15:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:56.109 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:56.109 01:15:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:56.109 01:15:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:56.109 01:15:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.109 01:15:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.109 01:15:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.109 01:15:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.109 01:15:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:56.109 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:56.109 01:15:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.109 01:15:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:56.109 01:15:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:56.109 01:15:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:56.109 01:15:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:56.109 01:15:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:56.109 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:56.110 01:15:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:56.110 01:15:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:56.110 01:15:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:56.110 01:15:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:56.110 01:15:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:56.110 01:15:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:56.110 01:15:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:56.110 01:15:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:56.110 01:15:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:56.110 01:15:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:56.110 01:15:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:56.110 01:15:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:56.110 01:15:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:56.110 01:15:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:56.110 01:15:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:56.110 01:15:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:56.110 01:15:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:56.110 01:15:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:56.110 01:15:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:56.110 01:15:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:56.110 01:15:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:56.110 01:15:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:56.110 01:15:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:56.110 01:15:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:56.110 01:15:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:56.110 01:15:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:56.110 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:56.110 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.332 ms 00:22:56.110 00:22:56.110 --- 10.0.0.2 ping statistics --- 00:22:56.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.110 rtt min/avg/max/mdev = 0.332/0.332/0.332/0.000 ms 00:22:56.110 01:15:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:56.110 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:56.110 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:22:56.110 00:22:56.110 --- 10.0.0.1 ping statistics --- 00:22:56.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:56.110 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:22:56.110 01:15:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:56.110 01:15:46 -- nvmf/common.sh@410 -- # return 0 00:22:56.110 01:15:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:56.110 01:15:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:56.110 01:15:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:56.110 01:15:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:56.110 01:15:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:56.110 01:15:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:56.110 01:15:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:56.110 01:15:46 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:22:56.110 01:15:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:56.110 01:15:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:56.110 01:15:46 -- common/autotest_common.sh@10 -- # set +x 00:22:56.110 01:15:46 -- nvmf/common.sh@469 -- # nvmfpid=1119572 00:22:56.110 01:15:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:56.110 01:15:46 -- nvmf/common.sh@470 -- # waitforlisten 1119572 00:22:56.110 01:15:46 -- common/autotest_common.sh@829 -- # '[' -z 1119572 ']' 00:22:56.110 01:15:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:56.110 01:15:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:56.110 01:15:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:56.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:56.110 01:15:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:56.110 01:15:46 -- common/autotest_common.sh@10 -- # set +x 00:22:56.110 [2024-11-26 01:15:46.608496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:56.110 [2024-11-26 01:15:46.608582] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:56.371 EAL: No free 2048 kB hugepages reported on node 1 00:22:56.371 [2024-11-26 01:15:46.681283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:56.371 [2024-11-26 01:15:46.799695] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:56.371 [2024-11-26 01:15:46.799883] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:56.371 [2024-11-26 01:15:46.799903] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:56.371 [2024-11-26 01:15:46.799918] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:56.371 [2024-11-26 01:15:46.799995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:56.371 [2024-11-26 01:15:46.800121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:56.371 [2024-11-26 01:15:46.800125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:57.308 01:15:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:57.308 01:15:47 -- common/autotest_common.sh@862 -- # return 0 00:22:57.308 01:15:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:57.308 01:15:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:57.308 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.308 01:15:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:57.308 01:15:47 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 [2024-11-26 01:15:47.639171] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 Malloc0 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 [2024-11-26 01:15:47.708001] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 [2024-11-26 01:15:47.715819] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 Malloc1 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:22:57.309 01:15:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:57.309 01:15:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.309 01:15:47 -- host/multicontroller.sh@44 -- # bdevperf_pid=1119730 00:22:57.309 01:15:47 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:57.309 01:15:47 -- host/multicontroller.sh@47 -- # waitforlisten 1119730 /var/tmp/bdevperf.sock 00:22:57.309 01:15:47 -- common/autotest_common.sh@829 -- # '[' -z 1119730 ']' 00:22:57.309 01:15:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:57.309 01:15:47 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:22:57.309 01:15:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:57.309 01:15:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:57.309 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:57.309 01:15:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:57.309 01:15:47 -- common/autotest_common.sh@10 -- # set +x 00:22:58.687 01:15:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:58.687 01:15:48 -- common/autotest_common.sh@862 -- # return 0 00:22:58.687 01:15:48 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:58.687 01:15:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.687 01:15:48 -- common/autotest_common.sh@10 -- # set +x 00:22:58.687 NVMe0n1 00:22:58.687 01:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.687 01:15:49 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:58.687 01:15:49 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:22:58.687 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.687 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.687 01:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.687 1 00:22:58.687 01:15:49 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:58.687 01:15:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:58.687 01:15:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:58.687 01:15:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:58.687 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.687 01:15:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:58.687 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.687 01:15:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:22:58.687 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.687 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.687 request: 00:22:58.687 { 00:22:58.687 "name": "NVMe0", 00:22:58.687 "trtype": "tcp", 00:22:58.687 "traddr": "10.0.0.2", 00:22:58.687 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:22:58.687 "hostaddr": "10.0.0.2", 00:22:58.687 "hostsvcid": "60000", 00:22:58.687 "adrfam": "ipv4", 00:22:58.688 "trsvcid": "4420", 00:22:58.688 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.688 "method": "bdev_nvme_attach_controller", 00:22:58.688 "req_id": 1 00:22:58.688 } 00:22:58.688 Got JSON-RPC error response 00:22:58.688 response: 00:22:58.688 { 00:22:58.688 "code": -114, 00:22:58.688 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:58.688 } 00:22:58.688 01:15:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # es=1 00:22:58.688 01:15:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:58.688 01:15:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:58.688 01:15:49 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:58.688 01:15:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:58.688 01:15:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:58.688 01:15:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:22:58.688 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.688 request: 00:22:58.688 { 00:22:58.688 "name": "NVMe0", 00:22:58.688 "trtype": "tcp", 00:22:58.688 "traddr": "10.0.0.2", 00:22:58.688 "hostaddr": "10.0.0.2", 00:22:58.688 "hostsvcid": "60000", 00:22:58.688 "adrfam": "ipv4", 00:22:58.688 "trsvcid": "4420", 00:22:58.688 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:58.688 "method": "bdev_nvme_attach_controller", 00:22:58.688 "req_id": 1 00:22:58.688 } 00:22:58.688 Got JSON-RPC error response 00:22:58.688 response: 00:22:58.688 { 00:22:58.688 "code": -114, 00:22:58.688 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:58.688 } 00:22:58.688 01:15:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # es=1 00:22:58.688 01:15:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:58.688 01:15:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:58.688 01:15:49 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:58.688 01:15:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.688 request: 00:22:58.688 { 00:22:58.688 "name": "NVMe0", 00:22:58.688 "trtype": "tcp", 00:22:58.688 "traddr": "10.0.0.2", 00:22:58.688 "hostaddr": "10.0.0.2", 00:22:58.688 "hostsvcid": "60000", 00:22:58.688 "adrfam": "ipv4", 00:22:58.688 "trsvcid": "4420", 00:22:58.688 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.688 "multipath": "disable", 00:22:58.688 "method": "bdev_nvme_attach_controller", 00:22:58.688 "req_id": 1 00:22:58.688 } 00:22:58.688 Got JSON-RPC error response 00:22:58.688 response: 00:22:58.688 { 00:22:58.688 "code": -114, 00:22:58.688 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:22:58.688 } 00:22:58.688 01:15:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # es=1 00:22:58.688 01:15:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:58.688 01:15:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:58.688 01:15:49 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:58.688 01:15:49 -- common/autotest_common.sh@650 -- # local es=0 00:22:58.688 01:15:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:58.688 01:15:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:22:58.688 01:15:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:22:58.688 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.688 request: 00:22:58.688 { 00:22:58.688 "name": "NVMe0", 00:22:58.688 "trtype": "tcp", 00:22:58.688 "traddr": "10.0.0.2", 00:22:58.688 "hostaddr": "10.0.0.2", 00:22:58.688 "hostsvcid": "60000", 00:22:58.688 "adrfam": "ipv4", 00:22:58.688 "trsvcid": "4420", 00:22:58.688 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:58.688 "multipath": "failover", 00:22:58.688 "method": "bdev_nvme_attach_controller", 00:22:58.688 "req_id": 1 00:22:58.688 } 00:22:58.688 Got JSON-RPC error response 00:22:58.688 response: 00:22:58.688 { 00:22:58.688 "code": -114, 00:22:58.688 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:22:58.688 } 00:22:58.688 01:15:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@653 -- # es=1 00:22:58.688 01:15:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:22:58.688 01:15:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:22:58.688 01:15:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:22:58.688 01:15:49 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:58.688 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.688 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.946 00:22:58.946 01:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.946 01:15:49 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:22:58.946 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.946 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.946 01:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.946 01:15:49 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:22:58.946 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.946 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.946 00:22:58.946 01:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.946 01:15:49 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:22:58.946 01:15:49 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:22:58.946 01:15:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.946 01:15:49 -- common/autotest_common.sh@10 -- # set +x 00:22:58.946 01:15:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.946 01:15:49 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:22:58.946 01:15:49 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:00.325 0 00:23:00.325 01:15:50 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:00.325 01:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.325 01:15:50 -- common/autotest_common.sh@10 -- # set +x 00:23:00.325 01:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.325 01:15:50 -- host/multicontroller.sh@100 -- # killprocess 1119730 00:23:00.325 01:15:50 -- common/autotest_common.sh@936 -- # '[' -z 1119730 ']' 00:23:00.325 01:15:50 -- common/autotest_common.sh@940 -- # kill -0 1119730 00:23:00.325 01:15:50 -- common/autotest_common.sh@941 -- # uname 00:23:00.325 01:15:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:00.325 01:15:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1119730 00:23:00.325 01:15:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:00.325 01:15:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:00.325 01:15:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1119730' 00:23:00.325 killing process with pid 1119730 00:23:00.325 01:15:50 -- common/autotest_common.sh@955 -- # kill 1119730 00:23:00.325 01:15:50 -- common/autotest_common.sh@960 -- # wait 1119730 00:23:00.325 01:15:50 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:00.325 01:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.325 01:15:50 -- common/autotest_common.sh@10 -- # set +x 00:23:00.583 01:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.583 01:15:50 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:00.583 01:15:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:00.583 01:15:50 -- common/autotest_common.sh@10 -- # set +x 00:23:00.583 01:15:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:00.583 01:15:50 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:00.583 01:15:50 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:00.583 01:15:50 -- common/autotest_common.sh@1607 -- # read -r file 00:23:00.583 01:15:50 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:00.583 01:15:50 -- common/autotest_common.sh@1606 -- # sort -u 00:23:00.583 01:15:50 -- common/autotest_common.sh@1608 -- # cat 00:23:00.583 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:00.583 [2024-11-26 01:15:47.817216] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:00.583 [2024-11-26 01:15:47.817309] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1119730 ] 00:23:00.583 EAL: No free 2048 kB hugepages reported on node 1 00:23:00.583 [2024-11-26 01:15:47.877747] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:00.583 [2024-11-26 01:15:47.987998] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:00.583 [2024-11-26 01:15:49.389732] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 07c6d3e3-c258-4ccb-aab9-253da2dcb087 already exists 00:23:00.583 [2024-11-26 01:15:49.389773] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:07c6d3e3-c258-4ccb-aab9-253da2dcb087 alias for bdev NVMe1n1 00:23:00.583 [2024-11-26 01:15:49.389800] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:00.583 Running I/O for 1 seconds... 00:23:00.583 00:23:00.583 Latency(us) 00:23:00.583 [2024-11-26T00:15:51.118Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:00.583 [2024-11-26T00:15:51.118Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:00.583 NVMe0n1 : 1.01 19308.58 75.42 0.00 0.00 6619.92 2864.17 11796.48 00:23:00.583 [2024-11-26T00:15:51.118Z] =================================================================================================================== 00:23:00.583 [2024-11-26T00:15:51.118Z] Total : 19308.58 75.42 0.00 0.00 6619.92 2864.17 11796.48 00:23:00.583 Received shutdown signal, test time was about 1.000000 seconds 00:23:00.583 00:23:00.583 Latency(us) 00:23:00.583 [2024-11-26T00:15:51.118Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:00.583 [2024-11-26T00:15:51.118Z] =================================================================================================================== 00:23:00.583 [2024-11-26T00:15:51.118Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:00.583 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:00.583 01:15:50 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:00.583 01:15:50 -- common/autotest_common.sh@1607 -- # read -r file 00:23:00.583 01:15:50 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:00.583 01:15:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:00.583 01:15:50 -- nvmf/common.sh@116 -- # sync 00:23:00.583 01:15:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:00.583 01:15:50 -- nvmf/common.sh@119 -- # set +e 00:23:00.583 01:15:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:00.583 01:15:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:00.583 rmmod nvme_tcp 00:23:00.583 rmmod nvme_fabrics 00:23:00.583 rmmod nvme_keyring 00:23:00.583 01:15:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:00.583 01:15:50 -- nvmf/common.sh@123 -- # set -e 00:23:00.583 01:15:50 -- nvmf/common.sh@124 -- # return 0 00:23:00.583 01:15:50 -- nvmf/common.sh@477 -- # '[' -n 1119572 ']' 00:23:00.583 01:15:50 -- nvmf/common.sh@478 -- # killprocess 1119572 00:23:00.583 01:15:50 -- common/autotest_common.sh@936 -- # '[' -z 1119572 ']' 00:23:00.583 01:15:50 -- common/autotest_common.sh@940 -- # kill -0 1119572 00:23:00.583 01:15:50 -- common/autotest_common.sh@941 -- # uname 00:23:00.583 01:15:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:00.583 01:15:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1119572 00:23:00.583 01:15:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:00.583 01:15:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:00.583 01:15:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1119572' 00:23:00.583 killing process with pid 1119572 00:23:00.583 01:15:50 -- common/autotest_common.sh@955 -- # kill 1119572 00:23:00.583 01:15:50 -- common/autotest_common.sh@960 -- # wait 1119572 00:23:00.841 01:15:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:00.841 01:15:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:00.841 01:15:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:00.841 01:15:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:00.841 01:15:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:00.841 01:15:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:00.841 01:15:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:00.841 01:15:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:03.380 01:15:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:03.380 00:23:03.380 real 0m9.101s 00:23:03.380 user 0m17.665s 00:23:03.380 sys 0m2.433s 00:23:03.380 01:15:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:03.380 01:15:53 -- common/autotest_common.sh@10 -- # set +x 00:23:03.380 ************************************ 00:23:03.380 END TEST nvmf_multicontroller 00:23:03.380 ************************************ 00:23:03.380 01:15:53 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:03.380 01:15:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:03.380 01:15:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:03.380 01:15:53 -- common/autotest_common.sh@10 -- # set +x 00:23:03.380 ************************************ 00:23:03.380 START TEST nvmf_aer 00:23:03.380 ************************************ 00:23:03.380 01:15:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:03.380 * Looking for test storage... 00:23:03.380 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:03.380 01:15:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:03.380 01:15:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:03.380 01:15:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:03.380 01:15:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:03.380 01:15:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:03.380 01:15:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:03.380 01:15:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:03.380 01:15:53 -- scripts/common.sh@335 -- # IFS=.-: 00:23:03.380 01:15:53 -- scripts/common.sh@335 -- # read -ra ver1 00:23:03.380 01:15:53 -- scripts/common.sh@336 -- # IFS=.-: 00:23:03.380 01:15:53 -- scripts/common.sh@336 -- # read -ra ver2 00:23:03.380 01:15:53 -- scripts/common.sh@337 -- # local 'op=<' 00:23:03.380 01:15:53 -- scripts/common.sh@339 -- # ver1_l=2 00:23:03.380 01:15:53 -- scripts/common.sh@340 -- # ver2_l=1 00:23:03.380 01:15:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:03.380 01:15:53 -- scripts/common.sh@343 -- # case "$op" in 00:23:03.380 01:15:53 -- scripts/common.sh@344 -- # : 1 00:23:03.380 01:15:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:03.380 01:15:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:03.380 01:15:53 -- scripts/common.sh@364 -- # decimal 1 00:23:03.380 01:15:53 -- scripts/common.sh@352 -- # local d=1 00:23:03.380 01:15:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:03.380 01:15:53 -- scripts/common.sh@354 -- # echo 1 00:23:03.380 01:15:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:03.380 01:15:53 -- scripts/common.sh@365 -- # decimal 2 00:23:03.380 01:15:53 -- scripts/common.sh@352 -- # local d=2 00:23:03.380 01:15:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:03.380 01:15:53 -- scripts/common.sh@354 -- # echo 2 00:23:03.380 01:15:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:03.380 01:15:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:03.380 01:15:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:03.380 01:15:53 -- scripts/common.sh@367 -- # return 0 00:23:03.380 01:15:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:03.380 01:15:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:03.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.380 --rc genhtml_branch_coverage=1 00:23:03.380 --rc genhtml_function_coverage=1 00:23:03.380 --rc genhtml_legend=1 00:23:03.380 --rc geninfo_all_blocks=1 00:23:03.380 --rc geninfo_unexecuted_blocks=1 00:23:03.380 00:23:03.380 ' 00:23:03.380 01:15:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:03.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.380 --rc genhtml_branch_coverage=1 00:23:03.380 --rc genhtml_function_coverage=1 00:23:03.380 --rc genhtml_legend=1 00:23:03.380 --rc geninfo_all_blocks=1 00:23:03.380 --rc geninfo_unexecuted_blocks=1 00:23:03.380 00:23:03.380 ' 00:23:03.380 01:15:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:03.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.380 --rc genhtml_branch_coverage=1 00:23:03.380 --rc genhtml_function_coverage=1 00:23:03.380 --rc genhtml_legend=1 00:23:03.380 --rc geninfo_all_blocks=1 00:23:03.380 --rc geninfo_unexecuted_blocks=1 00:23:03.380 00:23:03.380 ' 00:23:03.380 01:15:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:03.380 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:03.380 --rc genhtml_branch_coverage=1 00:23:03.380 --rc genhtml_function_coverage=1 00:23:03.380 --rc genhtml_legend=1 00:23:03.380 --rc geninfo_all_blocks=1 00:23:03.380 --rc geninfo_unexecuted_blocks=1 00:23:03.380 00:23:03.380 ' 00:23:03.380 01:15:53 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:03.380 01:15:53 -- nvmf/common.sh@7 -- # uname -s 00:23:03.380 01:15:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:03.380 01:15:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:03.380 01:15:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:03.380 01:15:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:03.380 01:15:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:03.380 01:15:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:03.380 01:15:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:03.380 01:15:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:03.380 01:15:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:03.380 01:15:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:03.380 01:15:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:03.380 01:15:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:03.380 01:15:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:03.380 01:15:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:03.380 01:15:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:03.380 01:15:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:03.380 01:15:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:03.380 01:15:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:03.380 01:15:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:03.380 01:15:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.381 01:15:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.381 01:15:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.381 01:15:53 -- paths/export.sh@5 -- # export PATH 00:23:03.381 01:15:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:03.381 01:15:53 -- nvmf/common.sh@46 -- # : 0 00:23:03.381 01:15:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:03.381 01:15:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:03.381 01:15:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:03.381 01:15:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:03.381 01:15:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:03.381 01:15:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:03.381 01:15:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:03.381 01:15:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:03.381 01:15:53 -- host/aer.sh@11 -- # nvmftestinit 00:23:03.381 01:15:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:03.381 01:15:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:03.381 01:15:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:03.381 01:15:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:03.381 01:15:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:03.381 01:15:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:03.381 01:15:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:03.381 01:15:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:03.381 01:15:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:03.381 01:15:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:03.381 01:15:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:03.381 01:15:53 -- common/autotest_common.sh@10 -- # set +x 00:23:05.285 01:15:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:05.285 01:15:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:05.285 01:15:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:05.285 01:15:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:05.285 01:15:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:05.285 01:15:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:05.285 01:15:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:05.285 01:15:55 -- nvmf/common.sh@294 -- # net_devs=() 00:23:05.285 01:15:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:05.285 01:15:55 -- nvmf/common.sh@295 -- # e810=() 00:23:05.285 01:15:55 -- nvmf/common.sh@295 -- # local -ga e810 00:23:05.285 01:15:55 -- nvmf/common.sh@296 -- # x722=() 00:23:05.285 01:15:55 -- nvmf/common.sh@296 -- # local -ga x722 00:23:05.285 01:15:55 -- nvmf/common.sh@297 -- # mlx=() 00:23:05.285 01:15:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:05.285 01:15:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:05.285 01:15:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:05.285 01:15:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:05.285 01:15:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:05.285 01:15:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:05.285 01:15:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:05.285 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:05.285 01:15:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:05.285 01:15:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:05.285 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:05.285 01:15:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:05.285 01:15:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:05.285 01:15:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:05.285 01:15:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:05.285 01:15:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:05.285 01:15:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:05.285 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:05.285 01:15:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:05.285 01:15:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:05.285 01:15:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:05.285 01:15:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:05.285 01:15:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:05.285 01:15:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:05.285 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:05.285 01:15:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:05.285 01:15:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:05.285 01:15:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:05.285 01:15:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:05.285 01:15:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:05.285 01:15:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:05.285 01:15:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:05.285 01:15:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:05.285 01:15:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:05.285 01:15:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:05.285 01:15:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:05.285 01:15:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:05.285 01:15:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:05.285 01:15:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:05.285 01:15:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:05.285 01:15:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:05.285 01:15:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:05.285 01:15:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:05.285 01:15:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:05.285 01:15:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:05.285 01:15:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:05.285 01:15:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:05.285 01:15:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:05.285 01:15:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:05.285 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:05.285 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.381 ms 00:23:05.285 00:23:05.285 --- 10.0.0.2 ping statistics --- 00:23:05.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:05.285 rtt min/avg/max/mdev = 0.381/0.381/0.381/0.000 ms 00:23:05.285 01:15:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:05.285 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:05.285 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:23:05.285 00:23:05.285 --- 10.0.0.1 ping statistics --- 00:23:05.285 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:05.285 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:23:05.285 01:15:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:05.285 01:15:55 -- nvmf/common.sh@410 -- # return 0 00:23:05.285 01:15:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:05.285 01:15:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:05.285 01:15:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:05.285 01:15:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:05.285 01:15:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:05.285 01:15:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:05.285 01:15:55 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:05.285 01:15:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:05.285 01:15:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:05.285 01:15:55 -- common/autotest_common.sh@10 -- # set +x 00:23:05.285 01:15:55 -- nvmf/common.sh@469 -- # nvmfpid=1122104 00:23:05.286 01:15:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:05.286 01:15:55 -- nvmf/common.sh@470 -- # waitforlisten 1122104 00:23:05.286 01:15:55 -- common/autotest_common.sh@829 -- # '[' -z 1122104 ']' 00:23:05.286 01:15:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:05.286 01:15:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:05.286 01:15:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:05.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:05.286 01:15:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:05.286 01:15:55 -- common/autotest_common.sh@10 -- # set +x 00:23:05.286 [2024-11-26 01:15:55.746249] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:05.286 [2024-11-26 01:15:55.746342] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:05.286 EAL: No free 2048 kB hugepages reported on node 1 00:23:05.286 [2024-11-26 01:15:55.815429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:05.545 [2024-11-26 01:15:55.930667] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:05.545 [2024-11-26 01:15:55.930856] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:05.545 [2024-11-26 01:15:55.930879] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:05.545 [2024-11-26 01:15:55.930893] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:05.545 [2024-11-26 01:15:55.930980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:05.545 [2024-11-26 01:15:55.931039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:05.545 [2024-11-26 01:15:55.931156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:05.545 [2024-11-26 01:15:55.931159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:06.481 01:15:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:06.481 01:15:56 -- common/autotest_common.sh@862 -- # return 0 00:23:06.481 01:15:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:06.481 01:15:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:06.481 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.481 01:15:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:06.482 01:15:56 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.482 [2024-11-26 01:15:56.721158] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:06.482 01:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.482 01:15:56 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.482 Malloc0 00:23:06.482 01:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.482 01:15:56 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.482 01:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.482 01:15:56 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.482 01:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.482 01:15:56 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.482 [2024-11-26 01:15:56.772394] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:06.482 01:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.482 01:15:56 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.482 [2024-11-26 01:15:56.780097] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:06.482 [ 00:23:06.482 { 00:23:06.482 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:06.482 "subtype": "Discovery", 00:23:06.482 "listen_addresses": [], 00:23:06.482 "allow_any_host": true, 00:23:06.482 "hosts": [] 00:23:06.482 }, 00:23:06.482 { 00:23:06.482 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:06.482 "subtype": "NVMe", 00:23:06.482 "listen_addresses": [ 00:23:06.482 { 00:23:06.482 "transport": "TCP", 00:23:06.482 "trtype": "TCP", 00:23:06.482 "adrfam": "IPv4", 00:23:06.482 "traddr": "10.0.0.2", 00:23:06.482 "trsvcid": "4420" 00:23:06.482 } 00:23:06.482 ], 00:23:06.482 "allow_any_host": true, 00:23:06.482 "hosts": [], 00:23:06.482 "serial_number": "SPDK00000000000001", 00:23:06.482 "model_number": "SPDK bdev Controller", 00:23:06.482 "max_namespaces": 2, 00:23:06.482 "min_cntlid": 1, 00:23:06.482 "max_cntlid": 65519, 00:23:06.482 "namespaces": [ 00:23:06.482 { 00:23:06.482 "nsid": 1, 00:23:06.482 "bdev_name": "Malloc0", 00:23:06.482 "name": "Malloc0", 00:23:06.482 "nguid": "1C43D4496B114B94AD456140F1420979", 00:23:06.482 "uuid": "1c43d449-6b11-4b94-ad45-6140f1420979" 00:23:06.482 } 00:23:06.482 ] 00:23:06.482 } 00:23:06.482 ] 00:23:06.482 01:15:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.482 01:15:56 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:06.482 01:15:56 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:06.482 01:15:56 -- host/aer.sh@33 -- # aerpid=1122266 00:23:06.482 01:15:56 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:06.482 01:15:56 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:06.482 01:15:56 -- common/autotest_common.sh@1254 -- # local i=0 00:23:06.482 01:15:56 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:06.482 01:15:56 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:06.482 01:15:56 -- common/autotest_common.sh@1257 -- # i=1 00:23:06.482 01:15:56 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:06.482 EAL: No free 2048 kB hugepages reported on node 1 00:23:06.482 01:15:56 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:06.482 01:15:56 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:06.482 01:15:56 -- common/autotest_common.sh@1257 -- # i=2 00:23:06.482 01:15:56 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:06.482 01:15:56 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:06.482 01:15:56 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:06.482 01:15:56 -- common/autotest_common.sh@1265 -- # return 0 00:23:06.482 01:15:56 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:06.482 01:15:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.482 01:15:56 -- common/autotest_common.sh@10 -- # set +x 00:23:06.742 Malloc1 00:23:06.742 01:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.742 01:15:57 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:06.742 01:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.742 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:06.742 01:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.742 01:15:57 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:06.742 01:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.742 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:06.742 Asynchronous Event Request test 00:23:06.742 Attaching to 10.0.0.2 00:23:06.742 Attached to 10.0.0.2 00:23:06.742 Registering asynchronous event callbacks... 00:23:06.742 Starting namespace attribute notice tests for all controllers... 00:23:06.742 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:06.742 aer_cb - Changed Namespace 00:23:06.742 Cleaning up... 00:23:06.742 [ 00:23:06.742 { 00:23:06.742 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:06.742 "subtype": "Discovery", 00:23:06.742 "listen_addresses": [], 00:23:06.742 "allow_any_host": true, 00:23:06.742 "hosts": [] 00:23:06.742 }, 00:23:06.742 { 00:23:06.742 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:06.742 "subtype": "NVMe", 00:23:06.742 "listen_addresses": [ 00:23:06.742 { 00:23:06.742 "transport": "TCP", 00:23:06.742 "trtype": "TCP", 00:23:06.742 "adrfam": "IPv4", 00:23:06.742 "traddr": "10.0.0.2", 00:23:06.742 "trsvcid": "4420" 00:23:06.742 } 00:23:06.742 ], 00:23:06.742 "allow_any_host": true, 00:23:06.742 "hosts": [], 00:23:06.742 "serial_number": "SPDK00000000000001", 00:23:06.742 "model_number": "SPDK bdev Controller", 00:23:06.742 "max_namespaces": 2, 00:23:06.742 "min_cntlid": 1, 00:23:06.742 "max_cntlid": 65519, 00:23:06.742 "namespaces": [ 00:23:06.742 { 00:23:06.742 "nsid": 1, 00:23:06.742 "bdev_name": "Malloc0", 00:23:06.742 "name": "Malloc0", 00:23:06.742 "nguid": "1C43D4496B114B94AD456140F1420979", 00:23:06.742 "uuid": "1c43d449-6b11-4b94-ad45-6140f1420979" 00:23:06.742 }, 00:23:06.742 { 00:23:06.742 "nsid": 2, 00:23:06.742 "bdev_name": "Malloc1", 00:23:06.742 "name": "Malloc1", 00:23:06.742 "nguid": "6F6AC24DECAF423180225E323747D30A", 00:23:06.742 "uuid": "6f6ac24d-ecaf-4231-8022-5e323747d30a" 00:23:06.742 } 00:23:06.742 ] 00:23:06.742 } 00:23:06.742 ] 00:23:06.742 01:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.742 01:15:57 -- host/aer.sh@43 -- # wait 1122266 00:23:06.742 01:15:57 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:06.742 01:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.742 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:06.742 01:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.742 01:15:57 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:06.742 01:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.742 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:06.742 01:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.742 01:15:57 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:06.742 01:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.742 01:15:57 -- common/autotest_common.sh@10 -- # set +x 00:23:06.742 01:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.742 01:15:57 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:06.742 01:15:57 -- host/aer.sh@51 -- # nvmftestfini 00:23:06.742 01:15:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:06.742 01:15:57 -- nvmf/common.sh@116 -- # sync 00:23:06.742 01:15:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:06.742 01:15:57 -- nvmf/common.sh@119 -- # set +e 00:23:06.742 01:15:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:06.742 01:15:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:06.742 rmmod nvme_tcp 00:23:06.742 rmmod nvme_fabrics 00:23:06.742 rmmod nvme_keyring 00:23:06.742 01:15:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:06.742 01:15:57 -- nvmf/common.sh@123 -- # set -e 00:23:06.742 01:15:57 -- nvmf/common.sh@124 -- # return 0 00:23:06.742 01:15:57 -- nvmf/common.sh@477 -- # '[' -n 1122104 ']' 00:23:06.742 01:15:57 -- nvmf/common.sh@478 -- # killprocess 1122104 00:23:06.742 01:15:57 -- common/autotest_common.sh@936 -- # '[' -z 1122104 ']' 00:23:06.742 01:15:57 -- common/autotest_common.sh@940 -- # kill -0 1122104 00:23:06.742 01:15:57 -- common/autotest_common.sh@941 -- # uname 00:23:06.742 01:15:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:06.742 01:15:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1122104 00:23:06.742 01:15:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:06.742 01:15:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:06.742 01:15:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1122104' 00:23:06.742 killing process with pid 1122104 00:23:06.742 01:15:57 -- common/autotest_common.sh@955 -- # kill 1122104 00:23:06.742 [2024-11-26 01:15:57.271150] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:06.742 01:15:57 -- common/autotest_common.sh@960 -- # wait 1122104 00:23:07.310 01:15:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:07.310 01:15:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:07.310 01:15:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:07.310 01:15:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:07.310 01:15:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:07.310 01:15:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:07.310 01:15:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:07.310 01:15:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:09.216 01:15:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:09.216 00:23:09.216 real 0m6.228s 00:23:09.216 user 0m7.200s 00:23:09.216 sys 0m2.038s 00:23:09.216 01:15:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:09.216 01:15:59 -- common/autotest_common.sh@10 -- # set +x 00:23:09.216 ************************************ 00:23:09.216 END TEST nvmf_aer 00:23:09.216 ************************************ 00:23:09.216 01:15:59 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:09.216 01:15:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:09.216 01:15:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:09.216 01:15:59 -- common/autotest_common.sh@10 -- # set +x 00:23:09.216 ************************************ 00:23:09.216 START TEST nvmf_async_init 00:23:09.216 ************************************ 00:23:09.216 01:15:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:09.216 * Looking for test storage... 00:23:09.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:09.216 01:15:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:09.216 01:15:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:09.216 01:15:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:09.216 01:15:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:09.216 01:15:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:09.216 01:15:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:09.216 01:15:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:09.216 01:15:59 -- scripts/common.sh@335 -- # IFS=.-: 00:23:09.216 01:15:59 -- scripts/common.sh@335 -- # read -ra ver1 00:23:09.216 01:15:59 -- scripts/common.sh@336 -- # IFS=.-: 00:23:09.216 01:15:59 -- scripts/common.sh@336 -- # read -ra ver2 00:23:09.216 01:15:59 -- scripts/common.sh@337 -- # local 'op=<' 00:23:09.216 01:15:59 -- scripts/common.sh@339 -- # ver1_l=2 00:23:09.216 01:15:59 -- scripts/common.sh@340 -- # ver2_l=1 00:23:09.216 01:15:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:09.216 01:15:59 -- scripts/common.sh@343 -- # case "$op" in 00:23:09.216 01:15:59 -- scripts/common.sh@344 -- # : 1 00:23:09.475 01:15:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:09.475 01:15:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:09.475 01:15:59 -- scripts/common.sh@364 -- # decimal 1 00:23:09.475 01:15:59 -- scripts/common.sh@352 -- # local d=1 00:23:09.475 01:15:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:09.475 01:15:59 -- scripts/common.sh@354 -- # echo 1 00:23:09.475 01:15:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:09.475 01:15:59 -- scripts/common.sh@365 -- # decimal 2 00:23:09.475 01:15:59 -- scripts/common.sh@352 -- # local d=2 00:23:09.475 01:15:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:09.475 01:15:59 -- scripts/common.sh@354 -- # echo 2 00:23:09.475 01:15:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:09.475 01:15:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:09.476 01:15:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:09.476 01:15:59 -- scripts/common.sh@367 -- # return 0 00:23:09.476 01:15:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:09.476 01:15:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:09.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.476 --rc genhtml_branch_coverage=1 00:23:09.476 --rc genhtml_function_coverage=1 00:23:09.476 --rc genhtml_legend=1 00:23:09.476 --rc geninfo_all_blocks=1 00:23:09.476 --rc geninfo_unexecuted_blocks=1 00:23:09.476 00:23:09.476 ' 00:23:09.476 01:15:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:09.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.476 --rc genhtml_branch_coverage=1 00:23:09.476 --rc genhtml_function_coverage=1 00:23:09.476 --rc genhtml_legend=1 00:23:09.476 --rc geninfo_all_blocks=1 00:23:09.476 --rc geninfo_unexecuted_blocks=1 00:23:09.476 00:23:09.476 ' 00:23:09.476 01:15:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:09.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.476 --rc genhtml_branch_coverage=1 00:23:09.476 --rc genhtml_function_coverage=1 00:23:09.476 --rc genhtml_legend=1 00:23:09.476 --rc geninfo_all_blocks=1 00:23:09.476 --rc geninfo_unexecuted_blocks=1 00:23:09.476 00:23:09.476 ' 00:23:09.476 01:15:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:09.476 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.476 --rc genhtml_branch_coverage=1 00:23:09.476 --rc genhtml_function_coverage=1 00:23:09.476 --rc genhtml_legend=1 00:23:09.476 --rc geninfo_all_blocks=1 00:23:09.476 --rc geninfo_unexecuted_blocks=1 00:23:09.476 00:23:09.476 ' 00:23:09.476 01:15:59 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:09.476 01:15:59 -- nvmf/common.sh@7 -- # uname -s 00:23:09.476 01:15:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:09.476 01:15:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:09.476 01:15:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:09.476 01:15:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:09.476 01:15:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:09.476 01:15:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:09.476 01:15:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:09.476 01:15:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:09.476 01:15:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:09.476 01:15:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:09.476 01:15:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:09.476 01:15:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:09.476 01:15:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:09.476 01:15:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:09.476 01:15:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:09.476 01:15:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:09.476 01:15:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:09.476 01:15:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:09.476 01:15:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:09.476 01:15:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.476 01:15:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.476 01:15:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.476 01:15:59 -- paths/export.sh@5 -- # export PATH 00:23:09.476 01:15:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.476 01:15:59 -- nvmf/common.sh@46 -- # : 0 00:23:09.476 01:15:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:09.476 01:15:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:09.476 01:15:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:09.476 01:15:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:09.476 01:15:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:09.476 01:15:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:09.476 01:15:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:09.476 01:15:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:09.476 01:15:59 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:09.476 01:15:59 -- host/async_init.sh@14 -- # null_block_size=512 00:23:09.476 01:15:59 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:09.476 01:15:59 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:09.476 01:15:59 -- host/async_init.sh@20 -- # uuidgen 00:23:09.476 01:15:59 -- host/async_init.sh@20 -- # tr -d - 00:23:09.476 01:15:59 -- host/async_init.sh@20 -- # nguid=2cef0535aaee4ae3bb21ee8e30c1dfe3 00:23:09.476 01:15:59 -- host/async_init.sh@22 -- # nvmftestinit 00:23:09.476 01:15:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:09.476 01:15:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:09.476 01:15:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:09.476 01:15:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:09.476 01:15:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:09.476 01:15:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:09.476 01:15:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:09.476 01:15:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:09.476 01:15:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:09.476 01:15:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:09.476 01:15:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:09.476 01:15:59 -- common/autotest_common.sh@10 -- # set +x 00:23:11.381 01:16:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:11.381 01:16:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:11.381 01:16:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:11.381 01:16:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:11.381 01:16:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:11.381 01:16:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:11.381 01:16:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:11.381 01:16:01 -- nvmf/common.sh@294 -- # net_devs=() 00:23:11.381 01:16:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:11.381 01:16:01 -- nvmf/common.sh@295 -- # e810=() 00:23:11.381 01:16:01 -- nvmf/common.sh@295 -- # local -ga e810 00:23:11.381 01:16:01 -- nvmf/common.sh@296 -- # x722=() 00:23:11.381 01:16:01 -- nvmf/common.sh@296 -- # local -ga x722 00:23:11.381 01:16:01 -- nvmf/common.sh@297 -- # mlx=() 00:23:11.381 01:16:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:11.381 01:16:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:11.381 01:16:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:11.381 01:16:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:11.381 01:16:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:11.381 01:16:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.381 01:16:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:11.381 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:11.381 01:16:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:11.381 01:16:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:11.381 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:11.381 01:16:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:11.381 01:16:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.381 01:16:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.381 01:16:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.381 01:16:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.381 01:16:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:11.381 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:11.381 01:16:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.381 01:16:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:11.381 01:16:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:11.381 01:16:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:11.381 01:16:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:11.381 01:16:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:11.381 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:11.381 01:16:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:11.381 01:16:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:11.381 01:16:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:11.381 01:16:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:11.381 01:16:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:11.381 01:16:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:11.381 01:16:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:11.381 01:16:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:11.381 01:16:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:11.381 01:16:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:11.381 01:16:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:11.381 01:16:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:11.381 01:16:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:11.381 01:16:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:11.381 01:16:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:11.381 01:16:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:11.381 01:16:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:11.381 01:16:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:11.381 01:16:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:11.381 01:16:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:11.381 01:16:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:11.381 01:16:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:11.381 01:16:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:11.381 01:16:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:11.381 01:16:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:11.381 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:11.381 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:23:11.381 00:23:11.381 --- 10.0.0.2 ping statistics --- 00:23:11.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.381 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:23:11.381 01:16:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:11.381 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:11.381 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:23:11.381 00:23:11.381 --- 10.0.0.1 ping statistics --- 00:23:11.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:11.381 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:23:11.381 01:16:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:11.381 01:16:01 -- nvmf/common.sh@410 -- # return 0 00:23:11.381 01:16:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:11.381 01:16:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:11.381 01:16:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:11.382 01:16:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:11.382 01:16:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:11.382 01:16:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:11.382 01:16:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:11.382 01:16:01 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:11.382 01:16:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:11.382 01:16:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:11.382 01:16:01 -- common/autotest_common.sh@10 -- # set +x 00:23:11.382 01:16:01 -- nvmf/common.sh@469 -- # nvmfpid=1124220 00:23:11.382 01:16:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:11.382 01:16:01 -- nvmf/common.sh@470 -- # waitforlisten 1124220 00:23:11.382 01:16:01 -- common/autotest_common.sh@829 -- # '[' -z 1124220 ']' 00:23:11.382 01:16:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:11.382 01:16:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:11.382 01:16:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:11.382 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:11.382 01:16:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:11.382 01:16:01 -- common/autotest_common.sh@10 -- # set +x 00:23:11.382 [2024-11-26 01:16:01.869849] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:11.382 [2024-11-26 01:16:01.869926] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:11.382 EAL: No free 2048 kB hugepages reported on node 1 00:23:11.642 [2024-11-26 01:16:01.933694] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:11.642 [2024-11-26 01:16:02.040283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:11.642 [2024-11-26 01:16:02.040439] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:11.642 [2024-11-26 01:16:02.040471] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:11.642 [2024-11-26 01:16:02.040483] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:11.642 [2024-11-26 01:16:02.040511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:12.580 01:16:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:12.580 01:16:02 -- common/autotest_common.sh@862 -- # return 0 00:23:12.580 01:16:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:12.580 01:16:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 01:16:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:12.580 01:16:02 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 [2024-11-26 01:16:02.938914] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:12.580 01:16:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.580 01:16:02 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 null0 00:23:12.580 01:16:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.580 01:16:02 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 01:16:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.580 01:16:02 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 01:16:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.580 01:16:02 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 2cef0535aaee4ae3bb21ee8e30c1dfe3 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 01:16:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.580 01:16:02 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.580 [2024-11-26 01:16:02.979224] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:12.580 01:16:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.580 01:16:02 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:12.580 01:16:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.580 01:16:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.839 nvme0n1 00:23:12.839 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.839 01:16:03 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:12.839 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.839 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:12.839 [ 00:23:12.839 { 00:23:12.839 "name": "nvme0n1", 00:23:12.839 "aliases": [ 00:23:12.839 "2cef0535-aaee-4ae3-bb21-ee8e30c1dfe3" 00:23:12.839 ], 00:23:12.839 "product_name": "NVMe disk", 00:23:12.839 "block_size": 512, 00:23:12.839 "num_blocks": 2097152, 00:23:12.839 "uuid": "2cef0535-aaee-4ae3-bb21-ee8e30c1dfe3", 00:23:12.839 "assigned_rate_limits": { 00:23:12.839 "rw_ios_per_sec": 0, 00:23:12.839 "rw_mbytes_per_sec": 0, 00:23:12.839 "r_mbytes_per_sec": 0, 00:23:12.839 "w_mbytes_per_sec": 0 00:23:12.839 }, 00:23:12.839 "claimed": false, 00:23:12.839 "zoned": false, 00:23:12.839 "supported_io_types": { 00:23:12.839 "read": true, 00:23:12.839 "write": true, 00:23:12.839 "unmap": false, 00:23:12.839 "write_zeroes": true, 00:23:12.839 "flush": true, 00:23:12.839 "reset": true, 00:23:12.839 "compare": true, 00:23:12.839 "compare_and_write": true, 00:23:12.839 "abort": true, 00:23:12.839 "nvme_admin": true, 00:23:12.839 "nvme_io": true 00:23:12.839 }, 00:23:12.839 "driver_specific": { 00:23:12.839 "nvme": [ 00:23:12.839 { 00:23:12.839 "trid": { 00:23:12.839 "trtype": "TCP", 00:23:12.839 "adrfam": "IPv4", 00:23:12.839 "traddr": "10.0.0.2", 00:23:12.839 "trsvcid": "4420", 00:23:12.839 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:12.839 }, 00:23:12.839 "ctrlr_data": { 00:23:12.839 "cntlid": 1, 00:23:12.839 "vendor_id": "0x8086", 00:23:12.839 "model_number": "SPDK bdev Controller", 00:23:12.839 "serial_number": "00000000000000000000", 00:23:12.839 "firmware_revision": "24.01.1", 00:23:12.839 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:12.839 "oacs": { 00:23:12.839 "security": 0, 00:23:12.839 "format": 0, 00:23:12.839 "firmware": 0, 00:23:12.839 "ns_manage": 0 00:23:12.839 }, 00:23:12.839 "multi_ctrlr": true, 00:23:12.839 "ana_reporting": false 00:23:12.839 }, 00:23:12.839 "vs": { 00:23:12.839 "nvme_version": "1.3" 00:23:12.839 }, 00:23:12.839 "ns_data": { 00:23:12.839 "id": 1, 00:23:12.839 "can_share": true 00:23:12.839 } 00:23:12.840 } 00:23:12.840 ], 00:23:12.840 "mp_policy": "active_passive" 00:23:12.840 } 00:23:12.840 } 00:23:12.840 ] 00:23:12.840 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.840 01:16:03 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:12.840 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.840 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:12.840 [2024-11-26 01:16:03.227890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:12.840 [2024-11-26 01:16:03.227988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x261eba0 (9): Bad file descriptor 00:23:12.840 [2024-11-26 01:16:03.359836] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:12.840 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.840 01:16:03 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:12.840 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.840 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:12.840 [ 00:23:12.840 { 00:23:12.840 "name": "nvme0n1", 00:23:12.840 "aliases": [ 00:23:12.840 "2cef0535-aaee-4ae3-bb21-ee8e30c1dfe3" 00:23:12.840 ], 00:23:12.840 "product_name": "NVMe disk", 00:23:12.840 "block_size": 512, 00:23:12.840 "num_blocks": 2097152, 00:23:12.840 "uuid": "2cef0535-aaee-4ae3-bb21-ee8e30c1dfe3", 00:23:12.840 "assigned_rate_limits": { 00:23:12.840 "rw_ios_per_sec": 0, 00:23:12.840 "rw_mbytes_per_sec": 0, 00:23:12.840 "r_mbytes_per_sec": 0, 00:23:12.840 "w_mbytes_per_sec": 0 00:23:12.840 }, 00:23:12.840 "claimed": false, 00:23:12.840 "zoned": false, 00:23:12.840 "supported_io_types": { 00:23:12.840 "read": true, 00:23:12.840 "write": true, 00:23:12.840 "unmap": false, 00:23:12.840 "write_zeroes": true, 00:23:12.840 "flush": true, 00:23:12.840 "reset": true, 00:23:12.840 "compare": true, 00:23:12.840 "compare_and_write": true, 00:23:12.840 "abort": true, 00:23:12.840 "nvme_admin": true, 00:23:12.840 "nvme_io": true 00:23:12.840 }, 00:23:12.840 "driver_specific": { 00:23:12.840 "nvme": [ 00:23:12.840 { 00:23:12.840 "trid": { 00:23:12.840 "trtype": "TCP", 00:23:13.098 "adrfam": "IPv4", 00:23:13.098 "traddr": "10.0.0.2", 00:23:13.098 "trsvcid": "4420", 00:23:13.098 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:13.098 }, 00:23:13.098 "ctrlr_data": { 00:23:13.098 "cntlid": 2, 00:23:13.098 "vendor_id": "0x8086", 00:23:13.098 "model_number": "SPDK bdev Controller", 00:23:13.098 "serial_number": "00000000000000000000", 00:23:13.098 "firmware_revision": "24.01.1", 00:23:13.098 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:13.098 "oacs": { 00:23:13.098 "security": 0, 00:23:13.098 "format": 0, 00:23:13.098 "firmware": 0, 00:23:13.098 "ns_manage": 0 00:23:13.098 }, 00:23:13.098 "multi_ctrlr": true, 00:23:13.099 "ana_reporting": false 00:23:13.099 }, 00:23:13.099 "vs": { 00:23:13.099 "nvme_version": "1.3" 00:23:13.099 }, 00:23:13.099 "ns_data": { 00:23:13.099 "id": 1, 00:23:13.099 "can_share": true 00:23:13.099 } 00:23:13.099 } 00:23:13.099 ], 00:23:13.099 "mp_policy": "active_passive" 00:23:13.099 } 00:23:13.099 } 00:23:13.099 ] 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@53 -- # mktemp 00:23:13.099 01:16:03 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.XhHqMv5eBc 00:23:13.099 01:16:03 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:13.099 01:16:03 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.XhHqMv5eBc 00:23:13.099 01:16:03 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 [2024-11-26 01:16:03.404485] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:13.099 [2024-11-26 01:16:03.404671] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.XhHqMv5eBc 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.XhHqMv5eBc 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 [2024-11-26 01:16:03.420516] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:13.099 nvme0n1 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 [ 00:23:13.099 { 00:23:13.099 "name": "nvme0n1", 00:23:13.099 "aliases": [ 00:23:13.099 "2cef0535-aaee-4ae3-bb21-ee8e30c1dfe3" 00:23:13.099 ], 00:23:13.099 "product_name": "NVMe disk", 00:23:13.099 "block_size": 512, 00:23:13.099 "num_blocks": 2097152, 00:23:13.099 "uuid": "2cef0535-aaee-4ae3-bb21-ee8e30c1dfe3", 00:23:13.099 "assigned_rate_limits": { 00:23:13.099 "rw_ios_per_sec": 0, 00:23:13.099 "rw_mbytes_per_sec": 0, 00:23:13.099 "r_mbytes_per_sec": 0, 00:23:13.099 "w_mbytes_per_sec": 0 00:23:13.099 }, 00:23:13.099 "claimed": false, 00:23:13.099 "zoned": false, 00:23:13.099 "supported_io_types": { 00:23:13.099 "read": true, 00:23:13.099 "write": true, 00:23:13.099 "unmap": false, 00:23:13.099 "write_zeroes": true, 00:23:13.099 "flush": true, 00:23:13.099 "reset": true, 00:23:13.099 "compare": true, 00:23:13.099 "compare_and_write": true, 00:23:13.099 "abort": true, 00:23:13.099 "nvme_admin": true, 00:23:13.099 "nvme_io": true 00:23:13.099 }, 00:23:13.099 "driver_specific": { 00:23:13.099 "nvme": [ 00:23:13.099 { 00:23:13.099 "trid": { 00:23:13.099 "trtype": "TCP", 00:23:13.099 "adrfam": "IPv4", 00:23:13.099 "traddr": "10.0.0.2", 00:23:13.099 "trsvcid": "4421", 00:23:13.099 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:13.099 }, 00:23:13.099 "ctrlr_data": { 00:23:13.099 "cntlid": 3, 00:23:13.099 "vendor_id": "0x8086", 00:23:13.099 "model_number": "SPDK bdev Controller", 00:23:13.099 "serial_number": "00000000000000000000", 00:23:13.099 "firmware_revision": "24.01.1", 00:23:13.099 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:13.099 "oacs": { 00:23:13.099 "security": 0, 00:23:13.099 "format": 0, 00:23:13.099 "firmware": 0, 00:23:13.099 "ns_manage": 0 00:23:13.099 }, 00:23:13.099 "multi_ctrlr": true, 00:23:13.099 "ana_reporting": false 00:23:13.099 }, 00:23:13.099 "vs": { 00:23:13.099 "nvme_version": "1.3" 00:23:13.099 }, 00:23:13.099 "ns_data": { 00:23:13.099 "id": 1, 00:23:13.099 "can_share": true 00:23:13.099 } 00:23:13.099 } 00:23:13.099 ], 00:23:13.099 "mp_policy": "active_passive" 00:23:13.099 } 00:23:13.099 } 00:23:13.099 ] 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:13.099 01:16:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.099 01:16:03 -- common/autotest_common.sh@10 -- # set +x 00:23:13.099 01:16:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.099 01:16:03 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.XhHqMv5eBc 00:23:13.099 01:16:03 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:13.099 01:16:03 -- host/async_init.sh@78 -- # nvmftestfini 00:23:13.099 01:16:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:13.099 01:16:03 -- nvmf/common.sh@116 -- # sync 00:23:13.099 01:16:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:13.099 01:16:03 -- nvmf/common.sh@119 -- # set +e 00:23:13.099 01:16:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:13.099 01:16:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:13.099 rmmod nvme_tcp 00:23:13.099 rmmod nvme_fabrics 00:23:13.099 rmmod nvme_keyring 00:23:13.099 01:16:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:13.099 01:16:03 -- nvmf/common.sh@123 -- # set -e 00:23:13.099 01:16:03 -- nvmf/common.sh@124 -- # return 0 00:23:13.099 01:16:03 -- nvmf/common.sh@477 -- # '[' -n 1124220 ']' 00:23:13.099 01:16:03 -- nvmf/common.sh@478 -- # killprocess 1124220 00:23:13.099 01:16:03 -- common/autotest_common.sh@936 -- # '[' -z 1124220 ']' 00:23:13.099 01:16:03 -- common/autotest_common.sh@940 -- # kill -0 1124220 00:23:13.099 01:16:03 -- common/autotest_common.sh@941 -- # uname 00:23:13.099 01:16:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:13.099 01:16:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1124220 00:23:13.099 01:16:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:13.099 01:16:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:13.099 01:16:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1124220' 00:23:13.099 killing process with pid 1124220 00:23:13.099 01:16:03 -- common/autotest_common.sh@955 -- # kill 1124220 00:23:13.099 01:16:03 -- common/autotest_common.sh@960 -- # wait 1124220 00:23:13.358 01:16:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:13.358 01:16:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:13.359 01:16:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:13.359 01:16:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:13.359 01:16:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:13.359 01:16:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.359 01:16:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.359 01:16:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:15.900 01:16:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:15.900 00:23:15.900 real 0m6.274s 00:23:15.900 user 0m3.117s 00:23:15.900 sys 0m1.862s 00:23:15.900 01:16:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:15.900 01:16:05 -- common/autotest_common.sh@10 -- # set +x 00:23:15.900 ************************************ 00:23:15.900 END TEST nvmf_async_init 00:23:15.900 ************************************ 00:23:15.900 01:16:05 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:15.900 01:16:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:15.900 01:16:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:15.900 01:16:05 -- common/autotest_common.sh@10 -- # set +x 00:23:15.900 ************************************ 00:23:15.900 START TEST dma 00:23:15.900 ************************************ 00:23:15.900 01:16:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:15.900 * Looking for test storage... 00:23:15.900 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:15.900 01:16:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:15.900 01:16:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:15.900 01:16:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:15.900 01:16:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:15.900 01:16:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:15.900 01:16:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:15.900 01:16:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:15.900 01:16:06 -- scripts/common.sh@335 -- # IFS=.-: 00:23:15.900 01:16:06 -- scripts/common.sh@335 -- # read -ra ver1 00:23:15.900 01:16:06 -- scripts/common.sh@336 -- # IFS=.-: 00:23:15.900 01:16:06 -- scripts/common.sh@336 -- # read -ra ver2 00:23:15.900 01:16:06 -- scripts/common.sh@337 -- # local 'op=<' 00:23:15.900 01:16:06 -- scripts/common.sh@339 -- # ver1_l=2 00:23:15.900 01:16:06 -- scripts/common.sh@340 -- # ver2_l=1 00:23:15.900 01:16:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:15.900 01:16:06 -- scripts/common.sh@343 -- # case "$op" in 00:23:15.900 01:16:06 -- scripts/common.sh@344 -- # : 1 00:23:15.900 01:16:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:15.900 01:16:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:15.900 01:16:06 -- scripts/common.sh@364 -- # decimal 1 00:23:15.900 01:16:06 -- scripts/common.sh@352 -- # local d=1 00:23:15.900 01:16:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:15.900 01:16:06 -- scripts/common.sh@354 -- # echo 1 00:23:15.900 01:16:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:15.900 01:16:06 -- scripts/common.sh@365 -- # decimal 2 00:23:15.900 01:16:06 -- scripts/common.sh@352 -- # local d=2 00:23:15.900 01:16:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:15.900 01:16:06 -- scripts/common.sh@354 -- # echo 2 00:23:15.900 01:16:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:15.900 01:16:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:15.900 01:16:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:15.900 01:16:06 -- scripts/common.sh@367 -- # return 0 00:23:15.900 01:16:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:15.900 01:16:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.900 --rc genhtml_branch_coverage=1 00:23:15.900 --rc genhtml_function_coverage=1 00:23:15.900 --rc genhtml_legend=1 00:23:15.900 --rc geninfo_all_blocks=1 00:23:15.900 --rc geninfo_unexecuted_blocks=1 00:23:15.900 00:23:15.900 ' 00:23:15.900 01:16:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.900 --rc genhtml_branch_coverage=1 00:23:15.900 --rc genhtml_function_coverage=1 00:23:15.900 --rc genhtml_legend=1 00:23:15.900 --rc geninfo_all_blocks=1 00:23:15.900 --rc geninfo_unexecuted_blocks=1 00:23:15.900 00:23:15.900 ' 00:23:15.900 01:16:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.900 --rc genhtml_branch_coverage=1 00:23:15.900 --rc genhtml_function_coverage=1 00:23:15.900 --rc genhtml_legend=1 00:23:15.900 --rc geninfo_all_blocks=1 00:23:15.900 --rc geninfo_unexecuted_blocks=1 00:23:15.900 00:23:15.900 ' 00:23:15.900 01:16:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:15.900 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.900 --rc genhtml_branch_coverage=1 00:23:15.900 --rc genhtml_function_coverage=1 00:23:15.900 --rc genhtml_legend=1 00:23:15.900 --rc geninfo_all_blocks=1 00:23:15.900 --rc geninfo_unexecuted_blocks=1 00:23:15.900 00:23:15.900 ' 00:23:15.900 01:16:06 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:15.900 01:16:06 -- nvmf/common.sh@7 -- # uname -s 00:23:15.900 01:16:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:15.900 01:16:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:15.900 01:16:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:15.900 01:16:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:15.900 01:16:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:15.900 01:16:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:15.900 01:16:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:15.900 01:16:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:15.900 01:16:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:15.900 01:16:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:15.900 01:16:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:15.900 01:16:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:15.900 01:16:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:15.900 01:16:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:15.900 01:16:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:15.900 01:16:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:15.900 01:16:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:15.900 01:16:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:15.900 01:16:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:15.900 01:16:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.900 01:16:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.900 01:16:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.900 01:16:06 -- paths/export.sh@5 -- # export PATH 00:23:15.900 01:16:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.900 01:16:06 -- nvmf/common.sh@46 -- # : 0 00:23:15.900 01:16:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:15.900 01:16:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:15.900 01:16:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:15.900 01:16:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:15.900 01:16:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:15.900 01:16:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:15.900 01:16:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:15.900 01:16:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:15.900 01:16:06 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:15.900 01:16:06 -- host/dma.sh@13 -- # exit 0 00:23:15.900 00:23:15.900 real 0m0.159s 00:23:15.900 user 0m0.105s 00:23:15.900 sys 0m0.063s 00:23:15.900 01:16:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:15.901 01:16:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.901 ************************************ 00:23:15.901 END TEST dma 00:23:15.901 ************************************ 00:23:15.901 01:16:06 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:15.901 01:16:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:15.901 01:16:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:15.901 01:16:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.901 ************************************ 00:23:15.901 START TEST nvmf_identify 00:23:15.901 ************************************ 00:23:15.901 01:16:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:15.901 * Looking for test storage... 00:23:15.901 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:15.901 01:16:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:15.901 01:16:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:15.901 01:16:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:15.901 01:16:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:15.901 01:16:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:15.901 01:16:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:15.901 01:16:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:15.901 01:16:06 -- scripts/common.sh@335 -- # IFS=.-: 00:23:15.901 01:16:06 -- scripts/common.sh@335 -- # read -ra ver1 00:23:15.901 01:16:06 -- scripts/common.sh@336 -- # IFS=.-: 00:23:15.901 01:16:06 -- scripts/common.sh@336 -- # read -ra ver2 00:23:15.901 01:16:06 -- scripts/common.sh@337 -- # local 'op=<' 00:23:15.901 01:16:06 -- scripts/common.sh@339 -- # ver1_l=2 00:23:15.901 01:16:06 -- scripts/common.sh@340 -- # ver2_l=1 00:23:15.901 01:16:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:15.901 01:16:06 -- scripts/common.sh@343 -- # case "$op" in 00:23:15.901 01:16:06 -- scripts/common.sh@344 -- # : 1 00:23:15.901 01:16:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:15.901 01:16:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:15.901 01:16:06 -- scripts/common.sh@364 -- # decimal 1 00:23:15.901 01:16:06 -- scripts/common.sh@352 -- # local d=1 00:23:15.901 01:16:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:15.901 01:16:06 -- scripts/common.sh@354 -- # echo 1 00:23:15.901 01:16:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:15.901 01:16:06 -- scripts/common.sh@365 -- # decimal 2 00:23:15.901 01:16:06 -- scripts/common.sh@352 -- # local d=2 00:23:15.901 01:16:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:15.901 01:16:06 -- scripts/common.sh@354 -- # echo 2 00:23:15.901 01:16:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:15.901 01:16:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:15.901 01:16:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:15.901 01:16:06 -- scripts/common.sh@367 -- # return 0 00:23:15.901 01:16:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:15.901 01:16:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:15.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.901 --rc genhtml_branch_coverage=1 00:23:15.901 --rc genhtml_function_coverage=1 00:23:15.901 --rc genhtml_legend=1 00:23:15.901 --rc geninfo_all_blocks=1 00:23:15.901 --rc geninfo_unexecuted_blocks=1 00:23:15.901 00:23:15.901 ' 00:23:15.901 01:16:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:15.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.901 --rc genhtml_branch_coverage=1 00:23:15.901 --rc genhtml_function_coverage=1 00:23:15.901 --rc genhtml_legend=1 00:23:15.901 --rc geninfo_all_blocks=1 00:23:15.901 --rc geninfo_unexecuted_blocks=1 00:23:15.901 00:23:15.901 ' 00:23:15.901 01:16:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:15.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.901 --rc genhtml_branch_coverage=1 00:23:15.901 --rc genhtml_function_coverage=1 00:23:15.901 --rc genhtml_legend=1 00:23:15.901 --rc geninfo_all_blocks=1 00:23:15.901 --rc geninfo_unexecuted_blocks=1 00:23:15.901 00:23:15.901 ' 00:23:15.901 01:16:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:15.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:15.901 --rc genhtml_branch_coverage=1 00:23:15.901 --rc genhtml_function_coverage=1 00:23:15.901 --rc genhtml_legend=1 00:23:15.901 --rc geninfo_all_blocks=1 00:23:15.901 --rc geninfo_unexecuted_blocks=1 00:23:15.901 00:23:15.901 ' 00:23:15.901 01:16:06 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:15.901 01:16:06 -- nvmf/common.sh@7 -- # uname -s 00:23:15.901 01:16:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:15.901 01:16:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:15.901 01:16:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:15.901 01:16:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:15.901 01:16:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:15.901 01:16:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:15.901 01:16:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:15.901 01:16:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:15.901 01:16:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:15.901 01:16:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:15.901 01:16:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:15.901 01:16:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:15.901 01:16:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:15.901 01:16:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:15.901 01:16:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:15.901 01:16:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:15.901 01:16:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:15.901 01:16:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:15.901 01:16:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:15.901 01:16:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.901 01:16:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.901 01:16:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.901 01:16:06 -- paths/export.sh@5 -- # export PATH 00:23:15.901 01:16:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:15.901 01:16:06 -- nvmf/common.sh@46 -- # : 0 00:23:15.901 01:16:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:15.901 01:16:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:15.901 01:16:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:15.901 01:16:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:15.901 01:16:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:15.901 01:16:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:15.901 01:16:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:15.901 01:16:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:15.901 01:16:06 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:15.901 01:16:06 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:15.901 01:16:06 -- host/identify.sh@14 -- # nvmftestinit 00:23:15.901 01:16:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:15.901 01:16:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:15.901 01:16:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:15.901 01:16:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:15.901 01:16:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:15.901 01:16:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:15.901 01:16:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:15.901 01:16:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:15.901 01:16:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:15.901 01:16:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:15.901 01:16:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:15.901 01:16:06 -- common/autotest_common.sh@10 -- # set +x 00:23:17.805 01:16:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:17.805 01:16:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:17.805 01:16:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:17.805 01:16:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:17.805 01:16:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:17.805 01:16:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:17.805 01:16:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:17.805 01:16:08 -- nvmf/common.sh@294 -- # net_devs=() 00:23:17.805 01:16:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:17.805 01:16:08 -- nvmf/common.sh@295 -- # e810=() 00:23:17.805 01:16:08 -- nvmf/common.sh@295 -- # local -ga e810 00:23:17.805 01:16:08 -- nvmf/common.sh@296 -- # x722=() 00:23:17.805 01:16:08 -- nvmf/common.sh@296 -- # local -ga x722 00:23:17.805 01:16:08 -- nvmf/common.sh@297 -- # mlx=() 00:23:17.805 01:16:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:17.805 01:16:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:17.805 01:16:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:17.805 01:16:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:17.805 01:16:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:17.805 01:16:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:17.805 01:16:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:17.805 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:17.805 01:16:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:17.805 01:16:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:17.805 01:16:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:17.805 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:17.806 01:16:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:17.806 01:16:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:17.806 01:16:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:17.806 01:16:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:17.806 01:16:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:17.806 01:16:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:17.806 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:17.806 01:16:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:17.806 01:16:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:17.806 01:16:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:17.806 01:16:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:17.806 01:16:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:17.806 01:16:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:17.806 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:17.806 01:16:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:17.806 01:16:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:17.806 01:16:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:17.806 01:16:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:17.806 01:16:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:17.806 01:16:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:17.806 01:16:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:17.806 01:16:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:17.806 01:16:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:17.806 01:16:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:17.806 01:16:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:17.806 01:16:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:17.806 01:16:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:17.806 01:16:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:17.806 01:16:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:17.806 01:16:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:17.806 01:16:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:17.806 01:16:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:17.806 01:16:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:17.806 01:16:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:17.806 01:16:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:17.806 01:16:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:17.806 01:16:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:17.806 01:16:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:17.806 01:16:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:18.065 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:18.065 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:23:18.065 00:23:18.065 --- 10.0.0.2 ping statistics --- 00:23:18.065 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.065 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:23:18.065 01:16:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:18.065 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:18.065 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:23:18.065 00:23:18.065 --- 10.0.0.1 ping statistics --- 00:23:18.065 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.065 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:23:18.065 01:16:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:18.065 01:16:08 -- nvmf/common.sh@410 -- # return 0 00:23:18.065 01:16:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:18.065 01:16:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:18.065 01:16:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:18.065 01:16:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:18.065 01:16:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:18.065 01:16:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:18.065 01:16:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:18.065 01:16:08 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:18.065 01:16:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:18.065 01:16:08 -- common/autotest_common.sh@10 -- # set +x 00:23:18.065 01:16:08 -- host/identify.sh@19 -- # nvmfpid=1126503 00:23:18.065 01:16:08 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:18.065 01:16:08 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:18.065 01:16:08 -- host/identify.sh@23 -- # waitforlisten 1126503 00:23:18.065 01:16:08 -- common/autotest_common.sh@829 -- # '[' -z 1126503 ']' 00:23:18.065 01:16:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:18.065 01:16:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:18.065 01:16:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:18.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:18.065 01:16:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:18.065 01:16:08 -- common/autotest_common.sh@10 -- # set +x 00:23:18.065 [2024-11-26 01:16:08.409255] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:18.065 [2024-11-26 01:16:08.409321] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:18.065 EAL: No free 2048 kB hugepages reported on node 1 00:23:18.065 [2024-11-26 01:16:08.475473] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:18.065 [2024-11-26 01:16:08.591354] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:18.065 [2024-11-26 01:16:08.591538] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:18.065 [2024-11-26 01:16:08.591558] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:18.065 [2024-11-26 01:16:08.591572] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:18.065 [2024-11-26 01:16:08.591635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:18.065 [2024-11-26 01:16:08.591724] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:18.065 [2024-11-26 01:16:08.591760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:18.065 [2024-11-26 01:16:08.591763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:19.028 01:16:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:19.028 01:16:09 -- common/autotest_common.sh@862 -- # return 0 00:23:19.028 01:16:09 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 [2024-11-26 01:16:09.373210] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:19.028 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.028 01:16:09 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:19.028 01:16:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 01:16:09 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 Malloc0 00:23:19.028 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.028 01:16:09 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.028 01:16:09 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.028 01:16:09 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 [2024-11-26 01:16:09.454317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:19.028 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.028 01:16:09 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.028 01:16:09 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:19.028 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.028 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.028 [2024-11-26 01:16:09.470025] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:19.028 [ 00:23:19.028 { 00:23:19.028 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:19.028 "subtype": "Discovery", 00:23:19.028 "listen_addresses": [ 00:23:19.028 { 00:23:19.028 "transport": "TCP", 00:23:19.028 "trtype": "TCP", 00:23:19.028 "adrfam": "IPv4", 00:23:19.028 "traddr": "10.0.0.2", 00:23:19.028 "trsvcid": "4420" 00:23:19.028 } 00:23:19.028 ], 00:23:19.028 "allow_any_host": true, 00:23:19.028 "hosts": [] 00:23:19.028 }, 00:23:19.028 { 00:23:19.028 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:19.028 "subtype": "NVMe", 00:23:19.028 "listen_addresses": [ 00:23:19.028 { 00:23:19.028 "transport": "TCP", 00:23:19.028 "trtype": "TCP", 00:23:19.028 "adrfam": "IPv4", 00:23:19.028 "traddr": "10.0.0.2", 00:23:19.028 "trsvcid": "4420" 00:23:19.028 } 00:23:19.028 ], 00:23:19.028 "allow_any_host": true, 00:23:19.028 "hosts": [], 00:23:19.028 "serial_number": "SPDK00000000000001", 00:23:19.028 "model_number": "SPDK bdev Controller", 00:23:19.028 "max_namespaces": 32, 00:23:19.028 "min_cntlid": 1, 00:23:19.028 "max_cntlid": 65519, 00:23:19.028 "namespaces": [ 00:23:19.028 { 00:23:19.028 "nsid": 1, 00:23:19.028 "bdev_name": "Malloc0", 00:23:19.028 "name": "Malloc0", 00:23:19.028 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:19.028 "eui64": "ABCDEF0123456789", 00:23:19.028 "uuid": "4c8c88e3-8460-4713-991b-6c6a758b16a5" 00:23:19.028 } 00:23:19.029 ] 00:23:19.029 } 00:23:19.029 ] 00:23:19.029 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.029 01:16:09 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:19.029 [2024-11-26 01:16:09.497104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:19.029 [2024-11-26 01:16:09.497147] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1126660 ] 00:23:19.029 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.029 [2024-11-26 01:16:09.532021] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:19.029 [2024-11-26 01:16:09.532075] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:19.029 [2024-11-26 01:16:09.532085] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:19.029 [2024-11-26 01:16:09.532101] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:19.029 [2024-11-26 01:16:09.532114] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:19.029 [2024-11-26 01:16:09.532482] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:19.029 [2024-11-26 01:16:09.532549] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xf25e10 0 00:23:19.029 [2024-11-26 01:16:09.538718] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:19.029 [2024-11-26 01:16:09.538738] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:19.029 [2024-11-26 01:16:09.538746] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:19.029 [2024-11-26 01:16:09.538752] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:19.029 [2024-11-26 01:16:09.538817] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.538830] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.538838] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.538854] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:19.029 [2024-11-26 01:16:09.538881] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.546698] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.546716] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.546723] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.546730] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.546746] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:19.029 [2024-11-26 01:16:09.546756] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:19.029 [2024-11-26 01:16:09.546766] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:19.029 [2024-11-26 01:16:09.546785] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.546793] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.546799] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.546811] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.546835] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.546947] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.546962] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.546969] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.546976] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.546984] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:19.029 [2024-11-26 01:16:09.546997] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:19.029 [2024-11-26 01:16:09.547009] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547017] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547023] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.547033] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.547054] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.547144] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.547158] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.547165] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547172] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.547180] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:19.029 [2024-11-26 01:16:09.547194] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:19.029 [2024-11-26 01:16:09.547206] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547213] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547219] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.547229] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.547250] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.547334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.547345] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.547352] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547358] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.547367] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:19.029 [2024-11-26 01:16:09.547382] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547391] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547397] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.547407] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.547428] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.547512] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.547524] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.547530] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547536] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.547545] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:19.029 [2024-11-26 01:16:09.547553] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:19.029 [2024-11-26 01:16:09.547565] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:19.029 [2024-11-26 01:16:09.547675] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:19.029 [2024-11-26 01:16:09.547683] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:19.029 [2024-11-26 01:16:09.547706] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547714] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547720] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.547734] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.547756] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.547858] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.547870] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.547877] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547883] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.547891] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:19.029 [2024-11-26 01:16:09.547907] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547915] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.547921] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.547932] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.547952] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.548037] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.029 [2024-11-26 01:16:09.548049] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.029 [2024-11-26 01:16:09.548055] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.548061] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.029 [2024-11-26 01:16:09.548069] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:19.029 [2024-11-26 01:16:09.548077] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:19.029 [2024-11-26 01:16:09.548089] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:19.029 [2024-11-26 01:16:09.548103] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:19.029 [2024-11-26 01:16:09.548118] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.548126] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.548132] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.029 [2024-11-26 01:16:09.548142] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.029 [2024-11-26 01:16:09.548163] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.029 [2024-11-26 01:16:09.548325] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.029 [2024-11-26 01:16:09.548340] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.029 [2024-11-26 01:16:09.548347] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.548353] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xf25e10): datao=0, datal=4096, cccid=0 00:23:19.029 [2024-11-26 01:16:09.548360] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xfa5b30) on tqpair(0xf25e10): expected_datao=0, payload_size=4096 00:23:19.029 [2024-11-26 01:16:09.548372] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.029 [2024-11-26 01:16:09.548380] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.588766] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.295 [2024-11-26 01:16:09.588786] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.295 [2024-11-26 01:16:09.588798] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.588805] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.295 [2024-11-26 01:16:09.588818] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:19.295 [2024-11-26 01:16:09.588827] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:19.295 [2024-11-26 01:16:09.588834] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:19.295 [2024-11-26 01:16:09.588842] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:19.295 [2024-11-26 01:16:09.588850] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:19.295 [2024-11-26 01:16:09.588858] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:19.295 [2024-11-26 01:16:09.588877] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:19.295 [2024-11-26 01:16:09.588891] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.588899] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.588905] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.588916] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:19.295 [2024-11-26 01:16:09.588939] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.295 [2024-11-26 01:16:09.589036] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.295 [2024-11-26 01:16:09.589050] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.295 [2024-11-26 01:16:09.589057] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589063] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5b30) on tqpair=0xf25e10 00:23:19.295 [2024-11-26 01:16:09.589075] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589083] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589089] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.589098] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.295 [2024-11-26 01:16:09.589108] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589121] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.589129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.295 [2024-11-26 01:16:09.589139] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589145] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589151] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.589160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.295 [2024-11-26 01:16:09.589169] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589176] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589182] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.589194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.295 [2024-11-26 01:16:09.589204] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:19.295 [2024-11-26 01:16:09.589223] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:19.295 [2024-11-26 01:16:09.589235] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589242] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589248] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.589258] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.295 [2024-11-26 01:16:09.589296] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5b30, cid 0, qid 0 00:23:19.295 [2024-11-26 01:16:09.589307] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5c90, cid 1, qid 0 00:23:19.295 [2024-11-26 01:16:09.589315] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5df0, cid 2, qid 0 00:23:19.295 [2024-11-26 01:16:09.589322] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.295 [2024-11-26 01:16:09.589329] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa60b0, cid 4, qid 0 00:23:19.295 [2024-11-26 01:16:09.589458] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.295 [2024-11-26 01:16:09.589471] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.295 [2024-11-26 01:16:09.589477] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589483] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa60b0) on tqpair=0xf25e10 00:23:19.295 [2024-11-26 01:16:09.589492] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:19.295 [2024-11-26 01:16:09.589500] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:19.295 [2024-11-26 01:16:09.589518] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589527] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.589533] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.589543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.295 [2024-11-26 01:16:09.589564] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa60b0, cid 4, qid 0 00:23:19.295 [2024-11-26 01:16:09.589668] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.295 [2024-11-26 01:16:09.589683] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.295 [2024-11-26 01:16:09.593700] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.593708] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xf25e10): datao=0, datal=4096, cccid=4 00:23:19.295 [2024-11-26 01:16:09.593716] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xfa60b0) on tqpair(0xf25e10): expected_datao=0, payload_size=4096 00:23:19.295 [2024-11-26 01:16:09.593727] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.593735] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.593747] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.295 [2024-11-26 01:16:09.593756] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.295 [2024-11-26 01:16:09.593763] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.593769] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa60b0) on tqpair=0xf25e10 00:23:19.295 [2024-11-26 01:16:09.593791] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:19.295 [2024-11-26 01:16:09.593845] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.593856] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.295 [2024-11-26 01:16:09.593863] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xf25e10) 00:23:19.295 [2024-11-26 01:16:09.593873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.295 [2024-11-26 01:16:09.593885] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.593892] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.593898] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xf25e10) 00:23:19.296 [2024-11-26 01:16:09.593906] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.296 [2024-11-26 01:16:09.593934] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa60b0, cid 4, qid 0 00:23:19.296 [2024-11-26 01:16:09.593946] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa6210, cid 5, qid 0 00:23:19.296 [2024-11-26 01:16:09.594103] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.296 [2024-11-26 01:16:09.594118] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.296 [2024-11-26 01:16:09.594124] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.594130] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xf25e10): datao=0, datal=1024, cccid=4 00:23:19.296 [2024-11-26 01:16:09.594138] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xfa60b0) on tqpair(0xf25e10): expected_datao=0, payload_size=1024 00:23:19.296 [2024-11-26 01:16:09.594148] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.594155] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.594163] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.296 [2024-11-26 01:16:09.594172] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.296 [2024-11-26 01:16:09.594178] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.594184] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa6210) on tqpair=0xf25e10 00:23:19.296 [2024-11-26 01:16:09.634787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.296 [2024-11-26 01:16:09.634807] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.296 [2024-11-26 01:16:09.634814] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.634821] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa60b0) on tqpair=0xf25e10 00:23:19.296 [2024-11-26 01:16:09.634839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.634848] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.634854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xf25e10) 00:23:19.296 [2024-11-26 01:16:09.634866] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.296 [2024-11-26 01:16:09.634895] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa60b0, cid 4, qid 0 00:23:19.296 [2024-11-26 01:16:09.635038] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.296 [2024-11-26 01:16:09.635050] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.296 [2024-11-26 01:16:09.635056] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635063] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xf25e10): datao=0, datal=3072, cccid=4 00:23:19.296 [2024-11-26 01:16:09.635070] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xfa60b0) on tqpair(0xf25e10): expected_datao=0, payload_size=3072 00:23:19.296 [2024-11-26 01:16:09.635085] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635094] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635105] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.296 [2024-11-26 01:16:09.635115] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.296 [2024-11-26 01:16:09.635122] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635128] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa60b0) on tqpair=0xf25e10 00:23:19.296 [2024-11-26 01:16:09.635143] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635151] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635157] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xf25e10) 00:23:19.296 [2024-11-26 01:16:09.635167] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.296 [2024-11-26 01:16:09.635195] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa60b0, cid 4, qid 0 00:23:19.296 [2024-11-26 01:16:09.635301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.296 [2024-11-26 01:16:09.635313] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.296 [2024-11-26 01:16:09.635319] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635325] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xf25e10): datao=0, datal=8, cccid=4 00:23:19.296 [2024-11-26 01:16:09.635332] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xfa60b0) on tqpair(0xf25e10): expected_datao=0, payload_size=8 00:23:19.296 [2024-11-26 01:16:09.635342] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.635349] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.679700] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.296 [2024-11-26 01:16:09.679719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.296 [2024-11-26 01:16:09.679726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.296 [2024-11-26 01:16:09.679733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa60b0) on tqpair=0xf25e10 00:23:19.296 ===================================================== 00:23:19.296 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:19.296 ===================================================== 00:23:19.296 Controller Capabilities/Features 00:23:19.296 ================================ 00:23:19.296 Vendor ID: 0000 00:23:19.296 Subsystem Vendor ID: 0000 00:23:19.296 Serial Number: .................... 00:23:19.296 Model Number: ........................................ 00:23:19.296 Firmware Version: 24.01.1 00:23:19.296 Recommended Arb Burst: 0 00:23:19.296 IEEE OUI Identifier: 00 00 00 00:23:19.296 Multi-path I/O 00:23:19.296 May have multiple subsystem ports: No 00:23:19.296 May have multiple controllers: No 00:23:19.296 Associated with SR-IOV VF: No 00:23:19.296 Max Data Transfer Size: 131072 00:23:19.296 Max Number of Namespaces: 0 00:23:19.296 Max Number of I/O Queues: 1024 00:23:19.296 NVMe Specification Version (VS): 1.3 00:23:19.296 NVMe Specification Version (Identify): 1.3 00:23:19.296 Maximum Queue Entries: 128 00:23:19.296 Contiguous Queues Required: Yes 00:23:19.296 Arbitration Mechanisms Supported 00:23:19.296 Weighted Round Robin: Not Supported 00:23:19.296 Vendor Specific: Not Supported 00:23:19.296 Reset Timeout: 15000 ms 00:23:19.296 Doorbell Stride: 4 bytes 00:23:19.296 NVM Subsystem Reset: Not Supported 00:23:19.296 Command Sets Supported 00:23:19.296 NVM Command Set: Supported 00:23:19.296 Boot Partition: Not Supported 00:23:19.296 Memory Page Size Minimum: 4096 bytes 00:23:19.296 Memory Page Size Maximum: 4096 bytes 00:23:19.296 Persistent Memory Region: Not Supported 00:23:19.296 Optional Asynchronous Events Supported 00:23:19.296 Namespace Attribute Notices: Not Supported 00:23:19.296 Firmware Activation Notices: Not Supported 00:23:19.296 ANA Change Notices: Not Supported 00:23:19.296 PLE Aggregate Log Change Notices: Not Supported 00:23:19.296 LBA Status Info Alert Notices: Not Supported 00:23:19.296 EGE Aggregate Log Change Notices: Not Supported 00:23:19.296 Normal NVM Subsystem Shutdown event: Not Supported 00:23:19.296 Zone Descriptor Change Notices: Not Supported 00:23:19.296 Discovery Log Change Notices: Supported 00:23:19.296 Controller Attributes 00:23:19.296 128-bit Host Identifier: Not Supported 00:23:19.296 Non-Operational Permissive Mode: Not Supported 00:23:19.296 NVM Sets: Not Supported 00:23:19.296 Read Recovery Levels: Not Supported 00:23:19.296 Endurance Groups: Not Supported 00:23:19.296 Predictable Latency Mode: Not Supported 00:23:19.296 Traffic Based Keep ALive: Not Supported 00:23:19.296 Namespace Granularity: Not Supported 00:23:19.296 SQ Associations: Not Supported 00:23:19.296 UUID List: Not Supported 00:23:19.296 Multi-Domain Subsystem: Not Supported 00:23:19.296 Fixed Capacity Management: Not Supported 00:23:19.296 Variable Capacity Management: Not Supported 00:23:19.296 Delete Endurance Group: Not Supported 00:23:19.296 Delete NVM Set: Not Supported 00:23:19.296 Extended LBA Formats Supported: Not Supported 00:23:19.296 Flexible Data Placement Supported: Not Supported 00:23:19.296 00:23:19.296 Controller Memory Buffer Support 00:23:19.296 ================================ 00:23:19.296 Supported: No 00:23:19.296 00:23:19.296 Persistent Memory Region Support 00:23:19.296 ================================ 00:23:19.296 Supported: No 00:23:19.296 00:23:19.296 Admin Command Set Attributes 00:23:19.296 ============================ 00:23:19.296 Security Send/Receive: Not Supported 00:23:19.296 Format NVM: Not Supported 00:23:19.296 Firmware Activate/Download: Not Supported 00:23:19.296 Namespace Management: Not Supported 00:23:19.296 Device Self-Test: Not Supported 00:23:19.296 Directives: Not Supported 00:23:19.296 NVMe-MI: Not Supported 00:23:19.296 Virtualization Management: Not Supported 00:23:19.296 Doorbell Buffer Config: Not Supported 00:23:19.296 Get LBA Status Capability: Not Supported 00:23:19.296 Command & Feature Lockdown Capability: Not Supported 00:23:19.296 Abort Command Limit: 1 00:23:19.296 Async Event Request Limit: 4 00:23:19.296 Number of Firmware Slots: N/A 00:23:19.296 Firmware Slot 1 Read-Only: N/A 00:23:19.296 Firmware Activation Without Reset: N/A 00:23:19.296 Multiple Update Detection Support: N/A 00:23:19.296 Firmware Update Granularity: No Information Provided 00:23:19.296 Per-Namespace SMART Log: No 00:23:19.296 Asymmetric Namespace Access Log Page: Not Supported 00:23:19.296 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:19.296 Command Effects Log Page: Not Supported 00:23:19.296 Get Log Page Extended Data: Supported 00:23:19.296 Telemetry Log Pages: Not Supported 00:23:19.296 Persistent Event Log Pages: Not Supported 00:23:19.296 Supported Log Pages Log Page: May Support 00:23:19.296 Commands Supported & Effects Log Page: Not Supported 00:23:19.296 Feature Identifiers & Effects Log Page:May Support 00:23:19.296 NVMe-MI Commands & Effects Log Page: May Support 00:23:19.296 Data Area 4 for Telemetry Log: Not Supported 00:23:19.296 Error Log Page Entries Supported: 128 00:23:19.296 Keep Alive: Not Supported 00:23:19.296 00:23:19.296 NVM Command Set Attributes 00:23:19.296 ========================== 00:23:19.296 Submission Queue Entry Size 00:23:19.296 Max: 1 00:23:19.296 Min: 1 00:23:19.296 Completion Queue Entry Size 00:23:19.296 Max: 1 00:23:19.296 Min: 1 00:23:19.296 Number of Namespaces: 0 00:23:19.296 Compare Command: Not Supported 00:23:19.296 Write Uncorrectable Command: Not Supported 00:23:19.296 Dataset Management Command: Not Supported 00:23:19.296 Write Zeroes Command: Not Supported 00:23:19.296 Set Features Save Field: Not Supported 00:23:19.296 Reservations: Not Supported 00:23:19.296 Timestamp: Not Supported 00:23:19.296 Copy: Not Supported 00:23:19.296 Volatile Write Cache: Not Present 00:23:19.296 Atomic Write Unit (Normal): 1 00:23:19.296 Atomic Write Unit (PFail): 1 00:23:19.296 Atomic Compare & Write Unit: 1 00:23:19.296 Fused Compare & Write: Supported 00:23:19.296 Scatter-Gather List 00:23:19.296 SGL Command Set: Supported 00:23:19.296 SGL Keyed: Supported 00:23:19.296 SGL Bit Bucket Descriptor: Not Supported 00:23:19.296 SGL Metadata Pointer: Not Supported 00:23:19.296 Oversized SGL: Not Supported 00:23:19.296 SGL Metadata Address: Not Supported 00:23:19.296 SGL Offset: Supported 00:23:19.296 Transport SGL Data Block: Not Supported 00:23:19.296 Replay Protected Memory Block: Not Supported 00:23:19.296 00:23:19.296 Firmware Slot Information 00:23:19.296 ========================= 00:23:19.296 Active slot: 0 00:23:19.296 00:23:19.296 00:23:19.296 Error Log 00:23:19.296 ========= 00:23:19.296 00:23:19.296 Active Namespaces 00:23:19.296 ================= 00:23:19.296 Discovery Log Page 00:23:19.296 ================== 00:23:19.296 Generation Counter: 2 00:23:19.296 Number of Records: 2 00:23:19.296 Record Format: 0 00:23:19.296 00:23:19.296 Discovery Log Entry 0 00:23:19.296 ---------------------- 00:23:19.296 Transport Type: 3 (TCP) 00:23:19.296 Address Family: 1 (IPv4) 00:23:19.296 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:19.296 Entry Flags: 00:23:19.296 Duplicate Returned Information: 1 00:23:19.296 Explicit Persistent Connection Support for Discovery: 1 00:23:19.296 Transport Requirements: 00:23:19.296 Secure Channel: Not Required 00:23:19.296 Port ID: 0 (0x0000) 00:23:19.296 Controller ID: 65535 (0xffff) 00:23:19.296 Admin Max SQ Size: 128 00:23:19.296 Transport Service Identifier: 4420 00:23:19.296 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:19.296 Transport Address: 10.0.0.2 00:23:19.296 Discovery Log Entry 1 00:23:19.296 ---------------------- 00:23:19.296 Transport Type: 3 (TCP) 00:23:19.296 Address Family: 1 (IPv4) 00:23:19.296 Subsystem Type: 2 (NVM Subsystem) 00:23:19.296 Entry Flags: 00:23:19.296 Duplicate Returned Information: 0 00:23:19.296 Explicit Persistent Connection Support for Discovery: 0 00:23:19.296 Transport Requirements: 00:23:19.296 Secure Channel: Not Required 00:23:19.296 Port ID: 0 (0x0000) 00:23:19.297 Controller ID: 65535 (0xffff) 00:23:19.297 Admin Max SQ Size: 128 00:23:19.297 Transport Service Identifier: 4420 00:23:19.297 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:19.297 Transport Address: 10.0.0.2 [2024-11-26 01:16:09.679858] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:19.297 [2024-11-26 01:16:09.679883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.297 [2024-11-26 01:16:09.679895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.297 [2024-11-26 01:16:09.679905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.297 [2024-11-26 01:16:09.679914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.297 [2024-11-26 01:16:09.679927] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.679934] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.679941] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.679951] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.679977] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.680057] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.680070] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.680076] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680087] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.680098] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680106] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680112] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.680122] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.680148] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.680261] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.680272] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.680279] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680285] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.680293] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:19.297 [2024-11-26 01:16:09.680300] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:19.297 [2024-11-26 01:16:09.680316] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680325] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680331] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.680341] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.680361] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.680455] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.680470] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.680477] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680483] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.680500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680509] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680515] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.680525] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.680546] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.680629] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.680644] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.680650] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680657] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.680673] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680682] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680696] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.680707] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.680728] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.680816] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.680831] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.680837] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680844] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.680860] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680869] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.680875] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.680885] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.680906] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.680986] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.680998] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.681004] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681011] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.681026] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681035] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681041] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.681051] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.681071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.681163] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.681178] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.681184] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681190] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.681206] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681215] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681221] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.681231] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.681252] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.681340] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.681355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.681361] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681368] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.681383] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681392] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681398] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.681408] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.681429] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.681511] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.681523] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.681534] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681541] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.681557] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681565] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681572] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.681582] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.681603] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.681697] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.681711] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.681717] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681724] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.681739] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681748] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681754] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.681765] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.681786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.681869] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.681881] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.681887] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681894] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.681909] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681918] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.681924] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.681934] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.681955] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.682049] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.682064] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.682070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682077] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.682093] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682101] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682107] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.682118] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.682138] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.682224] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.682235] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.682242] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682252] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.682268] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682277] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682283] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.682294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.682315] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.682398] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.682409] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.682416] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682422] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.682437] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682446] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682452] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.682462] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.682483] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.682572] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.682586] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.682593] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682599] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.682615] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682624] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682630] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.297 [2024-11-26 01:16:09.682640] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.297 [2024-11-26 01:16:09.682660] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.297 [2024-11-26 01:16:09.682759] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.297 [2024-11-26 01:16:09.682774] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.297 [2024-11-26 01:16:09.682781] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682787] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.297 [2024-11-26 01:16:09.682803] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.297 [2024-11-26 01:16:09.682812] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.682818] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.298 [2024-11-26 01:16:09.682828] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.682849] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.298 [2024-11-26 01:16:09.682937] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.682952] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.682958] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.682965] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.298 [2024-11-26 01:16:09.682985] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.682994] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683001] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.298 [2024-11-26 01:16:09.683011] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.683031] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.298 [2024-11-26 01:16:09.683116] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.683130] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.683137] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683143] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.298 [2024-11-26 01:16:09.683159] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683168] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683174] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.298 [2024-11-26 01:16:09.683184] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.683204] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.298 [2024-11-26 01:16:09.683285] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.683300] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.683307] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683313] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.298 [2024-11-26 01:16:09.683329] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683338] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683344] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.298 [2024-11-26 01:16:09.683354] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.683374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.298 [2024-11-26 01:16:09.683461] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.683476] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.683483] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683489] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.298 [2024-11-26 01:16:09.683505] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683513] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683519] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.298 [2024-11-26 01:16:09.683529] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.683550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.298 [2024-11-26 01:16:09.683641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.683656] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.683662] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.683668] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.298 [2024-11-26 01:16:09.687710] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.687725] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.687732] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xf25e10) 00:23:19.298 [2024-11-26 01:16:09.687742] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.687765] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xfa5f50, cid 3, qid 0 00:23:19.298 [2024-11-26 01:16:09.687850] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.687863] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.687869] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.687876] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xfa5f50) on tqpair=0xf25e10 00:23:19.298 [2024-11-26 01:16:09.687889] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:23:19.298 00:23:19.298 01:16:09 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:19.298 [2024-11-26 01:16:09.721308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:19.298 [2024-11-26 01:16:09.721349] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1126662 ] 00:23:19.298 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.298 [2024-11-26 01:16:09.753409] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:19.298 [2024-11-26 01:16:09.753462] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:19.298 [2024-11-26 01:16:09.753472] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:19.298 [2024-11-26 01:16:09.753487] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:19.298 [2024-11-26 01:16:09.753499] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:19.298 [2024-11-26 01:16:09.756722] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:19.298 [2024-11-26 01:16:09.756786] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x111ae10 0 00:23:19.298 [2024-11-26 01:16:09.764715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:19.298 [2024-11-26 01:16:09.764734] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:19.298 [2024-11-26 01:16:09.764742] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:19.298 [2024-11-26 01:16:09.764748] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:19.298 [2024-11-26 01:16:09.764787] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.764798] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.764805] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.298 [2024-11-26 01:16:09.764818] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:19.298 [2024-11-26 01:16:09.764844] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.298 [2024-11-26 01:16:09.772719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.772736] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.772748] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.772756] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.298 [2024-11-26 01:16:09.772774] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:19.298 [2024-11-26 01:16:09.772784] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:19.298 [2024-11-26 01:16:09.772793] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:19.298 [2024-11-26 01:16:09.772808] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.772816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.772822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.298 [2024-11-26 01:16:09.772833] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.772856] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.298 [2024-11-26 01:16:09.772972] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.772987] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.772994] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773000] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.298 [2024-11-26 01:16:09.773010] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:19.298 [2024-11-26 01:16:09.773023] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:19.298 [2024-11-26 01:16:09.773035] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773042] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773048] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.298 [2024-11-26 01:16:09.773059] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.773080] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.298 [2024-11-26 01:16:09.773164] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.773176] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.773182] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773189] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.298 [2024-11-26 01:16:09.773198] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:19.298 [2024-11-26 01:16:09.773212] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:19.298 [2024-11-26 01:16:09.773223] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773230] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773237] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.298 [2024-11-26 01:16:09.773247] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.773267] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.298 [2024-11-26 01:16:09.773354] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.773369] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.298 [2024-11-26 01:16:09.773375] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773401] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.298 [2024-11-26 01:16:09.773411] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:19.298 [2024-11-26 01:16:09.773428] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773436] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.298 [2024-11-26 01:16:09.773442] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.298 [2024-11-26 01:16:09.773469] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.298 [2024-11-26 01:16:09.773491] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.298 [2024-11-26 01:16:09.773576] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.298 [2024-11-26 01:16:09.773588] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.773594] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.773601] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.773609] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:19.299 [2024-11-26 01:16:09.773617] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:19.299 [2024-11-26 01:16:09.773630] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:19.299 [2024-11-26 01:16:09.773740] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:19.299 [2024-11-26 01:16:09.773749] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:19.299 [2024-11-26 01:16:09.773761] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.773768] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.773775] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.773785] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.299 [2024-11-26 01:16:09.773806] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.299 [2024-11-26 01:16:09.773918] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.773933] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.773940] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.773946] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.773955] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:19.299 [2024-11-26 01:16:09.773987] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.773996] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774002] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774013] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.299 [2024-11-26 01:16:09.774033] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.299 [2024-11-26 01:16:09.774119] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.774134] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.774145] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774152] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.774160] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:19.299 [2024-11-26 01:16:09.774168] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.774181] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:19.299 [2024-11-26 01:16:09.774195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.774209] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774216] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774222] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774233] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.299 [2024-11-26 01:16:09.774254] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.299 [2024-11-26 01:16:09.774383] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.299 [2024-11-26 01:16:09.774395] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.299 [2024-11-26 01:16:09.774401] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774408] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=4096, cccid=0 00:23:19.299 [2024-11-26 01:16:09.774415] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119ab30) on tqpair(0x111ae10): expected_datao=0, payload_size=4096 00:23:19.299 [2024-11-26 01:16:09.774440] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774448] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774459] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.774468] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.774474] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774496] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.774508] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:19.299 [2024-11-26 01:16:09.774517] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:19.299 [2024-11-26 01:16:09.774524] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:19.299 [2024-11-26 01:16:09.774530] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:19.299 [2024-11-26 01:16:09.774538] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:19.299 [2024-11-26 01:16:09.774546] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.774565] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.774578] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774585] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774591] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774602] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:19.299 [2024-11-26 01:16:09.774627] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.299 [2024-11-26 01:16:09.774787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.774803] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.774810] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774816] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119ab30) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.774827] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774834] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774841] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774850] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.299 [2024-11-26 01:16:09.774860] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774867] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774873] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774881] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.299 [2024-11-26 01:16:09.774891] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774897] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774903] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.299 [2024-11-26 01:16:09.774921] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774928] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.774949] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.774958] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.299 [2024-11-26 01:16:09.774966] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.774985] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.774997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775004] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775010] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.775019] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.299 [2024-11-26 01:16:09.775041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ab30, cid 0, qid 0 00:23:19.299 [2024-11-26 01:16:09.775067] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119ac90, cid 1, qid 0 00:23:19.299 [2024-11-26 01:16:09.775074] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119adf0, cid 2, qid 0 00:23:19.299 [2024-11-26 01:16:09.775081] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.299 [2024-11-26 01:16:09.775089] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.299 [2024-11-26 01:16:09.775208] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.775223] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.775230] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775237] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.775246] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:19.299 [2024-11-26 01:16:09.775254] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775268] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775282] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775301] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.775317] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:19.299 [2024-11-26 01:16:09.775338] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.299 [2024-11-26 01:16:09.775435] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.775450] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.775456] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.775529] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775547] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775561] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775568] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775574] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.775584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.299 [2024-11-26 01:16:09.775605] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.299 [2024-11-26 01:16:09.775705] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.299 [2024-11-26 01:16:09.775719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.299 [2024-11-26 01:16:09.775725] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775732] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=4096, cccid=4 00:23:19.299 [2024-11-26 01:16:09.775739] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b0b0) on tqpair(0x111ae10): expected_datao=0, payload_size=4096 00:23:19.299 [2024-11-26 01:16:09.775756] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775765] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.775790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.775797] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775803] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.299 [2024-11-26 01:16:09.775828] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:19.299 [2024-11-26 01:16:09.775848] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775866] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:19.299 [2024-11-26 01:16:09.775895] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775902] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.775908] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.299 [2024-11-26 01:16:09.775919] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.299 [2024-11-26 01:16:09.775940] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.299 [2024-11-26 01:16:09.776067] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.299 [2024-11-26 01:16:09.776079] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.299 [2024-11-26 01:16:09.776085] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.776091] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=4096, cccid=4 00:23:19.299 [2024-11-26 01:16:09.776099] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b0b0) on tqpair(0x111ae10): expected_datao=0, payload_size=4096 00:23:19.299 [2024-11-26 01:16:09.776115] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.776124] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.776138] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.299 [2024-11-26 01:16:09.776149] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.299 [2024-11-26 01:16:09.776155] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.299 [2024-11-26 01:16:09.776161] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.776185] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776204] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776217] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776225] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776231] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.776241] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.776277] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.300 [2024-11-26 01:16:09.776385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.300 [2024-11-26 01:16:09.776397] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.300 [2024-11-26 01:16:09.776404] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776410] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=4096, cccid=4 00:23:19.300 [2024-11-26 01:16:09.776417] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b0b0) on tqpair(0x111ae10): expected_datao=0, payload_size=4096 00:23:19.300 [2024-11-26 01:16:09.776434] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776442] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776454] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.776468] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.776475] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776481] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.776495] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776510] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776524] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776535] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776544] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776552] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:19.300 [2024-11-26 01:16:09.776560] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:19.300 [2024-11-26 01:16:09.776568] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:19.300 [2024-11-26 01:16:09.776587] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776596] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776602] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.776628] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.776638] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776645] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.776651] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.776659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:19.300 [2024-11-26 01:16:09.776684] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.300 [2024-11-26 01:16:09.780721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b210, cid 5, qid 0 00:23:19.300 [2024-11-26 01:16:09.780735] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.780745] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.780751] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.780757] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.780769] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.780777] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.780783] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.780789] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b210) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.780806] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.780815] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.780821] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.780831] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.780857] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b210, cid 5, qid 0 00:23:19.300 [2024-11-26 01:16:09.780972] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.780984] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.780991] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.780997] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b210) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.781014] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781022] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781028] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.781038] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.781059] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b210, cid 5, qid 0 00:23:19.300 [2024-11-26 01:16:09.781154] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.781166] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.781172] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781179] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b210) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.781195] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781203] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.781220] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.781240] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b210, cid 5, qid 0 00:23:19.300 [2024-11-26 01:16:09.781328] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.781343] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.781349] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781356] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b210) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.781376] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781386] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781392] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.781402] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.781414] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781421] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781427] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.781437] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.781448] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781455] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781462] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.781471] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.781487] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781495] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781501] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x111ae10) 00:23:19.300 [2024-11-26 01:16:09.781511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.300 [2024-11-26 01:16:09.781533] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b210, cid 5, qid 0 00:23:19.300 [2024-11-26 01:16:09.781544] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b0b0, cid 4, qid 0 00:23:19.300 [2024-11-26 01:16:09.781551] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b370, cid 6, qid 0 00:23:19.300 [2024-11-26 01:16:09.781559] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b4d0, cid 7, qid 0 00:23:19.300 [2024-11-26 01:16:09.781728] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.300 [2024-11-26 01:16:09.781743] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.300 [2024-11-26 01:16:09.781750] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781756] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=8192, cccid=5 00:23:19.300 [2024-11-26 01:16:09.781763] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b210) on tqpair(0x111ae10): expected_datao=0, payload_size=8192 00:23:19.300 [2024-11-26 01:16:09.781813] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781823] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781832] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.300 [2024-11-26 01:16:09.781840] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.300 [2024-11-26 01:16:09.781846] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781853] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=512, cccid=4 00:23:19.300 [2024-11-26 01:16:09.781860] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b0b0) on tqpair(0x111ae10): expected_datao=0, payload_size=512 00:23:19.300 [2024-11-26 01:16:09.781870] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781876] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781885] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.300 [2024-11-26 01:16:09.781893] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.300 [2024-11-26 01:16:09.781899] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781921] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=512, cccid=6 00:23:19.300 [2024-11-26 01:16:09.781928] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b370) on tqpair(0x111ae10): expected_datao=0, payload_size=512 00:23:19.300 [2024-11-26 01:16:09.781938] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781945] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781953] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:19.300 [2024-11-26 01:16:09.781961] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:19.300 [2024-11-26 01:16:09.781967] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.781973] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x111ae10): datao=0, datal=4096, cccid=7 00:23:19.300 [2024-11-26 01:16:09.781980] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x119b4d0) on tqpair(0x111ae10): expected_datao=0, payload_size=4096 00:23:19.300 [2024-11-26 01:16:09.781989] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.782000] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.782012] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.782021] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.782027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.782033] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b210) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.782053] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.782064] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.782070] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.782076] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b0b0) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.782090] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.782100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.782106] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.782112] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b370) on tqpair=0x111ae10 00:23:19.300 [2024-11-26 01:16:09.782123] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.300 [2024-11-26 01:16:09.782132] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.300 [2024-11-26 01:16:09.782138] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.300 [2024-11-26 01:16:09.782144] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b4d0) on tqpair=0x111ae10 00:23:19.300 ===================================================== 00:23:19.300 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:19.300 ===================================================== 00:23:19.300 Controller Capabilities/Features 00:23:19.300 ================================ 00:23:19.300 Vendor ID: 8086 00:23:19.300 Subsystem Vendor ID: 8086 00:23:19.300 Serial Number: SPDK00000000000001 00:23:19.300 Model Number: SPDK bdev Controller 00:23:19.300 Firmware Version: 24.01.1 00:23:19.300 Recommended Arb Burst: 6 00:23:19.300 IEEE OUI Identifier: e4 d2 5c 00:23:19.300 Multi-path I/O 00:23:19.300 May have multiple subsystem ports: Yes 00:23:19.300 May have multiple controllers: Yes 00:23:19.300 Associated with SR-IOV VF: No 00:23:19.300 Max Data Transfer Size: 131072 00:23:19.300 Max Number of Namespaces: 32 00:23:19.300 Max Number of I/O Queues: 127 00:23:19.300 NVMe Specification Version (VS): 1.3 00:23:19.300 NVMe Specification Version (Identify): 1.3 00:23:19.300 Maximum Queue Entries: 128 00:23:19.300 Contiguous Queues Required: Yes 00:23:19.300 Arbitration Mechanisms Supported 00:23:19.300 Weighted Round Robin: Not Supported 00:23:19.300 Vendor Specific: Not Supported 00:23:19.300 Reset Timeout: 15000 ms 00:23:19.300 Doorbell Stride: 4 bytes 00:23:19.300 NVM Subsystem Reset: Not Supported 00:23:19.300 Command Sets Supported 00:23:19.300 NVM Command Set: Supported 00:23:19.300 Boot Partition: Not Supported 00:23:19.301 Memory Page Size Minimum: 4096 bytes 00:23:19.301 Memory Page Size Maximum: 4096 bytes 00:23:19.301 Persistent Memory Region: Not Supported 00:23:19.301 Optional Asynchronous Events Supported 00:23:19.301 Namespace Attribute Notices: Supported 00:23:19.301 Firmware Activation Notices: Not Supported 00:23:19.301 ANA Change Notices: Not Supported 00:23:19.301 PLE Aggregate Log Change Notices: Not Supported 00:23:19.301 LBA Status Info Alert Notices: Not Supported 00:23:19.301 EGE Aggregate Log Change Notices: Not Supported 00:23:19.301 Normal NVM Subsystem Shutdown event: Not Supported 00:23:19.301 Zone Descriptor Change Notices: Not Supported 00:23:19.301 Discovery Log Change Notices: Not Supported 00:23:19.301 Controller Attributes 00:23:19.301 128-bit Host Identifier: Supported 00:23:19.301 Non-Operational Permissive Mode: Not Supported 00:23:19.301 NVM Sets: Not Supported 00:23:19.301 Read Recovery Levels: Not Supported 00:23:19.301 Endurance Groups: Not Supported 00:23:19.301 Predictable Latency Mode: Not Supported 00:23:19.301 Traffic Based Keep ALive: Not Supported 00:23:19.301 Namespace Granularity: Not Supported 00:23:19.301 SQ Associations: Not Supported 00:23:19.301 UUID List: Not Supported 00:23:19.301 Multi-Domain Subsystem: Not Supported 00:23:19.301 Fixed Capacity Management: Not Supported 00:23:19.301 Variable Capacity Management: Not Supported 00:23:19.301 Delete Endurance Group: Not Supported 00:23:19.301 Delete NVM Set: Not Supported 00:23:19.301 Extended LBA Formats Supported: Not Supported 00:23:19.301 Flexible Data Placement Supported: Not Supported 00:23:19.301 00:23:19.301 Controller Memory Buffer Support 00:23:19.301 ================================ 00:23:19.301 Supported: No 00:23:19.301 00:23:19.301 Persistent Memory Region Support 00:23:19.301 ================================ 00:23:19.301 Supported: No 00:23:19.301 00:23:19.301 Admin Command Set Attributes 00:23:19.301 ============================ 00:23:19.301 Security Send/Receive: Not Supported 00:23:19.301 Format NVM: Not Supported 00:23:19.301 Firmware Activate/Download: Not Supported 00:23:19.301 Namespace Management: Not Supported 00:23:19.301 Device Self-Test: Not Supported 00:23:19.301 Directives: Not Supported 00:23:19.301 NVMe-MI: Not Supported 00:23:19.301 Virtualization Management: Not Supported 00:23:19.301 Doorbell Buffer Config: Not Supported 00:23:19.301 Get LBA Status Capability: Not Supported 00:23:19.301 Command & Feature Lockdown Capability: Not Supported 00:23:19.301 Abort Command Limit: 4 00:23:19.301 Async Event Request Limit: 4 00:23:19.301 Number of Firmware Slots: N/A 00:23:19.301 Firmware Slot 1 Read-Only: N/A 00:23:19.301 Firmware Activation Without Reset: N/A 00:23:19.301 Multiple Update Detection Support: N/A 00:23:19.301 Firmware Update Granularity: No Information Provided 00:23:19.301 Per-Namespace SMART Log: No 00:23:19.301 Asymmetric Namespace Access Log Page: Not Supported 00:23:19.301 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:19.301 Command Effects Log Page: Supported 00:23:19.301 Get Log Page Extended Data: Supported 00:23:19.301 Telemetry Log Pages: Not Supported 00:23:19.301 Persistent Event Log Pages: Not Supported 00:23:19.301 Supported Log Pages Log Page: May Support 00:23:19.301 Commands Supported & Effects Log Page: Not Supported 00:23:19.301 Feature Identifiers & Effects Log Page:May Support 00:23:19.301 NVMe-MI Commands & Effects Log Page: May Support 00:23:19.301 Data Area 4 for Telemetry Log: Not Supported 00:23:19.301 Error Log Page Entries Supported: 128 00:23:19.301 Keep Alive: Supported 00:23:19.301 Keep Alive Granularity: 10000 ms 00:23:19.301 00:23:19.301 NVM Command Set Attributes 00:23:19.301 ========================== 00:23:19.301 Submission Queue Entry Size 00:23:19.301 Max: 64 00:23:19.301 Min: 64 00:23:19.301 Completion Queue Entry Size 00:23:19.301 Max: 16 00:23:19.301 Min: 16 00:23:19.301 Number of Namespaces: 32 00:23:19.301 Compare Command: Supported 00:23:19.301 Write Uncorrectable Command: Not Supported 00:23:19.301 Dataset Management Command: Supported 00:23:19.301 Write Zeroes Command: Supported 00:23:19.301 Set Features Save Field: Not Supported 00:23:19.301 Reservations: Supported 00:23:19.301 Timestamp: Not Supported 00:23:19.301 Copy: Supported 00:23:19.301 Volatile Write Cache: Present 00:23:19.301 Atomic Write Unit (Normal): 1 00:23:19.301 Atomic Write Unit (PFail): 1 00:23:19.301 Atomic Compare & Write Unit: 1 00:23:19.301 Fused Compare & Write: Supported 00:23:19.301 Scatter-Gather List 00:23:19.301 SGL Command Set: Supported 00:23:19.301 SGL Keyed: Supported 00:23:19.301 SGL Bit Bucket Descriptor: Not Supported 00:23:19.301 SGL Metadata Pointer: Not Supported 00:23:19.301 Oversized SGL: Not Supported 00:23:19.301 SGL Metadata Address: Not Supported 00:23:19.301 SGL Offset: Supported 00:23:19.301 Transport SGL Data Block: Not Supported 00:23:19.301 Replay Protected Memory Block: Not Supported 00:23:19.301 00:23:19.301 Firmware Slot Information 00:23:19.301 ========================= 00:23:19.301 Active slot: 1 00:23:19.301 Slot 1 Firmware Revision: 24.01.1 00:23:19.301 00:23:19.301 00:23:19.301 Commands Supported and Effects 00:23:19.301 ============================== 00:23:19.301 Admin Commands 00:23:19.301 -------------- 00:23:19.301 Get Log Page (02h): Supported 00:23:19.301 Identify (06h): Supported 00:23:19.301 Abort (08h): Supported 00:23:19.301 Set Features (09h): Supported 00:23:19.301 Get Features (0Ah): Supported 00:23:19.301 Asynchronous Event Request (0Ch): Supported 00:23:19.301 Keep Alive (18h): Supported 00:23:19.301 I/O Commands 00:23:19.301 ------------ 00:23:19.301 Flush (00h): Supported LBA-Change 00:23:19.301 Write (01h): Supported LBA-Change 00:23:19.301 Read (02h): Supported 00:23:19.301 Compare (05h): Supported 00:23:19.301 Write Zeroes (08h): Supported LBA-Change 00:23:19.301 Dataset Management (09h): Supported LBA-Change 00:23:19.301 Copy (19h): Supported LBA-Change 00:23:19.301 Unknown (79h): Supported LBA-Change 00:23:19.301 Unknown (7Ah): Supported 00:23:19.301 00:23:19.301 Error Log 00:23:19.301 ========= 00:23:19.301 00:23:19.301 Arbitration 00:23:19.301 =========== 00:23:19.301 Arbitration Burst: 1 00:23:19.301 00:23:19.301 Power Management 00:23:19.301 ================ 00:23:19.301 Number of Power States: 1 00:23:19.301 Current Power State: Power State #0 00:23:19.301 Power State #0: 00:23:19.301 Max Power: 0.00 W 00:23:19.301 Non-Operational State: Operational 00:23:19.301 Entry Latency: Not Reported 00:23:19.301 Exit Latency: Not Reported 00:23:19.301 Relative Read Throughput: 0 00:23:19.301 Relative Read Latency: 0 00:23:19.301 Relative Write Throughput: 0 00:23:19.301 Relative Write Latency: 0 00:23:19.301 Idle Power: Not Reported 00:23:19.301 Active Power: Not Reported 00:23:19.301 Non-Operational Permissive Mode: Not Supported 00:23:19.301 00:23:19.301 Health Information 00:23:19.301 ================== 00:23:19.301 Critical Warnings: 00:23:19.301 Available Spare Space: OK 00:23:19.301 Temperature: OK 00:23:19.301 Device Reliability: OK 00:23:19.301 Read Only: No 00:23:19.301 Volatile Memory Backup: OK 00:23:19.301 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:19.301 Temperature Threshold: [2024-11-26 01:16:09.782266] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782277] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782283] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x111ae10) 00:23:19.301 [2024-11-26 01:16:09.782293] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.301 [2024-11-26 01:16:09.782316] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119b4d0, cid 7, qid 0 00:23:19.301 [2024-11-26 01:16:09.782435] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.301 [2024-11-26 01:16:09.782450] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.301 [2024-11-26 01:16:09.782457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119b4d0) on tqpair=0x111ae10 00:23:19.301 [2024-11-26 01:16:09.782505] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:19.301 [2024-11-26 01:16:09.782526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.301 [2024-11-26 01:16:09.782538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.301 [2024-11-26 01:16:09.782547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.301 [2024-11-26 01:16:09.782556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:19.301 [2024-11-26 01:16:09.782569] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782582] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.301 [2024-11-26 01:16:09.782593] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.301 [2024-11-26 01:16:09.782615] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.301 [2024-11-26 01:16:09.782767] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.301 [2024-11-26 01:16:09.782784] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.301 [2024-11-26 01:16:09.782790] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782797] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.301 [2024-11-26 01:16:09.782809] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.301 [2024-11-26 01:16:09.782833] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.301 [2024-11-26 01:16:09.782859] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.301 [2024-11-26 01:16:09.782967] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.301 [2024-11-26 01:16:09.782981] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.301 [2024-11-26 01:16:09.782988] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.782994] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.301 [2024-11-26 01:16:09.783003] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:19.301 [2024-11-26 01:16:09.783010] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:19.301 [2024-11-26 01:16:09.783026] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.783034] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.783040] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.301 [2024-11-26 01:16:09.783051] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.301 [2024-11-26 01:16:09.783071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.301 [2024-11-26 01:16:09.783159] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.301 [2024-11-26 01:16:09.783170] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.301 [2024-11-26 01:16:09.783177] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.783183] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.301 [2024-11-26 01:16:09.783200] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.783209] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.301 [2024-11-26 01:16:09.783215] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.301 [2024-11-26 01:16:09.783225] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.301 [2024-11-26 01:16:09.783245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.301 [2024-11-26 01:16:09.783331] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.301 [2024-11-26 01:16:09.783343] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.783349] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783355] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.783372] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783381] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783387] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.783397] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.783422] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.783505] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.783520] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.783526] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783533] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.783550] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783559] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783565] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.783575] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.783596] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.783681] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.783722] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.783730] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783737] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.783755] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783764] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783771] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.783781] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.783803] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.783893] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.783908] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.783914] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783920] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.783937] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783946] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.783952] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.783963] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.783983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.784066] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.784078] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.784084] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784091] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.784107] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784116] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784122] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.784132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.784157] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.784245] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.784257] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.784263] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784269] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.784286] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784294] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784300] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.784311] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.784331] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.784418] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.784430] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.784437] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.784460] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784468] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784475] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.784485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.784505] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.784587] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.784599] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.784605] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784612] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.784628] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784637] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.784643] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.784653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.784673] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.788711] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.788728] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.788735] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.788741] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.788760] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.788769] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.788775] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x111ae10) 00:23:19.302 [2024-11-26 01:16:09.788785] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:19.302 [2024-11-26 01:16:09.788806] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x119af50, cid 3, qid 0 00:23:19.302 [2024-11-26 01:16:09.788916] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:19.302 [2024-11-26 01:16:09.788929] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:19.302 [2024-11-26 01:16:09.788935] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:19.302 [2024-11-26 01:16:09.788942] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x119af50) on tqpair=0x111ae10 00:23:19.302 [2024-11-26 01:16:09.788956] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:19.302 0 Kelvin (-273 Celsius) 00:23:19.302 Available Spare: 0% 00:23:19.302 Available Spare Threshold: 0% 00:23:19.302 Life Percentage Used: 0% 00:23:19.302 Data Units Read: 0 00:23:19.302 Data Units Written: 0 00:23:19.302 Host Read Commands: 0 00:23:19.302 Host Write Commands: 0 00:23:19.302 Controller Busy Time: 0 minutes 00:23:19.302 Power Cycles: 0 00:23:19.302 Power On Hours: 0 hours 00:23:19.302 Unsafe Shutdowns: 0 00:23:19.302 Unrecoverable Media Errors: 0 00:23:19.302 Lifetime Error Log Entries: 0 00:23:19.302 Warning Temperature Time: 0 minutes 00:23:19.302 Critical Temperature Time: 0 minutes 00:23:19.302 00:23:19.302 Number of Queues 00:23:19.302 ================ 00:23:19.302 Number of I/O Submission Queues: 127 00:23:19.302 Number of I/O Completion Queues: 127 00:23:19.302 00:23:19.302 Active Namespaces 00:23:19.302 ================= 00:23:19.302 Namespace ID:1 00:23:19.302 Error Recovery Timeout: Unlimited 00:23:19.302 Command Set Identifier: NVM (00h) 00:23:19.302 Deallocate: Supported 00:23:19.302 Deallocated/Unwritten Error: Not Supported 00:23:19.302 Deallocated Read Value: Unknown 00:23:19.302 Deallocate in Write Zeroes: Not Supported 00:23:19.302 Deallocated Guard Field: 0xFFFF 00:23:19.302 Flush: Supported 00:23:19.302 Reservation: Supported 00:23:19.302 Namespace Sharing Capabilities: Multiple Controllers 00:23:19.302 Size (in LBAs): 131072 (0GiB) 00:23:19.302 Capacity (in LBAs): 131072 (0GiB) 00:23:19.302 Utilization (in LBAs): 131072 (0GiB) 00:23:19.302 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:19.302 EUI64: ABCDEF0123456789 00:23:19.302 UUID: 4c8c88e3-8460-4713-991b-6c6a758b16a5 00:23:19.302 Thin Provisioning: Not Supported 00:23:19.302 Per-NS Atomic Units: Yes 00:23:19.302 Atomic Boundary Size (Normal): 0 00:23:19.302 Atomic Boundary Size (PFail): 0 00:23:19.302 Atomic Boundary Offset: 0 00:23:19.302 Maximum Single Source Range Length: 65535 00:23:19.302 Maximum Copy Length: 65535 00:23:19.302 Maximum Source Range Count: 1 00:23:19.302 NGUID/EUI64 Never Reused: No 00:23:19.302 Namespace Write Protected: No 00:23:19.302 Number of LBA Formats: 1 00:23:19.302 Current LBA Format: LBA Format #00 00:23:19.302 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:19.302 00:23:19.302 01:16:09 -- host/identify.sh@51 -- # sync 00:23:19.302 01:16:09 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:19.302 01:16:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.302 01:16:09 -- common/autotest_common.sh@10 -- # set +x 00:23:19.302 01:16:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.302 01:16:09 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:19.302 01:16:09 -- host/identify.sh@56 -- # nvmftestfini 00:23:19.302 01:16:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:19.302 01:16:09 -- nvmf/common.sh@116 -- # sync 00:23:19.302 01:16:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:19.302 01:16:09 -- nvmf/common.sh@119 -- # set +e 00:23:19.302 01:16:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:19.302 01:16:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:19.302 rmmod nvme_tcp 00:23:19.561 rmmod nvme_fabrics 00:23:19.561 rmmod nvme_keyring 00:23:19.561 01:16:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:19.561 01:16:09 -- nvmf/common.sh@123 -- # set -e 00:23:19.561 01:16:09 -- nvmf/common.sh@124 -- # return 0 00:23:19.561 01:16:09 -- nvmf/common.sh@477 -- # '[' -n 1126503 ']' 00:23:19.561 01:16:09 -- nvmf/common.sh@478 -- # killprocess 1126503 00:23:19.561 01:16:09 -- common/autotest_common.sh@936 -- # '[' -z 1126503 ']' 00:23:19.561 01:16:09 -- common/autotest_common.sh@940 -- # kill -0 1126503 00:23:19.561 01:16:09 -- common/autotest_common.sh@941 -- # uname 00:23:19.561 01:16:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:19.561 01:16:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1126503 00:23:19.561 01:16:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:19.561 01:16:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:19.561 01:16:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1126503' 00:23:19.561 killing process with pid 1126503 00:23:19.561 01:16:09 -- common/autotest_common.sh@955 -- # kill 1126503 00:23:19.561 [2024-11-26 01:16:09.912207] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:19.561 01:16:09 -- common/autotest_common.sh@960 -- # wait 1126503 00:23:19.819 01:16:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:19.819 01:16:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:19.819 01:16:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:19.819 01:16:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:19.819 01:16:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:19.819 01:16:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:19.819 01:16:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:19.819 01:16:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.726 01:16:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:21.726 00:23:21.726 real 0m6.135s 00:23:21.726 user 0m7.234s 00:23:21.726 sys 0m1.918s 00:23:21.726 01:16:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:21.726 01:16:12 -- common/autotest_common.sh@10 -- # set +x 00:23:21.726 ************************************ 00:23:21.726 END TEST nvmf_identify 00:23:21.726 ************************************ 00:23:21.986 01:16:12 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:21.986 01:16:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:21.986 01:16:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:21.986 01:16:12 -- common/autotest_common.sh@10 -- # set +x 00:23:21.986 ************************************ 00:23:21.986 START TEST nvmf_perf 00:23:21.986 ************************************ 00:23:21.986 01:16:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:21.986 * Looking for test storage... 00:23:21.986 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:21.986 01:16:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:21.986 01:16:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:21.986 01:16:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:21.986 01:16:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:21.986 01:16:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:21.986 01:16:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:21.986 01:16:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:21.986 01:16:12 -- scripts/common.sh@335 -- # IFS=.-: 00:23:21.986 01:16:12 -- scripts/common.sh@335 -- # read -ra ver1 00:23:21.986 01:16:12 -- scripts/common.sh@336 -- # IFS=.-: 00:23:21.986 01:16:12 -- scripts/common.sh@336 -- # read -ra ver2 00:23:21.986 01:16:12 -- scripts/common.sh@337 -- # local 'op=<' 00:23:21.986 01:16:12 -- scripts/common.sh@339 -- # ver1_l=2 00:23:21.986 01:16:12 -- scripts/common.sh@340 -- # ver2_l=1 00:23:21.986 01:16:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:21.986 01:16:12 -- scripts/common.sh@343 -- # case "$op" in 00:23:21.986 01:16:12 -- scripts/common.sh@344 -- # : 1 00:23:21.986 01:16:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:21.986 01:16:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:21.986 01:16:12 -- scripts/common.sh@364 -- # decimal 1 00:23:21.986 01:16:12 -- scripts/common.sh@352 -- # local d=1 00:23:21.986 01:16:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:21.986 01:16:12 -- scripts/common.sh@354 -- # echo 1 00:23:21.986 01:16:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:21.986 01:16:12 -- scripts/common.sh@365 -- # decimal 2 00:23:21.986 01:16:12 -- scripts/common.sh@352 -- # local d=2 00:23:21.986 01:16:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:21.986 01:16:12 -- scripts/common.sh@354 -- # echo 2 00:23:21.986 01:16:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:21.986 01:16:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:21.986 01:16:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:21.987 01:16:12 -- scripts/common.sh@367 -- # return 0 00:23:21.987 01:16:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:21.987 01:16:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:21.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.987 --rc genhtml_branch_coverage=1 00:23:21.987 --rc genhtml_function_coverage=1 00:23:21.987 --rc genhtml_legend=1 00:23:21.987 --rc geninfo_all_blocks=1 00:23:21.987 --rc geninfo_unexecuted_blocks=1 00:23:21.987 00:23:21.987 ' 00:23:21.987 01:16:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:21.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.987 --rc genhtml_branch_coverage=1 00:23:21.987 --rc genhtml_function_coverage=1 00:23:21.987 --rc genhtml_legend=1 00:23:21.987 --rc geninfo_all_blocks=1 00:23:21.987 --rc geninfo_unexecuted_blocks=1 00:23:21.987 00:23:21.987 ' 00:23:21.987 01:16:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:21.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.987 --rc genhtml_branch_coverage=1 00:23:21.987 --rc genhtml_function_coverage=1 00:23:21.987 --rc genhtml_legend=1 00:23:21.987 --rc geninfo_all_blocks=1 00:23:21.987 --rc geninfo_unexecuted_blocks=1 00:23:21.987 00:23:21.987 ' 00:23:21.987 01:16:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:21.987 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:21.987 --rc genhtml_branch_coverage=1 00:23:21.987 --rc genhtml_function_coverage=1 00:23:21.987 --rc genhtml_legend=1 00:23:21.987 --rc geninfo_all_blocks=1 00:23:21.987 --rc geninfo_unexecuted_blocks=1 00:23:21.987 00:23:21.987 ' 00:23:21.987 01:16:12 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:21.987 01:16:12 -- nvmf/common.sh@7 -- # uname -s 00:23:21.987 01:16:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:21.987 01:16:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:21.987 01:16:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:21.987 01:16:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:21.987 01:16:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:21.987 01:16:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:21.987 01:16:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:21.987 01:16:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:21.987 01:16:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:21.987 01:16:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:21.987 01:16:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.987 01:16:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:21.987 01:16:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:21.987 01:16:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:21.987 01:16:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:21.987 01:16:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:21.987 01:16:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:21.987 01:16:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:21.987 01:16:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:21.987 01:16:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.987 01:16:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.987 01:16:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.987 01:16:12 -- paths/export.sh@5 -- # export PATH 00:23:21.987 01:16:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:21.987 01:16:12 -- nvmf/common.sh@46 -- # : 0 00:23:21.987 01:16:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:21.987 01:16:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:21.987 01:16:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:21.987 01:16:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:21.987 01:16:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:21.987 01:16:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:21.987 01:16:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:21.987 01:16:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:21.987 01:16:12 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:21.987 01:16:12 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:21.987 01:16:12 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:21.987 01:16:12 -- host/perf.sh@17 -- # nvmftestinit 00:23:21.987 01:16:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:21.987 01:16:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:21.987 01:16:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:21.987 01:16:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:21.987 01:16:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:21.987 01:16:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.987 01:16:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.987 01:16:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:21.987 01:16:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:21.987 01:16:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:21.987 01:16:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:21.987 01:16:12 -- common/autotest_common.sh@10 -- # set +x 00:23:23.897 01:16:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:23.897 01:16:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:23.897 01:16:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:23.897 01:16:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:23.897 01:16:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:23.897 01:16:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:23.897 01:16:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:23.897 01:16:14 -- nvmf/common.sh@294 -- # net_devs=() 00:23:23.897 01:16:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:23.897 01:16:14 -- nvmf/common.sh@295 -- # e810=() 00:23:23.897 01:16:14 -- nvmf/common.sh@295 -- # local -ga e810 00:23:23.897 01:16:14 -- nvmf/common.sh@296 -- # x722=() 00:23:23.897 01:16:14 -- nvmf/common.sh@296 -- # local -ga x722 00:23:23.897 01:16:14 -- nvmf/common.sh@297 -- # mlx=() 00:23:23.897 01:16:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:23.897 01:16:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:23.897 01:16:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:23.898 01:16:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:23.898 01:16:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:23.898 01:16:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:23.898 01:16:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:23.898 01:16:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.898 01:16:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:23.898 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:23.898 01:16:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.898 01:16:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:23.898 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:23.898 01:16:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:23.898 01:16:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.898 01:16:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.898 01:16:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.898 01:16:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.898 01:16:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:23.898 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:23.898 01:16:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.898 01:16:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.898 01:16:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.898 01:16:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.898 01:16:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.898 01:16:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:23.898 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:23.898 01:16:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.898 01:16:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:23.898 01:16:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:23.898 01:16:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:23.898 01:16:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:23.898 01:16:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:23.898 01:16:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:23.898 01:16:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:23.898 01:16:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:23.898 01:16:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:23.898 01:16:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:23.898 01:16:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:23.898 01:16:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:23.898 01:16:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:23.898 01:16:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:23.898 01:16:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:23.898 01:16:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:23.898 01:16:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:23.898 01:16:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:23.898 01:16:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:23.898 01:16:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:23.898 01:16:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:24.158 01:16:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:24.158 01:16:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:24.158 01:16:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:24.158 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:24.158 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.227 ms 00:23:24.158 00:23:24.158 --- 10.0.0.2 ping statistics --- 00:23:24.158 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:24.158 rtt min/avg/max/mdev = 0.227/0.227/0.227/0.000 ms 00:23:24.158 01:16:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:24.158 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:24.158 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:23:24.158 00:23:24.158 --- 10.0.0.1 ping statistics --- 00:23:24.158 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:24.158 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:23:24.158 01:16:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:24.158 01:16:14 -- nvmf/common.sh@410 -- # return 0 00:23:24.158 01:16:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:24.158 01:16:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:24.158 01:16:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:24.158 01:16:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:24.158 01:16:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:24.158 01:16:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:24.159 01:16:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:24.159 01:16:14 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:24.159 01:16:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:24.159 01:16:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:24.159 01:16:14 -- common/autotest_common.sh@10 -- # set +x 00:23:24.159 01:16:14 -- nvmf/common.sh@469 -- # nvmfpid=1128614 00:23:24.159 01:16:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:24.159 01:16:14 -- nvmf/common.sh@470 -- # waitforlisten 1128614 00:23:24.159 01:16:14 -- common/autotest_common.sh@829 -- # '[' -z 1128614 ']' 00:23:24.159 01:16:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:24.159 01:16:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:24.159 01:16:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:24.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:24.159 01:16:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:24.159 01:16:14 -- common/autotest_common.sh@10 -- # set +x 00:23:24.159 [2024-11-26 01:16:14.531609] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:24.159 [2024-11-26 01:16:14.531713] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:24.159 EAL: No free 2048 kB hugepages reported on node 1 00:23:24.159 [2024-11-26 01:16:14.596501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:24.420 [2024-11-26 01:16:14.705690] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:24.420 [2024-11-26 01:16:14.705833] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:24.420 [2024-11-26 01:16:14.705851] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:24.420 [2024-11-26 01:16:14.705863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:24.420 [2024-11-26 01:16:14.705915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:24.420 [2024-11-26 01:16:14.705977] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:24.420 [2024-11-26 01:16:14.706020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:24.420 [2024-11-26 01:16:14.706023] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:24.991 01:16:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:24.991 01:16:15 -- common/autotest_common.sh@862 -- # return 0 00:23:24.991 01:16:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:24.991 01:16:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:24.991 01:16:15 -- common/autotest_common.sh@10 -- # set +x 00:23:24.991 01:16:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:24.991 01:16:15 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:25.249 01:16:15 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:28.552 01:16:18 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:28.552 01:16:18 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:28.552 01:16:18 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:28.552 01:16:18 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:28.820 01:16:19 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:28.820 01:16:19 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:28.820 01:16:19 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:28.821 01:16:19 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:28.821 01:16:19 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:29.079 [2024-11-26 01:16:19.401205] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:29.079 01:16:19 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:29.338 01:16:19 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:29.338 01:16:19 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:29.596 01:16:19 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:29.596 01:16:19 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:29.855 01:16:20 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:30.115 [2024-11-26 01:16:20.448704] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:30.115 01:16:20 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:30.413 01:16:20 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:30.413 01:16:20 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:30.413 01:16:20 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:30.413 01:16:20 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:31.411 Initializing NVMe Controllers 00:23:31.411 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:31.411 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:31.411 Initialization complete. Launching workers. 00:23:31.411 ======================================================== 00:23:31.411 Latency(us) 00:23:31.411 Device Information : IOPS MiB/s Average min max 00:23:31.411 PCIE (0000:88:00.0) NSID 1 from core 0: 86811.80 339.11 368.11 15.78 4320.08 00:23:31.411 ======================================================== 00:23:31.411 Total : 86811.80 339.11 368.11 15.78 4320.08 00:23:31.411 00:23:31.411 01:16:21 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:31.669 EAL: No free 2048 kB hugepages reported on node 1 00:23:33.049 Initializing NVMe Controllers 00:23:33.049 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:33.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:33.049 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:33.049 Initialization complete. Launching workers. 00:23:33.049 ======================================================== 00:23:33.049 Latency(us) 00:23:33.049 Device Information : IOPS MiB/s Average min max 00:23:33.049 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 129.00 0.50 7910.31 160.76 45771.52 00:23:33.049 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 62.00 0.24 16329.44 5108.61 47902.57 00:23:33.049 ======================================================== 00:23:33.049 Total : 191.00 0.75 10643.22 160.76 47902.57 00:23:33.049 00:23:33.049 01:16:23 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:33.049 EAL: No free 2048 kB hugepages reported on node 1 00:23:34.426 Initializing NVMe Controllers 00:23:34.426 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:34.426 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:34.426 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:34.426 Initialization complete. Launching workers. 00:23:34.426 ======================================================== 00:23:34.426 Latency(us) 00:23:34.426 Device Information : IOPS MiB/s Average min max 00:23:34.426 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8484.08 33.14 3788.48 608.51 8294.51 00:23:34.426 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3985.57 15.57 8065.04 6248.75 15618.26 00:23:34.426 ======================================================== 00:23:34.426 Total : 12469.64 48.71 5155.36 608.51 15618.26 00:23:34.426 00:23:34.426 01:16:24 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:34.426 01:16:24 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:34.426 01:16:24 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:34.426 EAL: No free 2048 kB hugepages reported on node 1 00:23:36.962 Initializing NVMe Controllers 00:23:36.962 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:36.962 Controller IO queue size 128, less than required. 00:23:36.962 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:36.962 Controller IO queue size 128, less than required. 00:23:36.962 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:36.962 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:36.962 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:36.962 Initialization complete. Launching workers. 00:23:36.962 ======================================================== 00:23:36.962 Latency(us) 00:23:36.962 Device Information : IOPS MiB/s Average min max 00:23:36.962 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1587.61 396.90 81862.50 57085.83 117793.60 00:23:36.962 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 591.36 147.84 227780.03 85688.35 357390.68 00:23:36.962 ======================================================== 00:23:36.962 Total : 2178.97 544.74 121463.42 57085.83 357390.68 00:23:36.962 00:23:36.962 01:16:27 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:36.962 EAL: No free 2048 kB hugepages reported on node 1 00:23:37.221 No valid NVMe controllers or AIO or URING devices found 00:23:37.221 Initializing NVMe Controllers 00:23:37.221 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:37.221 Controller IO queue size 128, less than required. 00:23:37.221 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:37.221 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:37.221 Controller IO queue size 128, less than required. 00:23:37.221 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:37.221 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:37.221 WARNING: Some requested NVMe devices were skipped 00:23:37.221 01:16:27 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:37.221 EAL: No free 2048 kB hugepages reported on node 1 00:23:40.514 Initializing NVMe Controllers 00:23:40.514 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:40.514 Controller IO queue size 128, less than required. 00:23:40.514 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:40.514 Controller IO queue size 128, less than required. 00:23:40.514 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:40.514 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:40.514 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:40.514 Initialization complete. Launching workers. 00:23:40.514 00:23:40.514 ==================== 00:23:40.514 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:40.514 TCP transport: 00:23:40.514 polls: 9638 00:23:40.514 idle_polls: 6256 00:23:40.514 sock_completions: 3382 00:23:40.514 nvme_completions: 5639 00:23:40.514 submitted_requests: 8623 00:23:40.514 queued_requests: 1 00:23:40.514 00:23:40.514 ==================== 00:23:40.514 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:40.514 TCP transport: 00:23:40.514 polls: 12995 00:23:40.514 idle_polls: 9134 00:23:40.514 sock_completions: 3861 00:23:40.514 nvme_completions: 5942 00:23:40.514 submitted_requests: 9070 00:23:40.514 queued_requests: 1 00:23:40.514 ======================================================== 00:23:40.514 Latency(us) 00:23:40.515 Device Information : IOPS MiB/s Average min max 00:23:40.515 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1473.45 368.36 89592.20 58876.59 164657.94 00:23:40.515 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1548.95 387.24 83194.79 34954.06 126303.87 00:23:40.515 ======================================================== 00:23:40.515 Total : 3022.40 755.60 86313.59 34954.06 164657.94 00:23:40.515 00:23:40.515 01:16:30 -- host/perf.sh@66 -- # sync 00:23:40.515 01:16:30 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:40.515 01:16:30 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:40.515 01:16:30 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:40.515 01:16:30 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:43.817 01:16:33 -- host/perf.sh@72 -- # ls_guid=1b9fd31c-a3e5-4046-af02-19c0d81d86d5 00:23:43.817 01:16:33 -- host/perf.sh@73 -- # get_lvs_free_mb 1b9fd31c-a3e5-4046-af02-19c0d81d86d5 00:23:43.817 01:16:33 -- common/autotest_common.sh@1353 -- # local lvs_uuid=1b9fd31c-a3e5-4046-af02-19c0d81d86d5 00:23:43.817 01:16:33 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:43.817 01:16:33 -- common/autotest_common.sh@1355 -- # local fc 00:23:43.817 01:16:33 -- common/autotest_common.sh@1356 -- # local cs 00:23:43.817 01:16:33 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:43.817 01:16:34 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:43.817 { 00:23:43.817 "uuid": "1b9fd31c-a3e5-4046-af02-19c0d81d86d5", 00:23:43.817 "name": "lvs_0", 00:23:43.817 "base_bdev": "Nvme0n1", 00:23:43.817 "total_data_clusters": 238234, 00:23:43.817 "free_clusters": 238234, 00:23:43.817 "block_size": 512, 00:23:43.817 "cluster_size": 4194304 00:23:43.817 } 00:23:43.817 ]' 00:23:43.817 01:16:34 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="1b9fd31c-a3e5-4046-af02-19c0d81d86d5") .free_clusters' 00:23:43.817 01:16:34 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:43.817 01:16:34 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="1b9fd31c-a3e5-4046-af02-19c0d81d86d5") .cluster_size' 00:23:43.817 01:16:34 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:43.817 01:16:34 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:43.817 01:16:34 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:43.817 952936 00:23:43.817 01:16:34 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:43.817 01:16:34 -- host/perf.sh@78 -- # free_mb=20480 00:23:43.817 01:16:34 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 1b9fd31c-a3e5-4046-af02-19c0d81d86d5 lbd_0 20480 00:23:44.384 01:16:34 -- host/perf.sh@80 -- # lb_guid=b9667570-50b9-4a75-8216-2d8c12279413 00:23:44.384 01:16:34 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore b9667570-50b9-4a75-8216-2d8c12279413 lvs_n_0 00:23:45.321 01:16:35 -- host/perf.sh@83 -- # ls_nested_guid=417e10b2-702e-41a1-8032-dabfe5feaf07 00:23:45.321 01:16:35 -- host/perf.sh@84 -- # get_lvs_free_mb 417e10b2-702e-41a1-8032-dabfe5feaf07 00:23:45.321 01:16:35 -- common/autotest_common.sh@1353 -- # local lvs_uuid=417e10b2-702e-41a1-8032-dabfe5feaf07 00:23:45.321 01:16:35 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:45.321 01:16:35 -- common/autotest_common.sh@1355 -- # local fc 00:23:45.321 01:16:35 -- common/autotest_common.sh@1356 -- # local cs 00:23:45.321 01:16:35 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:45.580 01:16:35 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:45.580 { 00:23:45.580 "uuid": "1b9fd31c-a3e5-4046-af02-19c0d81d86d5", 00:23:45.580 "name": "lvs_0", 00:23:45.580 "base_bdev": "Nvme0n1", 00:23:45.580 "total_data_clusters": 238234, 00:23:45.580 "free_clusters": 233114, 00:23:45.580 "block_size": 512, 00:23:45.580 "cluster_size": 4194304 00:23:45.580 }, 00:23:45.580 { 00:23:45.580 "uuid": "417e10b2-702e-41a1-8032-dabfe5feaf07", 00:23:45.580 "name": "lvs_n_0", 00:23:45.580 "base_bdev": "b9667570-50b9-4a75-8216-2d8c12279413", 00:23:45.580 "total_data_clusters": 5114, 00:23:45.580 "free_clusters": 5114, 00:23:45.580 "block_size": 512, 00:23:45.580 "cluster_size": 4194304 00:23:45.580 } 00:23:45.580 ]' 00:23:45.580 01:16:35 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="417e10b2-702e-41a1-8032-dabfe5feaf07") .free_clusters' 00:23:45.580 01:16:35 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:45.580 01:16:35 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="417e10b2-702e-41a1-8032-dabfe5feaf07") .cluster_size' 00:23:45.580 01:16:35 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:45.580 01:16:35 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:45.580 01:16:35 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:45.580 20456 00:23:45.580 01:16:35 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:45.580 01:16:35 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 417e10b2-702e-41a1-8032-dabfe5feaf07 lbd_nest_0 20456 00:23:45.837 01:16:36 -- host/perf.sh@88 -- # lb_nested_guid=19798b95-0b87-437b-95aa-6a0ca56ecfee 00:23:45.837 01:16:36 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:46.095 01:16:36 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:46.095 01:16:36 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 19798b95-0b87-437b-95aa-6a0ca56ecfee 00:23:46.353 01:16:36 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:46.611 01:16:36 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:46.611 01:16:36 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:46.611 01:16:36 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:46.611 01:16:36 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:46.611 01:16:36 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:46.611 EAL: No free 2048 kB hugepages reported on node 1 00:23:58.874 Initializing NVMe Controllers 00:23:58.874 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:58.874 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:58.874 Initialization complete. Launching workers. 00:23:58.874 ======================================================== 00:23:58.874 Latency(us) 00:23:58.874 Device Information : IOPS MiB/s Average min max 00:23:58.874 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 44.90 0.02 22287.89 176.91 44979.62 00:23:58.874 ======================================================== 00:23:58.874 Total : 44.90 0.02 22287.89 176.91 44979.62 00:23:58.874 00:23:58.874 01:16:47 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:58.874 01:16:47 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:58.874 EAL: No free 2048 kB hugepages reported on node 1 00:24:08.864 Initializing NVMe Controllers 00:24:08.864 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:08.864 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:08.864 Initialization complete. Launching workers. 00:24:08.864 ======================================================== 00:24:08.864 Latency(us) 00:24:08.864 Device Information : IOPS MiB/s Average min max 00:24:08.864 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 72.30 9.04 13842.45 5053.99 47892.84 00:24:08.864 ======================================================== 00:24:08.864 Total : 72.30 9.04 13842.45 5053.99 47892.84 00:24:08.864 00:24:08.864 01:16:57 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:08.864 01:16:57 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:08.864 01:16:57 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:08.864 EAL: No free 2048 kB hugepages reported on node 1 00:24:18.858 Initializing NVMe Controllers 00:24:18.858 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:18.858 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:18.858 Initialization complete. Launching workers. 00:24:18.858 ======================================================== 00:24:18.858 Latency(us) 00:24:18.858 Device Information : IOPS MiB/s Average min max 00:24:18.858 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7806.93 3.81 4105.56 429.18 42970.11 00:24:18.858 ======================================================== 00:24:18.858 Total : 7806.93 3.81 4105.56 429.18 42970.11 00:24:18.858 00:24:18.858 01:17:08 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:18.858 01:17:08 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:18.858 EAL: No free 2048 kB hugepages reported on node 1 00:24:28.867 Initializing NVMe Controllers 00:24:28.867 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:28.867 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:28.867 Initialization complete. Launching workers. 00:24:28.867 ======================================================== 00:24:28.867 Latency(us) 00:24:28.867 Device Information : IOPS MiB/s Average min max 00:24:28.867 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3985.10 498.14 8031.46 594.91 17708.76 00:24:28.867 ======================================================== 00:24:28.867 Total : 3985.10 498.14 8031.46 594.91 17708.76 00:24:28.867 00:24:28.867 01:17:18 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:28.867 01:17:18 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:28.867 01:17:18 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:28.867 EAL: No free 2048 kB hugepages reported on node 1 00:24:38.861 Initializing NVMe Controllers 00:24:38.861 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:38.861 Controller IO queue size 128, less than required. 00:24:38.861 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:38.861 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:38.861 Initialization complete. Launching workers. 00:24:38.861 ======================================================== 00:24:38.862 Latency(us) 00:24:38.862 Device Information : IOPS MiB/s Average min max 00:24:38.862 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11990.36 5.85 10675.19 1741.24 27886.51 00:24:38.862 ======================================================== 00:24:38.862 Total : 11990.36 5.85 10675.19 1741.24 27886.51 00:24:38.862 00:24:38.862 01:17:28 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:38.862 01:17:28 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:38.862 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.855 Initializing NVMe Controllers 00:24:48.855 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:48.855 Controller IO queue size 128, less than required. 00:24:48.855 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:48.855 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:48.855 Initialization complete. Launching workers. 00:24:48.855 ======================================================== 00:24:48.855 Latency(us) 00:24:48.855 Device Information : IOPS MiB/s Average min max 00:24:48.855 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1186.90 148.36 108316.41 15624.83 214603.73 00:24:48.855 ======================================================== 00:24:48.855 Total : 1186.90 148.36 108316.41 15624.83 214603.73 00:24:48.855 00:24:48.855 01:17:39 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:49.421 01:17:39 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 19798b95-0b87-437b-95aa-6a0ca56ecfee 00:24:49.987 01:17:40 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:50.246 01:17:40 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete b9667570-50b9-4a75-8216-2d8c12279413 00:24:50.814 01:17:41 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:50.814 01:17:41 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:50.814 01:17:41 -- host/perf.sh@114 -- # nvmftestfini 00:24:50.814 01:17:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:50.814 01:17:41 -- nvmf/common.sh@116 -- # sync 00:24:50.814 01:17:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:50.814 01:17:41 -- nvmf/common.sh@119 -- # set +e 00:24:50.814 01:17:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:50.814 01:17:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:50.814 rmmod nvme_tcp 00:24:51.075 rmmod nvme_fabrics 00:24:51.075 rmmod nvme_keyring 00:24:51.075 01:17:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:51.075 01:17:41 -- nvmf/common.sh@123 -- # set -e 00:24:51.075 01:17:41 -- nvmf/common.sh@124 -- # return 0 00:24:51.075 01:17:41 -- nvmf/common.sh@477 -- # '[' -n 1128614 ']' 00:24:51.075 01:17:41 -- nvmf/common.sh@478 -- # killprocess 1128614 00:24:51.075 01:17:41 -- common/autotest_common.sh@936 -- # '[' -z 1128614 ']' 00:24:51.075 01:17:41 -- common/autotest_common.sh@940 -- # kill -0 1128614 00:24:51.075 01:17:41 -- common/autotest_common.sh@941 -- # uname 00:24:51.075 01:17:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:51.075 01:17:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1128614 00:24:51.075 01:17:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:51.075 01:17:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:51.075 01:17:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1128614' 00:24:51.075 killing process with pid 1128614 00:24:51.075 01:17:41 -- common/autotest_common.sh@955 -- # kill 1128614 00:24:51.075 01:17:41 -- common/autotest_common.sh@960 -- # wait 1128614 00:24:52.980 01:17:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:52.980 01:17:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:52.980 01:17:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:52.980 01:17:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:52.980 01:17:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:52.980 01:17:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:52.980 01:17:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:52.980 01:17:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:54.890 01:17:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:54.890 00:24:54.890 real 1m32.906s 00:24:54.890 user 5m44.694s 00:24:54.890 sys 0m15.510s 00:24:54.890 01:17:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:54.890 01:17:45 -- common/autotest_common.sh@10 -- # set +x 00:24:54.890 ************************************ 00:24:54.890 END TEST nvmf_perf 00:24:54.890 ************************************ 00:24:54.890 01:17:45 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:54.890 01:17:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:54.890 01:17:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:54.890 01:17:45 -- common/autotest_common.sh@10 -- # set +x 00:24:54.890 ************************************ 00:24:54.890 START TEST nvmf_fio_host 00:24:54.890 ************************************ 00:24:54.890 01:17:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:24:54.890 * Looking for test storage... 00:24:54.890 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:54.890 01:17:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:54.890 01:17:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:54.890 01:17:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:54.890 01:17:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:54.890 01:17:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:54.890 01:17:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:54.890 01:17:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:54.890 01:17:45 -- scripts/common.sh@335 -- # IFS=.-: 00:24:54.890 01:17:45 -- scripts/common.sh@335 -- # read -ra ver1 00:24:54.890 01:17:45 -- scripts/common.sh@336 -- # IFS=.-: 00:24:54.890 01:17:45 -- scripts/common.sh@336 -- # read -ra ver2 00:24:54.890 01:17:45 -- scripts/common.sh@337 -- # local 'op=<' 00:24:54.890 01:17:45 -- scripts/common.sh@339 -- # ver1_l=2 00:24:54.890 01:17:45 -- scripts/common.sh@340 -- # ver2_l=1 00:24:54.890 01:17:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:54.890 01:17:45 -- scripts/common.sh@343 -- # case "$op" in 00:24:54.890 01:17:45 -- scripts/common.sh@344 -- # : 1 00:24:54.890 01:17:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:54.890 01:17:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:54.890 01:17:45 -- scripts/common.sh@364 -- # decimal 1 00:24:54.890 01:17:45 -- scripts/common.sh@352 -- # local d=1 00:24:54.890 01:17:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:54.890 01:17:45 -- scripts/common.sh@354 -- # echo 1 00:24:54.890 01:17:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:54.890 01:17:45 -- scripts/common.sh@365 -- # decimal 2 00:24:54.890 01:17:45 -- scripts/common.sh@352 -- # local d=2 00:24:54.890 01:17:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:54.890 01:17:45 -- scripts/common.sh@354 -- # echo 2 00:24:54.890 01:17:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:54.890 01:17:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:54.890 01:17:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:54.890 01:17:45 -- scripts/common.sh@367 -- # return 0 00:24:54.890 01:17:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:54.890 01:17:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:54.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:54.890 --rc genhtml_branch_coverage=1 00:24:54.890 --rc genhtml_function_coverage=1 00:24:54.890 --rc genhtml_legend=1 00:24:54.890 --rc geninfo_all_blocks=1 00:24:54.890 --rc geninfo_unexecuted_blocks=1 00:24:54.890 00:24:54.890 ' 00:24:54.890 01:17:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:54.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:54.890 --rc genhtml_branch_coverage=1 00:24:54.890 --rc genhtml_function_coverage=1 00:24:54.890 --rc genhtml_legend=1 00:24:54.890 --rc geninfo_all_blocks=1 00:24:54.890 --rc geninfo_unexecuted_blocks=1 00:24:54.890 00:24:54.890 ' 00:24:54.890 01:17:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:54.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:54.890 --rc genhtml_branch_coverage=1 00:24:54.890 --rc genhtml_function_coverage=1 00:24:54.890 --rc genhtml_legend=1 00:24:54.890 --rc geninfo_all_blocks=1 00:24:54.890 --rc geninfo_unexecuted_blocks=1 00:24:54.890 00:24:54.890 ' 00:24:54.890 01:17:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:54.890 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:54.890 --rc genhtml_branch_coverage=1 00:24:54.890 --rc genhtml_function_coverage=1 00:24:54.890 --rc genhtml_legend=1 00:24:54.890 --rc geninfo_all_blocks=1 00:24:54.890 --rc geninfo_unexecuted_blocks=1 00:24:54.890 00:24:54.890 ' 00:24:54.890 01:17:45 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:54.890 01:17:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:54.890 01:17:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:54.890 01:17:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:54.890 01:17:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.890 01:17:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.890 01:17:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.890 01:17:45 -- paths/export.sh@5 -- # export PATH 00:24:54.890 01:17:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.890 01:17:45 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:54.890 01:17:45 -- nvmf/common.sh@7 -- # uname -s 00:24:54.890 01:17:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:54.890 01:17:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:54.890 01:17:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:54.890 01:17:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:54.890 01:17:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:54.890 01:17:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:54.890 01:17:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:54.890 01:17:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:54.890 01:17:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:54.890 01:17:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:54.890 01:17:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:54.890 01:17:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:54.890 01:17:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:54.890 01:17:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:54.890 01:17:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:54.890 01:17:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:54.890 01:17:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:54.890 01:17:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:54.890 01:17:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:54.890 01:17:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.891 01:17:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.891 01:17:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.891 01:17:45 -- paths/export.sh@5 -- # export PATH 00:24:54.891 01:17:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:54.891 01:17:45 -- nvmf/common.sh@46 -- # : 0 00:24:54.891 01:17:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:54.891 01:17:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:54.891 01:17:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:54.891 01:17:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:54.891 01:17:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:54.891 01:17:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:54.891 01:17:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:54.891 01:17:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:54.891 01:17:45 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:24:54.891 01:17:45 -- host/fio.sh@14 -- # nvmftestinit 00:24:54.891 01:17:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:54.891 01:17:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:54.891 01:17:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:54.891 01:17:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:54.891 01:17:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:54.891 01:17:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:54.891 01:17:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:54.891 01:17:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:54.891 01:17:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:54.891 01:17:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:54.891 01:17:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:54.891 01:17:45 -- common/autotest_common.sh@10 -- # set +x 00:24:56.799 01:17:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:56.799 01:17:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:56.799 01:17:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:56.799 01:17:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:56.799 01:17:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:56.799 01:17:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:56.799 01:17:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:56.799 01:17:47 -- nvmf/common.sh@294 -- # net_devs=() 00:24:56.799 01:17:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:56.799 01:17:47 -- nvmf/common.sh@295 -- # e810=() 00:24:56.799 01:17:47 -- nvmf/common.sh@295 -- # local -ga e810 00:24:56.799 01:17:47 -- nvmf/common.sh@296 -- # x722=() 00:24:56.799 01:17:47 -- nvmf/common.sh@296 -- # local -ga x722 00:24:56.799 01:17:47 -- nvmf/common.sh@297 -- # mlx=() 00:24:56.799 01:17:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:56.799 01:17:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:56.799 01:17:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:56.799 01:17:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:56.799 01:17:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:56.799 01:17:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:56.799 01:17:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:56.799 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:56.799 01:17:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:56.799 01:17:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:56.799 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:56.799 01:17:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:56.799 01:17:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:56.799 01:17:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:56.799 01:17:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:56.799 01:17:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:56.799 01:17:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:56.799 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:56.799 01:17:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:56.799 01:17:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:56.799 01:17:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:56.799 01:17:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:56.799 01:17:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:56.799 01:17:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:56.799 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:56.799 01:17:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:56.799 01:17:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:56.799 01:17:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:56.799 01:17:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:56.799 01:17:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:56.799 01:17:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:56.799 01:17:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:56.799 01:17:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:56.799 01:17:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:56.800 01:17:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:56.800 01:17:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:56.800 01:17:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:56.800 01:17:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:56.800 01:17:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:56.800 01:17:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:56.800 01:17:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:56.800 01:17:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:56.800 01:17:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:57.058 01:17:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:57.058 01:17:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:57.058 01:17:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:57.058 01:17:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:57.058 01:17:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:57.059 01:17:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:57.059 01:17:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:57.059 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:57.059 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.381 ms 00:24:57.059 00:24:57.059 --- 10.0.0.2 ping statistics --- 00:24:57.059 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:57.059 rtt min/avg/max/mdev = 0.381/0.381/0.381/0.000 ms 00:24:57.059 01:17:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:57.059 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:57.059 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:24:57.059 00:24:57.059 --- 10.0.0.1 ping statistics --- 00:24:57.059 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:57.059 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:24:57.059 01:17:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:57.059 01:17:47 -- nvmf/common.sh@410 -- # return 0 00:24:57.059 01:17:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:57.059 01:17:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:57.059 01:17:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:57.059 01:17:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:57.059 01:17:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:57.059 01:17:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:57.059 01:17:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:57.059 01:17:47 -- host/fio.sh@16 -- # [[ y != y ]] 00:24:57.059 01:17:47 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:24:57.059 01:17:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:57.059 01:17:47 -- common/autotest_common.sh@10 -- # set +x 00:24:57.059 01:17:47 -- host/fio.sh@24 -- # nvmfpid=1141207 00:24:57.059 01:17:47 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:57.059 01:17:47 -- host/fio.sh@28 -- # waitforlisten 1141207 00:24:57.059 01:17:47 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:57.059 01:17:47 -- common/autotest_common.sh@829 -- # '[' -z 1141207 ']' 00:24:57.059 01:17:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:57.059 01:17:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:57.059 01:17:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:57.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:57.059 01:17:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:57.059 01:17:47 -- common/autotest_common.sh@10 -- # set +x 00:24:57.059 [2024-11-26 01:17:47.485383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:57.059 [2024-11-26 01:17:47.485471] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:57.059 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.059 [2024-11-26 01:17:47.557182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:57.317 [2024-11-26 01:17:47.674804] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:57.317 [2024-11-26 01:17:47.674950] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:57.317 [2024-11-26 01:17:47.674977] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:57.317 [2024-11-26 01:17:47.674989] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:57.317 [2024-11-26 01:17:47.675042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:57.317 [2024-11-26 01:17:47.675068] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:57.317 [2024-11-26 01:17:47.675127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:57.317 [2024-11-26 01:17:47.675130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:58.251 01:17:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:58.251 01:17:48 -- common/autotest_common.sh@862 -- # return 0 00:24:58.251 01:17:48 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:24:58.251 [2024-11-26 01:17:48.671844] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:58.251 01:17:48 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:24:58.251 01:17:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:58.251 01:17:48 -- common/autotest_common.sh@10 -- # set +x 00:24:58.251 01:17:48 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:24:58.509 Malloc1 00:24:58.509 01:17:49 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:58.767 01:17:49 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:59.025 01:17:49 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:59.283 [2024-11-26 01:17:49.747035] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.283 01:17:49 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:24:59.541 01:17:50 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:24:59.541 01:17:50 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:59.541 01:17:50 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:59.541 01:17:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:24:59.541 01:17:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:24:59.541 01:17:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:24:59.541 01:17:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:59.541 01:17:50 -- common/autotest_common.sh@1330 -- # shift 00:24:59.541 01:17:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:24:59.541 01:17:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:59.541 01:17:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:59.541 01:17:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:24:59.541 01:17:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:59.542 01:17:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:59.542 01:17:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:59.542 01:17:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:24:59.542 01:17:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:24:59.542 01:17:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:24:59.542 01:17:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:24:59.542 01:17:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:24:59.542 01:17:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:24:59.542 01:17:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:24:59.542 01:17:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:24:59.802 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:24:59.802 fio-3.35 00:24:59.802 Starting 1 thread 00:24:59.802 EAL: No free 2048 kB hugepages reported on node 1 00:25:02.333 00:25:02.333 test: (groupid=0, jobs=1): err= 0: pid=1141706: Tue Nov 26 01:17:52 2024 00:25:02.333 read: IOPS=8690, BW=33.9MiB/s (35.6MB/s)(68.1MiB/2006msec) 00:25:02.333 slat (nsec): min=1934, max=217287, avg=2589.07, stdev=2289.21 00:25:02.333 clat (usec): min=2542, max=13459, avg=8151.79, stdev=599.82 00:25:02.333 lat (usec): min=2568, max=13461, avg=8154.38, stdev=599.69 00:25:02.333 clat percentiles (usec): 00:25:02.333 | 1.00th=[ 6783], 5.00th=[ 7242], 10.00th=[ 7439], 20.00th=[ 7701], 00:25:02.333 | 30.00th=[ 7898], 40.00th=[ 8029], 50.00th=[ 8160], 60.00th=[ 8291], 00:25:02.334 | 70.00th=[ 8455], 80.00th=[ 8586], 90.00th=[ 8848], 95.00th=[ 9110], 00:25:02.334 | 99.00th=[ 9503], 99.50th=[ 9634], 99.90th=[11076], 99.95th=[11731], 00:25:02.334 | 99.99th=[13435] 00:25:02.334 bw ( KiB/s): min=33888, max=35256, per=99.92%, avg=34736.00, stdev=616.47, samples=4 00:25:02.334 iops : min= 8472, max= 8814, avg=8684.00, stdev=154.12, samples=4 00:25:02.334 write: IOPS=8681, BW=33.9MiB/s (35.6MB/s)(68.0MiB/2006msec); 0 zone resets 00:25:02.334 slat (usec): min=2, max=129, avg= 2.66, stdev= 1.47 00:25:02.334 clat (usec): min=1494, max=11796, avg=6549.53, stdev=525.66 00:25:02.334 lat (usec): min=1503, max=11799, avg=6552.18, stdev=525.60 00:25:02.334 clat percentiles (usec): 00:25:02.334 | 1.00th=[ 5407], 5.00th=[ 5800], 10.00th=[ 5997], 20.00th=[ 6194], 00:25:02.334 | 30.00th=[ 6325], 40.00th=[ 6456], 50.00th=[ 6521], 60.00th=[ 6652], 00:25:02.334 | 70.00th=[ 6783], 80.00th=[ 6915], 90.00th=[ 7111], 95.00th=[ 7308], 00:25:02.334 | 99.00th=[ 7635], 99.50th=[ 7767], 99.90th=[10945], 99.95th=[11600], 00:25:02.334 | 99.99th=[11731] 00:25:02.334 bw ( KiB/s): min=34336, max=34912, per=99.95%, avg=34708.00, stdev=268.17, samples=4 00:25:02.334 iops : min= 8586, max= 8726, avg=8677.00, stdev=65.62, samples=4 00:25:02.334 lat (msec) : 2=0.02%, 4=0.12%, 10=99.73%, 20=0.12% 00:25:02.334 cpu : usr=60.90%, sys=36.26%, ctx=74, majf=0, minf=37 00:25:02.334 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:02.334 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:02.334 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:02.334 issued rwts: total=17434,17415,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:02.334 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:02.334 00:25:02.334 Run status group 0 (all jobs): 00:25:02.334 READ: bw=33.9MiB/s (35.6MB/s), 33.9MiB/s-33.9MiB/s (35.6MB/s-35.6MB/s), io=68.1MiB (71.4MB), run=2006-2006msec 00:25:02.334 WRITE: bw=33.9MiB/s (35.6MB/s), 33.9MiB/s-33.9MiB/s (35.6MB/s-35.6MB/s), io=68.0MiB (71.3MB), run=2006-2006msec 00:25:02.334 01:17:52 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:02.334 01:17:52 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:02.334 01:17:52 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:02.334 01:17:52 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:02.334 01:17:52 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:02.334 01:17:52 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:02.334 01:17:52 -- common/autotest_common.sh@1330 -- # shift 00:25:02.334 01:17:52 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:02.334 01:17:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:02.334 01:17:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:02.334 01:17:52 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:02.334 01:17:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:02.334 01:17:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:02.334 01:17:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:02.334 01:17:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:02.594 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:02.594 fio-3.35 00:25:02.594 Starting 1 thread 00:25:02.594 EAL: No free 2048 kB hugepages reported on node 1 00:25:05.123 00:25:05.123 test: (groupid=0, jobs=1): err= 0: pid=1142055: Tue Nov 26 01:17:55 2024 00:25:05.123 read: IOPS=6944, BW=109MiB/s (114MB/s)(218MiB/2007msec) 00:25:05.123 slat (nsec): min=2788, max=94129, avg=3654.50, stdev=1813.87 00:25:05.123 clat (usec): min=3811, max=53731, avg=10682.51, stdev=5868.38 00:25:05.123 lat (usec): min=3814, max=53734, avg=10686.17, stdev=5868.36 00:25:05.123 clat percentiles (usec): 00:25:05.123 | 1.00th=[ 4752], 5.00th=[ 5997], 10.00th=[ 6783], 20.00th=[ 7767], 00:25:05.123 | 30.00th=[ 8455], 40.00th=[ 9110], 50.00th=[ 9765], 60.00th=[10421], 00:25:05.123 | 70.00th=[11207], 80.00th=[12387], 90.00th=[13566], 95.00th=[15533], 00:25:05.123 | 99.00th=[47973], 99.50th=[50594], 99.90th=[53216], 99.95th=[53216], 00:25:05.123 | 99.99th=[53740] 00:25:05.123 bw ( KiB/s): min=49440, max=64032, per=49.88%, avg=55424.00, stdev=6960.57, samples=4 00:25:05.123 iops : min= 3090, max= 4002, avg=3464.00, stdev=435.04, samples=4 00:25:05.123 write: IOPS=4113, BW=64.3MiB/s (67.4MB/s)(113MiB/1764msec); 0 zone resets 00:25:05.123 slat (usec): min=30, max=189, avg=33.60, stdev= 6.02 00:25:05.123 clat (usec): min=5610, max=26999, avg=13964.90, stdev=3997.43 00:25:05.123 lat (usec): min=5641, max=27030, avg=13998.49, stdev=3997.52 00:25:05.123 clat percentiles (usec): 00:25:05.123 | 1.00th=[ 7373], 5.00th=[ 8717], 10.00th=[ 9372], 20.00th=[10290], 00:25:05.123 | 30.00th=[11207], 40.00th=[12125], 50.00th=[13173], 60.00th=[14353], 00:25:05.123 | 70.00th=[15926], 80.00th=[18220], 90.00th=[20055], 95.00th=[20841], 00:25:05.123 | 99.00th=[23200], 99.50th=[23987], 99.90th=[25297], 99.95th=[26608], 00:25:05.123 | 99.99th=[26870] 00:25:05.123 bw ( KiB/s): min=51008, max=67584, per=87.56%, avg=57624.00, stdev=7383.22, samples=4 00:25:05.123 iops : min= 3188, max= 4224, avg=3601.50, stdev=461.45, samples=4 00:25:05.123 lat (msec) : 4=0.03%, 10=40.92%, 20=54.00%, 50=4.61%, 100=0.44% 00:25:05.123 cpu : usr=71.45%, sys=26.41%, ctx=77, majf=0, minf=69 00:25:05.123 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:25:05.123 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:05.123 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:05.123 issued rwts: total=13937,7256,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:05.123 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:05.123 00:25:05.123 Run status group 0 (all jobs): 00:25:05.123 READ: bw=109MiB/s (114MB/s), 109MiB/s-109MiB/s (114MB/s-114MB/s), io=218MiB (228MB), run=2007-2007msec 00:25:05.123 WRITE: bw=64.3MiB/s (67.4MB/s), 64.3MiB/s-64.3MiB/s (67.4MB/s-67.4MB/s), io=113MiB (119MB), run=1764-1764msec 00:25:05.123 01:17:55 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:05.123 01:17:55 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:05.123 01:17:55 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:05.123 01:17:55 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:05.123 01:17:55 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:05.123 01:17:55 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:05.123 01:17:55 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:05.123 01:17:55 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:05.123 01:17:55 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:05.123 01:17:55 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:05.123 01:17:55 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:05.123 01:17:55 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:08.414 Nvme0n1 00:25:08.415 01:17:58 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:11.730 01:18:01 -- host/fio.sh@53 -- # ls_guid=9ab39414-5cd7-4f5d-b626-09f78b81b4e7 00:25:11.730 01:18:01 -- host/fio.sh@54 -- # get_lvs_free_mb 9ab39414-5cd7-4f5d-b626-09f78b81b4e7 00:25:11.730 01:18:01 -- common/autotest_common.sh@1353 -- # local lvs_uuid=9ab39414-5cd7-4f5d-b626-09f78b81b4e7 00:25:11.730 01:18:01 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:11.730 01:18:01 -- common/autotest_common.sh@1355 -- # local fc 00:25:11.730 01:18:01 -- common/autotest_common.sh@1356 -- # local cs 00:25:11.730 01:18:01 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:11.730 01:18:01 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:11.730 { 00:25:11.730 "uuid": "9ab39414-5cd7-4f5d-b626-09f78b81b4e7", 00:25:11.730 "name": "lvs_0", 00:25:11.730 "base_bdev": "Nvme0n1", 00:25:11.730 "total_data_clusters": 930, 00:25:11.730 "free_clusters": 930, 00:25:11.730 "block_size": 512, 00:25:11.730 "cluster_size": 1073741824 00:25:11.730 } 00:25:11.730 ]' 00:25:11.730 01:18:01 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="9ab39414-5cd7-4f5d-b626-09f78b81b4e7") .free_clusters' 00:25:11.730 01:18:01 -- common/autotest_common.sh@1358 -- # fc=930 00:25:11.730 01:18:01 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="9ab39414-5cd7-4f5d-b626-09f78b81b4e7") .cluster_size' 00:25:11.730 01:18:01 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:11.730 01:18:01 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:11.730 01:18:01 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:11.730 952320 00:25:11.730 01:18:01 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:11.989 cba72252-33da-431d-8438-7f7d9050e9db 00:25:11.989 01:18:02 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:12.249 01:18:02 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:12.507 01:18:02 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:12.765 01:18:03 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:12.766 01:18:03 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:12.766 01:18:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:12.766 01:18:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:12.766 01:18:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:12.766 01:18:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:12.766 01:18:03 -- common/autotest_common.sh@1330 -- # shift 00:25:12.766 01:18:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:12.766 01:18:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:12.766 01:18:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:12.766 01:18:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:12.766 01:18:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:12.766 01:18:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:12.766 01:18:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:12.766 01:18:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:13.024 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:13.024 fio-3.35 00:25:13.024 Starting 1 thread 00:25:13.024 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.557 00:25:15.557 test: (groupid=0, jobs=1): err= 0: pid=1143549: Tue Nov 26 01:18:05 2024 00:25:15.557 read: IOPS=6227, BW=24.3MiB/s (25.5MB/s)(48.8MiB/2008msec) 00:25:15.557 slat (nsec): min=1950, max=158739, avg=2628.77, stdev=2287.89 00:25:15.557 clat (usec): min=813, max=170569, avg=11280.75, stdev=11397.43 00:25:15.557 lat (usec): min=815, max=170603, avg=11283.38, stdev=11397.68 00:25:15.557 clat percentiles (msec): 00:25:15.557 | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 10], 00:25:15.557 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:25:15.557 | 70.00th=[ 11], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 12], 00:25:15.557 | 99.00th=[ 13], 99.50th=[ 155], 99.90th=[ 171], 99.95th=[ 171], 00:25:15.557 | 99.99th=[ 171] 00:25:15.557 bw ( KiB/s): min=17504, max=27488, per=99.83%, avg=24866.00, stdev=4912.05, samples=4 00:25:15.557 iops : min= 4376, max= 6872, avg=6216.50, stdev=1228.01, samples=4 00:25:15.557 write: IOPS=6217, BW=24.3MiB/s (25.5MB/s)(48.8MiB/2008msec); 0 zone resets 00:25:15.557 slat (usec): min=2, max=100, avg= 2.68, stdev= 1.67 00:25:15.557 clat (usec): min=318, max=168922, avg=9138.76, stdev=10705.74 00:25:15.557 lat (usec): min=320, max=168928, avg=9141.44, stdev=10705.97 00:25:15.557 clat percentiles (msec): 00:25:15.557 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:25:15.557 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:25:15.557 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:25:15.557 | 99.00th=[ 11], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:15.557 | 99.99th=[ 169] 00:25:15.557 bw ( KiB/s): min=18416, max=27136, per=99.95%, avg=24858.00, stdev=4295.94, samples=4 00:25:15.557 iops : min= 4604, max= 6784, avg=6214.50, stdev=1073.98, samples=4 00:25:15.557 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:15.557 lat (msec) : 2=0.03%, 4=0.14%, 10=63.86%, 20=35.44%, 250=0.51% 00:25:15.557 cpu : usr=59.89%, sys=37.92%, ctx=104, majf=0, minf=37 00:25:15.557 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:15.557 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:15.557 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:15.557 issued rwts: total=12504,12485,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:15.557 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:15.557 00:25:15.557 Run status group 0 (all jobs): 00:25:15.557 READ: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.8MiB (51.2MB), run=2008-2008msec 00:25:15.557 WRITE: bw=24.3MiB/s (25.5MB/s), 24.3MiB/s-24.3MiB/s (25.5MB/s-25.5MB/s), io=48.8MiB (51.1MB), run=2008-2008msec 00:25:15.557 01:18:05 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:15.557 01:18:05 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:16.937 01:18:07 -- host/fio.sh@64 -- # ls_nested_guid=20e25390-1bbe-4142-a88b-83782ed03b69 00:25:16.937 01:18:07 -- host/fio.sh@65 -- # get_lvs_free_mb 20e25390-1bbe-4142-a88b-83782ed03b69 00:25:16.937 01:18:07 -- common/autotest_common.sh@1353 -- # local lvs_uuid=20e25390-1bbe-4142-a88b-83782ed03b69 00:25:16.937 01:18:07 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:16.937 01:18:07 -- common/autotest_common.sh@1355 -- # local fc 00:25:16.937 01:18:07 -- common/autotest_common.sh@1356 -- # local cs 00:25:16.937 01:18:07 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:16.937 01:18:07 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:16.937 { 00:25:16.937 "uuid": "9ab39414-5cd7-4f5d-b626-09f78b81b4e7", 00:25:16.937 "name": "lvs_0", 00:25:16.937 "base_bdev": "Nvme0n1", 00:25:16.937 "total_data_clusters": 930, 00:25:16.937 "free_clusters": 0, 00:25:16.937 "block_size": 512, 00:25:16.937 "cluster_size": 1073741824 00:25:16.937 }, 00:25:16.937 { 00:25:16.937 "uuid": "20e25390-1bbe-4142-a88b-83782ed03b69", 00:25:16.937 "name": "lvs_n_0", 00:25:16.937 "base_bdev": "cba72252-33da-431d-8438-7f7d9050e9db", 00:25:16.937 "total_data_clusters": 237847, 00:25:16.937 "free_clusters": 237847, 00:25:16.937 "block_size": 512, 00:25:16.937 "cluster_size": 4194304 00:25:16.937 } 00:25:16.937 ]' 00:25:16.937 01:18:07 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="20e25390-1bbe-4142-a88b-83782ed03b69") .free_clusters' 00:25:16.937 01:18:07 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:16.937 01:18:07 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="20e25390-1bbe-4142-a88b-83782ed03b69") .cluster_size' 00:25:16.937 01:18:07 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:16.937 01:18:07 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:16.937 01:18:07 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:16.937 951388 00:25:16.937 01:18:07 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:17.871 b2a37169-ba74-4fa8-9dda-56e9fd9fb6d0 00:25:17.871 01:18:08 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:17.871 01:18:08 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:18.438 01:18:08 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:18.438 01:18:08 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.438 01:18:08 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.438 01:18:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:18.438 01:18:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:18.438 01:18:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:18.438 01:18:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.438 01:18:08 -- common/autotest_common.sh@1330 -- # shift 00:25:18.438 01:18:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:18.438 01:18:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:18.438 01:18:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:18.438 01:18:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:18.438 01:18:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:18.438 01:18:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:18.438 01:18:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:18.438 01:18:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:18.697 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:18.697 fio-3.35 00:25:18.697 Starting 1 thread 00:25:18.697 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.283 00:25:21.283 test: (groupid=0, jobs=1): err= 0: pid=1144881: Tue Nov 26 01:18:11 2024 00:25:21.283 read: IOPS=6147, BW=24.0MiB/s (25.2MB/s)(48.2MiB/2009msec) 00:25:21.283 slat (nsec): min=1940, max=136613, avg=2584.13, stdev=1900.78 00:25:21.283 clat (usec): min=4267, max=19464, avg=11484.02, stdev=979.93 00:25:21.283 lat (usec): min=4271, max=19467, avg=11486.61, stdev=979.84 00:25:21.283 clat percentiles (usec): 00:25:21.283 | 1.00th=[ 9110], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[10683], 00:25:21.283 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:25:21.283 | 70.00th=[11994], 80.00th=[12256], 90.00th=[12649], 95.00th=[13042], 00:25:21.283 | 99.00th=[13698], 99.50th=[13960], 99.90th=[16909], 99.95th=[18482], 00:25:21.283 | 99.99th=[19530] 00:25:21.283 bw ( KiB/s): min=23256, max=25152, per=99.91%, avg=24566.00, stdev=888.41, samples=4 00:25:21.283 iops : min= 5814, max= 6288, avg=6141.50, stdev=222.10, samples=4 00:25:21.283 write: IOPS=6131, BW=24.0MiB/s (25.1MB/s)(48.1MiB/2009msec); 0 zone resets 00:25:21.283 slat (nsec): min=2057, max=91239, avg=2644.64, stdev=1357.02 00:25:21.283 clat (usec): min=2049, max=16831, avg=9188.30, stdev=855.73 00:25:21.283 lat (usec): min=2055, max=16835, avg=9190.95, stdev=855.71 00:25:21.283 clat percentiles (usec): 00:25:21.283 | 1.00th=[ 7242], 5.00th=[ 7898], 10.00th=[ 8225], 20.00th=[ 8586], 00:25:21.283 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:25:21.283 | 70.00th=[ 9503], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10421], 00:25:21.284 | 99.00th=[11076], 99.50th=[11469], 99.90th=[15270], 99.95th=[15664], 00:25:21.284 | 99.99th=[16712] 00:25:21.284 bw ( KiB/s): min=24328, max=24760, per=99.96%, avg=24516.00, stdev=193.16, samples=4 00:25:21.284 iops : min= 6082, max= 6190, avg=6129.00, stdev=48.29, samples=4 00:25:21.284 lat (msec) : 4=0.04%, 10=45.19%, 20=54.77% 00:25:21.284 cpu : usr=61.90%, sys=35.86%, ctx=152, majf=0, minf=37 00:25:21.284 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:21.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:21.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:21.284 issued rwts: total=12350,12318,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:21.284 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:21.284 00:25:21.284 Run status group 0 (all jobs): 00:25:21.284 READ: bw=24.0MiB/s (25.2MB/s), 24.0MiB/s-24.0MiB/s (25.2MB/s-25.2MB/s), io=48.2MiB (50.6MB), run=2009-2009msec 00:25:21.284 WRITE: bw=24.0MiB/s (25.1MB/s), 24.0MiB/s-24.0MiB/s (25.1MB/s-25.1MB/s), io=48.1MiB (50.5MB), run=2009-2009msec 00:25:21.284 01:18:11 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:21.284 01:18:11 -- host/fio.sh@74 -- # sync 00:25:21.284 01:18:11 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:25.504 01:18:15 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:25.504 01:18:15 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:28.795 01:18:18 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:28.795 01:18:18 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:30.698 01:18:20 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:30.698 01:18:20 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:30.698 01:18:20 -- host/fio.sh@86 -- # nvmftestfini 00:25:30.698 01:18:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:30.698 01:18:20 -- nvmf/common.sh@116 -- # sync 00:25:30.698 01:18:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:30.698 01:18:20 -- nvmf/common.sh@119 -- # set +e 00:25:30.698 01:18:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:30.698 01:18:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:30.698 rmmod nvme_tcp 00:25:30.698 rmmod nvme_fabrics 00:25:30.698 rmmod nvme_keyring 00:25:30.698 01:18:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:30.698 01:18:20 -- nvmf/common.sh@123 -- # set -e 00:25:30.698 01:18:20 -- nvmf/common.sh@124 -- # return 0 00:25:30.698 01:18:20 -- nvmf/common.sh@477 -- # '[' -n 1141207 ']' 00:25:30.698 01:18:20 -- nvmf/common.sh@478 -- # killprocess 1141207 00:25:30.698 01:18:20 -- common/autotest_common.sh@936 -- # '[' -z 1141207 ']' 00:25:30.698 01:18:20 -- common/autotest_common.sh@940 -- # kill -0 1141207 00:25:30.698 01:18:20 -- common/autotest_common.sh@941 -- # uname 00:25:30.698 01:18:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:30.698 01:18:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1141207 00:25:30.698 01:18:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:30.698 01:18:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:30.698 01:18:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1141207' 00:25:30.698 killing process with pid 1141207 00:25:30.698 01:18:20 -- common/autotest_common.sh@955 -- # kill 1141207 00:25:30.698 01:18:20 -- common/autotest_common.sh@960 -- # wait 1141207 00:25:30.957 01:18:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:30.957 01:18:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:30.957 01:18:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:30.957 01:18:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:30.957 01:18:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:30.957 01:18:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.957 01:18:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.957 01:18:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.866 01:18:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.866 00:25:32.866 real 0m38.070s 00:25:32.866 user 2m25.241s 00:25:32.866 sys 0m7.487s 00:25:32.866 01:18:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.866 01:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.866 ************************************ 00:25:32.866 END TEST nvmf_fio_host 00:25:32.866 ************************************ 00:25:32.866 01:18:23 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:32.866 01:18:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:32.866 01:18:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:32.866 01:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:32.866 ************************************ 00:25:32.866 START TEST nvmf_failover 00:25:32.866 ************************************ 00:25:32.866 01:18:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:32.866 * Looking for test storage... 00:25:32.866 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:32.866 01:18:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:32.866 01:18:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:32.866 01:18:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:33.126 01:18:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:33.126 01:18:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:33.126 01:18:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:33.126 01:18:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:33.126 01:18:23 -- scripts/common.sh@335 -- # IFS=.-: 00:25:33.126 01:18:23 -- scripts/common.sh@335 -- # read -ra ver1 00:25:33.126 01:18:23 -- scripts/common.sh@336 -- # IFS=.-: 00:25:33.126 01:18:23 -- scripts/common.sh@336 -- # read -ra ver2 00:25:33.126 01:18:23 -- scripts/common.sh@337 -- # local 'op=<' 00:25:33.126 01:18:23 -- scripts/common.sh@339 -- # ver1_l=2 00:25:33.126 01:18:23 -- scripts/common.sh@340 -- # ver2_l=1 00:25:33.126 01:18:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:33.126 01:18:23 -- scripts/common.sh@343 -- # case "$op" in 00:25:33.126 01:18:23 -- scripts/common.sh@344 -- # : 1 00:25:33.126 01:18:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:33.126 01:18:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:33.126 01:18:23 -- scripts/common.sh@364 -- # decimal 1 00:25:33.126 01:18:23 -- scripts/common.sh@352 -- # local d=1 00:25:33.126 01:18:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:33.126 01:18:23 -- scripts/common.sh@354 -- # echo 1 00:25:33.126 01:18:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:33.126 01:18:23 -- scripts/common.sh@365 -- # decimal 2 00:25:33.126 01:18:23 -- scripts/common.sh@352 -- # local d=2 00:25:33.126 01:18:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:33.126 01:18:23 -- scripts/common.sh@354 -- # echo 2 00:25:33.126 01:18:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:33.126 01:18:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:33.126 01:18:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:33.126 01:18:23 -- scripts/common.sh@367 -- # return 0 00:25:33.126 01:18:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:33.126 01:18:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:33.126 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.126 --rc genhtml_branch_coverage=1 00:25:33.126 --rc genhtml_function_coverage=1 00:25:33.126 --rc genhtml_legend=1 00:25:33.126 --rc geninfo_all_blocks=1 00:25:33.126 --rc geninfo_unexecuted_blocks=1 00:25:33.126 00:25:33.126 ' 00:25:33.126 01:18:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:33.126 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.126 --rc genhtml_branch_coverage=1 00:25:33.126 --rc genhtml_function_coverage=1 00:25:33.126 --rc genhtml_legend=1 00:25:33.126 --rc geninfo_all_blocks=1 00:25:33.126 --rc geninfo_unexecuted_blocks=1 00:25:33.126 00:25:33.126 ' 00:25:33.126 01:18:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:33.126 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.126 --rc genhtml_branch_coverage=1 00:25:33.126 --rc genhtml_function_coverage=1 00:25:33.126 --rc genhtml_legend=1 00:25:33.126 --rc geninfo_all_blocks=1 00:25:33.126 --rc geninfo_unexecuted_blocks=1 00:25:33.126 00:25:33.126 ' 00:25:33.126 01:18:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:33.126 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:33.126 --rc genhtml_branch_coverage=1 00:25:33.126 --rc genhtml_function_coverage=1 00:25:33.126 --rc genhtml_legend=1 00:25:33.126 --rc geninfo_all_blocks=1 00:25:33.126 --rc geninfo_unexecuted_blocks=1 00:25:33.126 00:25:33.126 ' 00:25:33.126 01:18:23 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:33.126 01:18:23 -- nvmf/common.sh@7 -- # uname -s 00:25:33.126 01:18:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:33.126 01:18:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:33.126 01:18:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:33.126 01:18:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:33.127 01:18:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:33.127 01:18:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:33.127 01:18:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:33.127 01:18:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:33.127 01:18:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:33.127 01:18:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:33.127 01:18:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:33.127 01:18:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:33.127 01:18:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:33.127 01:18:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:33.127 01:18:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:33.127 01:18:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:33.127 01:18:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:33.127 01:18:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:33.127 01:18:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:33.127 01:18:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.127 01:18:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.127 01:18:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.127 01:18:23 -- paths/export.sh@5 -- # export PATH 00:25:33.127 01:18:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:33.127 01:18:23 -- nvmf/common.sh@46 -- # : 0 00:25:33.127 01:18:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:33.127 01:18:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:33.127 01:18:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:33.127 01:18:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:33.127 01:18:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:33.127 01:18:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:33.127 01:18:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:33.127 01:18:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:33.127 01:18:23 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:33.127 01:18:23 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:33.127 01:18:23 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:33.127 01:18:23 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:33.127 01:18:23 -- host/failover.sh@18 -- # nvmftestinit 00:25:33.127 01:18:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:33.127 01:18:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:33.127 01:18:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:33.127 01:18:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:33.127 01:18:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:33.127 01:18:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:33.127 01:18:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:33.127 01:18:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:33.127 01:18:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:33.127 01:18:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:33.127 01:18:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:33.127 01:18:23 -- common/autotest_common.sh@10 -- # set +x 00:25:35.040 01:18:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:35.040 01:18:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:35.040 01:18:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:35.040 01:18:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:35.040 01:18:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:35.040 01:18:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:35.040 01:18:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:35.040 01:18:25 -- nvmf/common.sh@294 -- # net_devs=() 00:25:35.040 01:18:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:35.040 01:18:25 -- nvmf/common.sh@295 -- # e810=() 00:25:35.040 01:18:25 -- nvmf/common.sh@295 -- # local -ga e810 00:25:35.040 01:18:25 -- nvmf/common.sh@296 -- # x722=() 00:25:35.040 01:18:25 -- nvmf/common.sh@296 -- # local -ga x722 00:25:35.040 01:18:25 -- nvmf/common.sh@297 -- # mlx=() 00:25:35.040 01:18:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:35.040 01:18:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:35.040 01:18:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:35.040 01:18:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:35.040 01:18:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:35.040 01:18:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:35.040 01:18:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:35.040 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:35.040 01:18:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:35.040 01:18:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:35.040 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:35.040 01:18:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:35.040 01:18:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:35.041 01:18:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:35.041 01:18:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:35.041 01:18:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:35.041 01:18:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:35.041 01:18:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:35.041 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:35.041 01:18:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:35.041 01:18:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:35.041 01:18:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:35.041 01:18:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:35.041 01:18:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:35.041 01:18:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:35.041 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:35.041 01:18:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:35.041 01:18:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:35.041 01:18:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:35.041 01:18:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:35.041 01:18:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:35.041 01:18:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:35.041 01:18:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:35.041 01:18:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:35.041 01:18:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:35.041 01:18:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:35.041 01:18:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:35.041 01:18:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:35.041 01:18:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:35.041 01:18:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:35.041 01:18:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:35.041 01:18:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:35.041 01:18:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:35.041 01:18:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:35.041 01:18:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:35.041 01:18:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:35.323 01:18:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:35.323 01:18:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:35.323 01:18:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:35.323 01:18:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:35.323 01:18:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:35.323 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:35.323 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:25:35.323 00:25:35.323 --- 10.0.0.2 ping statistics --- 00:25:35.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:35.323 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:25:35.323 01:18:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:35.323 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:35.323 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:25:35.323 00:25:35.323 --- 10.0.0.1 ping statistics --- 00:25:35.323 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:35.323 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:25:35.323 01:18:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:35.323 01:18:25 -- nvmf/common.sh@410 -- # return 0 00:25:35.323 01:18:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:35.323 01:18:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:35.323 01:18:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:35.323 01:18:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:35.323 01:18:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:35.323 01:18:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:35.323 01:18:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:35.323 01:18:25 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:35.323 01:18:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:35.323 01:18:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:35.323 01:18:25 -- common/autotest_common.sh@10 -- # set +x 00:25:35.323 01:18:25 -- nvmf/common.sh@469 -- # nvmfpid=1148189 00:25:35.323 01:18:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:35.323 01:18:25 -- nvmf/common.sh@470 -- # waitforlisten 1148189 00:25:35.323 01:18:25 -- common/autotest_common.sh@829 -- # '[' -z 1148189 ']' 00:25:35.323 01:18:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:35.323 01:18:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:35.323 01:18:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:35.323 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:35.324 01:18:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:35.324 01:18:25 -- common/autotest_common.sh@10 -- # set +x 00:25:35.324 [2024-11-26 01:18:25.701471] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:35.324 [2024-11-26 01:18:25.701560] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:35.324 EAL: No free 2048 kB hugepages reported on node 1 00:25:35.324 [2024-11-26 01:18:25.766340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:35.582 [2024-11-26 01:18:25.875323] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:35.582 [2024-11-26 01:18:25.875480] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:35.582 [2024-11-26 01:18:25.875497] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:35.582 [2024-11-26 01:18:25.875510] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:35.582 [2024-11-26 01:18:25.875637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:35.582 [2024-11-26 01:18:25.875708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:35.582 [2024-11-26 01:18:25.875712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:36.147 01:18:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:36.147 01:18:26 -- common/autotest_common.sh@862 -- # return 0 00:25:36.147 01:18:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:36.147 01:18:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:36.147 01:18:26 -- common/autotest_common.sh@10 -- # set +x 00:25:36.404 01:18:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:36.404 01:18:26 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:36.404 [2024-11-26 01:18:26.919206] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:36.662 01:18:26 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:36.919 Malloc0 00:25:36.919 01:18:27 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:37.178 01:18:27 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:37.435 01:18:27 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:37.435 [2024-11-26 01:18:27.942999] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:37.435 01:18:27 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:37.692 [2024-11-26 01:18:28.191679] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:37.692 01:18:28 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:37.949 [2024-11-26 01:18:28.464633] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:38.206 01:18:28 -- host/failover.sh@31 -- # bdevperf_pid=1148615 00:25:38.206 01:18:28 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:38.206 01:18:28 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:38.206 01:18:28 -- host/failover.sh@34 -- # waitforlisten 1148615 /var/tmp/bdevperf.sock 00:25:38.206 01:18:28 -- common/autotest_common.sh@829 -- # '[' -z 1148615 ']' 00:25:38.206 01:18:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:38.206 01:18:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:38.206 01:18:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:38.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:38.206 01:18:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:38.206 01:18:28 -- common/autotest_common.sh@10 -- # set +x 00:25:39.141 01:18:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:39.141 01:18:29 -- common/autotest_common.sh@862 -- # return 0 00:25:39.141 01:18:29 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:39.706 NVMe0n1 00:25:39.706 01:18:30 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:39.964 00:25:39.964 01:18:30 -- host/failover.sh@39 -- # run_test_pid=1148763 00:25:39.964 01:18:30 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:39.964 01:18:30 -- host/failover.sh@41 -- # sleep 1 00:25:41.341 01:18:31 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:41.341 [2024-11-26 01:18:31.713564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713665] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.341 [2024-11-26 01:18:31.713979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.713991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714026] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 [2024-11-26 01:18:31.714309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbccb0 is same with the state(5) to be set 00:25:41.342 01:18:31 -- host/failover.sh@45 -- # sleep 3 00:25:44.632 01:18:34 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:44.890 00:25:44.890 01:18:35 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:45.148 [2024-11-26 01:18:35.477749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.148 [2024-11-26 01:18:35.477790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.148 [2024-11-26 01:18:35.477805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.148 [2024-11-26 01:18:35.477819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.148 [2024-11-26 01:18:35.477832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.148 [2024-11-26 01:18:35.477845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.148 [2024-11-26 01:18:35.477858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477951] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477962] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.477996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478055] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 [2024-11-26 01:18:35.478256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbe3a0 is same with the state(5) to be set 00:25:45.149 01:18:35 -- host/failover.sh@50 -- # sleep 3 00:25:48.435 01:18:38 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:48.436 [2024-11-26 01:18:38.771302] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:48.436 01:18:38 -- host/failover.sh@55 -- # sleep 1 00:25:49.370 01:18:39 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:49.630 [2024-11-26 01:18:40.046025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 [2024-11-26 01:18:40.046766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xfbea80 is same with the state(5) to be set 00:25:49.630 01:18:40 -- host/failover.sh@59 -- # wait 1148763 00:25:56.206 0 00:25:56.206 01:18:45 -- host/failover.sh@61 -- # killprocess 1148615 00:25:56.206 01:18:45 -- common/autotest_common.sh@936 -- # '[' -z 1148615 ']' 00:25:56.206 01:18:45 -- common/autotest_common.sh@940 -- # kill -0 1148615 00:25:56.206 01:18:45 -- common/autotest_common.sh@941 -- # uname 00:25:56.206 01:18:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:56.207 01:18:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1148615 00:25:56.207 01:18:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:56.207 01:18:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:56.207 01:18:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1148615' 00:25:56.207 killing process with pid 1148615 00:25:56.207 01:18:45 -- common/autotest_common.sh@955 -- # kill 1148615 00:25:56.207 01:18:45 -- common/autotest_common.sh@960 -- # wait 1148615 00:25:56.207 01:18:45 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:56.207 [2024-11-26 01:18:28.521417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:56.207 [2024-11-26 01:18:28.521512] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1148615 ] 00:25:56.207 EAL: No free 2048 kB hugepages reported on node 1 00:25:56.207 [2024-11-26 01:18:28.584311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:56.207 [2024-11-26 01:18:28.692826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:56.207 Running I/O for 15 seconds... 00:25:56.207 [2024-11-26 01:18:31.714579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:118848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:118864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:118872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:118896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:118384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:118400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:118416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:118432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.714970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:118440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.714984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:118904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:118920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:118928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:118952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:119016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:119040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.207 [2024-11-26 01:18:31.715182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:119048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:119056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.207 [2024-11-26 01:18:31.715236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:119064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.207 [2024-11-26 01:18:31.715263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:119072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.207 [2024-11-26 01:18:31.715290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:118448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:118456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:118496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:118528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:118552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:119080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:119088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:119096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.207 [2024-11-26 01:18:31.715586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:119104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.207 [2024-11-26 01:18:31.715613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.207 [2024-11-26 01:18:31.715626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:119112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.715639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:119120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:119128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:119136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:119144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:119152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.715812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:119160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.715839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:119168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:119176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.715893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:119184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:119192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.715948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:119200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.715975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.715989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:119208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:119216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:119224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:119232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:119240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:119248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:119256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:119264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:118568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:118584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:118632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:118640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:118648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:118672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:118680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:118696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:118720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:118736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:118800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:118808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:118816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:118824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:119272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.208 [2024-11-26 01:18:31.716681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:119280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.208 [2024-11-26 01:18:31.716753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:119288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.208 [2024-11-26 01:18:31.716766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:119296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.716798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:119304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.716827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:119312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.716855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:119320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.716884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:119328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.716911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:119336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.716939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:119344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.716968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.716983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:119352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.716996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:119360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:119368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:119376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:119384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:119392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:118840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:118856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:118880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:118888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:118912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:118936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:118944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:119400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:119408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:119416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:119424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:119432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:119440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:119448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:119456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:119464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:119472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:119480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:119488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:119496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:119504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:119512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:119520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.209 [2024-11-26 01:18:31.717900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:119528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.209 [2024-11-26 01:18:31.717944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:119536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.209 [2024-11-26 01:18:31.717961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.717976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:119544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.717993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:119552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.210 [2024-11-26 01:18:31.718037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:119560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:119568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:119576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.210 [2024-11-26 01:18:31.718124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:119584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.210 [2024-11-26 01:18:31.718152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:119592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.210 [2024-11-26 01:18:31.718180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:119600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:118968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:118976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:118984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:119000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:119008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:119024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:31.718408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10df6a0 is same with the state(5) to be set 00:25:56.210 [2024-11-26 01:18:31.718438] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:56.210 [2024-11-26 01:18:31.718449] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:56.210 [2024-11-26 01:18:31.718467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:119032 len:8 PRP1 0x0 PRP2 0x0 00:25:56.210 [2024-11-26 01:18:31.718481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718549] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10df6a0 was disconnected and freed. reset controller. 00:25:56.210 [2024-11-26 01:18:31.718587] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:25:56.210 [2024-11-26 01:18:31.718636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:31.718655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718681] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:31.718704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718719] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:31.718732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:31.718759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:31.718772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:56.210 [2024-11-26 01:18:31.720920] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:56.210 [2024-11-26 01:18:31.720959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c0870 (9): Bad file descriptor 00:25:56.210 [2024-11-26 01:18:31.875438] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:56.210 [2024-11-26 01:18:35.476366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:35.476436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.476475] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:35.476489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.476502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:35.476515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.476529] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.210 [2024-11-26 01:18:35.476541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.476553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c0870 is same with the state(5) to be set 00:25:56.210 [2024-11-26 01:18:35.478382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:35360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:35368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:34712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:34744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:34752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:34768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:34776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:34784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.210 [2024-11-26 01:18:35.478737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:35376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.210 [2024-11-26 01:18:35.478751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:34808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:34824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:34840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:34848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:34864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:34872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.478974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.478989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:35416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:34888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:34896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:34904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:34912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:34944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:34952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:34976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:34984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:35000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:35024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:35032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:35040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:35064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:35088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:35464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.211 [2024-11-26 01:18:35.479531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:35472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:35480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.211 [2024-11-26 01:18:35.479584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:35488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.211 [2024-11-26 01:18:35.479610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.211 [2024-11-26 01:18:35.479637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.211 [2024-11-26 01:18:35.479663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.211 [2024-11-26 01:18:35.479702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:35512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.211 [2024-11-26 01:18:35.479717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:35520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.479744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:35528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.479772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:35536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.479803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:35544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.479831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.479858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.479886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:35120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.479913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.479940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:35136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.479981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.479996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:35208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:35216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:35560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:35568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:35576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:35592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:35608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:35616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:35632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:35648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:35656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:35664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:35672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:35680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:35688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:35696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:35704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.212 [2024-11-26 01:18:35.480592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:35720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:35728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:35232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:35240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:35264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.212 [2024-11-26 01:18:35.480819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:35272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.212 [2024-11-26 01:18:35.480832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.480850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:35296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.480863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.480878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:35304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.480890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.480904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:35312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.480917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.480931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:35736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.480943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.480958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.480985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.480999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:35752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:35760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:35768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:35776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:35784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:35792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:35800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:35808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:35816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:35824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:35832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:35848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:35864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:35872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:35880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:35888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:35896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:35904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:35920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:35928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:35936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:35944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:35952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:35960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:35968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:35976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.213 [2024-11-26 01:18:35.481823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:35352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:35384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:35392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:35400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.481968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.213 [2024-11-26 01:18:35.481983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:35408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.213 [2024-11-26 01:18:35.482011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:35.482027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:35432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:35.482041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:35.482056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:35440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:35.482069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:35.482082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ecc90 is same with the state(5) to be set 00:25:56.214 [2024-11-26 01:18:35.482097] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:56.214 [2024-11-26 01:18:35.482108] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:56.214 [2024-11-26 01:18:35.482119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35448 len:8 PRP1 0x0 PRP2 0x0 00:25:56.214 [2024-11-26 01:18:35.482132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:35.482187] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10ecc90 was disconnected and freed. reset controller. 00:25:56.214 [2024-11-26 01:18:35.482204] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:25:56.214 [2024-11-26 01:18:35.482219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:56.214 [2024-11-26 01:18:35.484492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:56.214 [2024-11-26 01:18:35.484531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c0870 (9): Bad file descriptor 00:25:56.214 [2024-11-26 01:18:35.594842] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:56.214 [2024-11-26 01:18:40.046902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.046944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.046977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.046994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:25648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:25656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:25024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:25040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:25056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:25072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:25080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:25664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:25120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:25128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:25160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:25184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:25192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:25200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:25216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:25736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:25224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:25256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:25280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:25288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.214 [2024-11-26 01:18:40.047918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.214 [2024-11-26 01:18:40.047939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.047955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:25320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.047968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.047984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:25328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.047997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:25760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:25768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:25776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:25784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:25792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:25800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:25816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:25824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:25832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.215 [2024-11-26 01:18:40.048350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:25880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:25896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.215 [2024-11-26 01:18:40.048456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:25904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.215 [2024-11-26 01:18:40.048483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:25912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:25928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.215 [2024-11-26 01:18:40.048567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:25936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.215 [2024-11-26 01:18:40.048629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:25960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.215 [2024-11-26 01:18:40.048695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:25968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:25336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:25344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:25352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:25376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:25408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:25424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:25432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.048978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.215 [2024-11-26 01:18:40.048991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.215 [2024-11-26 01:18:40.049023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:25456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:25472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:25480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:25504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:25528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:25976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:25984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:26000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:26016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:26024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:26032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:26040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:26056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:26064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.049583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:25576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:25632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:25640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:26088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:26096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:26104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.049974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.049989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:26112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.050003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.050032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.050061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:26136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.050090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:26144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.050123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:26152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.216 [2024-11-26 01:18:40.050152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:26160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.050181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.216 [2024-11-26 01:18:40.050198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:26168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.216 [2024-11-26 01:18:40.050211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:26176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.217 [2024-11-26 01:18:40.050240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:26184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.217 [2024-11-26 01:18:40.050269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:26200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:26216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.217 [2024-11-26 01:18:40.050388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:26224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:26232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.217 [2024-11-26 01:18:40.050445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:26240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.217 [2024-11-26 01:18:40.050473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:26248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:26256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:25:56.217 [2024-11-26 01:18:40.050536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:26264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:25680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:25696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:25704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:25712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:25720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:25840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:56.217 [2024-11-26 01:18:40.050780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10ccd10 is same with the state(5) to be set 00:25:56.217 [2024-11-26 01:18:40.050814] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:25:56.217 [2024-11-26 01:18:40.050825] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:25:56.217 [2024-11-26 01:18:40.050846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25864 len:8 PRP1 0x0 PRP2 0x0 00:25:56.217 [2024-11-26 01:18:40.050861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.050927] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x10ccd10 was disconnected and freed. reset controller. 00:25:56.217 [2024-11-26 01:18:40.050950] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:25:56.217 [2024-11-26 01:18:40.050985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.217 [2024-11-26 01:18:40.051004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.051019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.217 [2024-11-26 01:18:40.051031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.051045] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.217 [2024-11-26 01:18:40.051057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.051070] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:56.217 [2024-11-26 01:18:40.051083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:56.217 [2024-11-26 01:18:40.051096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:56.217 [2024-11-26 01:18:40.053101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:56.217 [2024-11-26 01:18:40.053143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10c0870 (9): Bad file descriptor 00:25:56.217 [2024-11-26 01:18:40.202152] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:56.217 00:25:56.217 Latency(us) 00:25:56.217 [2024-11-26T00:18:46.752Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:56.217 [2024-11-26T00:18:46.752Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:25:56.217 Verification LBA range: start 0x0 length 0x4000 00:25:56.217 NVMe0n1 : 15.01 12530.90 48.95 1599.36 0.00 9041.93 731.21 17670.45 00:25:56.217 [2024-11-26T00:18:46.752Z] =================================================================================================================== 00:25:56.217 [2024-11-26T00:18:46.752Z] Total : 12530.90 48.95 1599.36 0.00 9041.93 731.21 17670.45 00:25:56.217 Received shutdown signal, test time was about 15.000000 seconds 00:25:56.217 00:25:56.217 Latency(us) 00:25:56.217 [2024-11-26T00:18:46.752Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:56.217 [2024-11-26T00:18:46.752Z] =================================================================================================================== 00:25:56.217 [2024-11-26T00:18:46.752Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:56.217 01:18:45 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:25:56.217 01:18:45 -- host/failover.sh@65 -- # count=3 00:25:56.217 01:18:45 -- host/failover.sh@67 -- # (( count != 3 )) 00:25:56.217 01:18:45 -- host/failover.sh@73 -- # bdevperf_pid=1150668 00:25:56.217 01:18:45 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:25:56.217 01:18:45 -- host/failover.sh@75 -- # waitforlisten 1150668 /var/tmp/bdevperf.sock 00:25:56.217 01:18:45 -- common/autotest_common.sh@829 -- # '[' -z 1150668 ']' 00:25:56.217 01:18:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:56.217 01:18:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:56.217 01:18:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:56.217 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:56.217 01:18:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:56.217 01:18:45 -- common/autotest_common.sh@10 -- # set +x 00:25:56.475 01:18:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:56.476 01:18:46 -- common/autotest_common.sh@862 -- # return 0 00:25:56.476 01:18:46 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:56.733 [2024-11-26 01:18:47.165175] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:56.734 01:18:47 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:56.991 [2024-11-26 01:18:47.466002] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:56.992 01:18:47 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:57.559 NVMe0n1 00:25:57.559 01:18:47 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:57.817 00:25:57.817 01:18:48 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:58.384 00:25:58.384 01:18:48 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:58.385 01:18:48 -- host/failover.sh@82 -- # grep -q NVMe0 00:25:58.643 01:18:48 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:58.901 01:18:49 -- host/failover.sh@87 -- # sleep 3 00:26:02.225 01:18:52 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:02.225 01:18:52 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:02.225 01:18:52 -- host/failover.sh@90 -- # run_test_pid=1151485 00:26:02.225 01:18:52 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:02.225 01:18:52 -- host/failover.sh@92 -- # wait 1151485 00:26:03.206 0 00:26:03.206 01:18:53 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:03.206 [2024-11-26 01:18:45.964514] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.206 [2024-11-26 01:18:45.964605] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1150668 ] 00:26:03.206 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.206 [2024-11-26 01:18:46.023087] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:03.206 [2024-11-26 01:18:46.128982] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:03.207 [2024-11-26 01:18:49.219615] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:03.207 [2024-11-26 01:18:49.219717] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.207 [2024-11-26 01:18:49.219756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.207 [2024-11-26 01:18:49.219774] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.207 [2024-11-26 01:18:49.219788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.207 [2024-11-26 01:18:49.219802] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.207 [2024-11-26 01:18:49.219816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.207 [2024-11-26 01:18:49.219830] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.207 [2024-11-26 01:18:49.219844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.207 [2024-11-26 01:18:49.219858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.207 [2024-11-26 01:18:49.219897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.207 [2024-11-26 01:18:49.219928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1335870 (9): Bad file descriptor 00:26:03.207 [2024-11-26 01:18:49.224385] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:03.207 Running I/O for 1 seconds... 00:26:03.207 00:26:03.207 Latency(us) 00:26:03.207 [2024-11-26T00:18:53.742Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.207 [2024-11-26T00:18:53.742Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:03.207 Verification LBA range: start 0x0 length 0x4000 00:26:03.207 NVMe0n1 : 1.01 12576.81 49.13 0.00 0.00 10130.18 1419.95 17767.54 00:26:03.207 [2024-11-26T00:18:53.742Z] =================================================================================================================== 00:26:03.207 [2024-11-26T00:18:53.742Z] Total : 12576.81 49.13 0.00 0.00 10130.18 1419.95 17767.54 00:26:03.207 01:18:53 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:03.207 01:18:53 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:03.465 01:18:53 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:03.723 01:18:54 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:03.723 01:18:54 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:03.982 01:18:54 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:04.242 01:18:54 -- host/failover.sh@101 -- # sleep 3 00:26:07.534 01:18:57 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:07.534 01:18:57 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:07.534 01:18:57 -- host/failover.sh@108 -- # killprocess 1150668 00:26:07.534 01:18:57 -- common/autotest_common.sh@936 -- # '[' -z 1150668 ']' 00:26:07.534 01:18:57 -- common/autotest_common.sh@940 -- # kill -0 1150668 00:26:07.534 01:18:57 -- common/autotest_common.sh@941 -- # uname 00:26:07.534 01:18:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:07.534 01:18:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1150668 00:26:07.534 01:18:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:07.534 01:18:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:07.534 01:18:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1150668' 00:26:07.534 killing process with pid 1150668 00:26:07.534 01:18:57 -- common/autotest_common.sh@955 -- # kill 1150668 00:26:07.534 01:18:57 -- common/autotest_common.sh@960 -- # wait 1150668 00:26:07.793 01:18:58 -- host/failover.sh@110 -- # sync 00:26:07.793 01:18:58 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:08.051 01:18:58 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:08.051 01:18:58 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:08.051 01:18:58 -- host/failover.sh@116 -- # nvmftestfini 00:26:08.051 01:18:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:08.051 01:18:58 -- nvmf/common.sh@116 -- # sync 00:26:08.051 01:18:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:08.051 01:18:58 -- nvmf/common.sh@119 -- # set +e 00:26:08.051 01:18:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:08.051 01:18:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:08.051 rmmod nvme_tcp 00:26:08.051 rmmod nvme_fabrics 00:26:08.051 rmmod nvme_keyring 00:26:08.309 01:18:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:08.309 01:18:58 -- nvmf/common.sh@123 -- # set -e 00:26:08.309 01:18:58 -- nvmf/common.sh@124 -- # return 0 00:26:08.309 01:18:58 -- nvmf/common.sh@477 -- # '[' -n 1148189 ']' 00:26:08.309 01:18:58 -- nvmf/common.sh@478 -- # killprocess 1148189 00:26:08.309 01:18:58 -- common/autotest_common.sh@936 -- # '[' -z 1148189 ']' 00:26:08.309 01:18:58 -- common/autotest_common.sh@940 -- # kill -0 1148189 00:26:08.309 01:18:58 -- common/autotest_common.sh@941 -- # uname 00:26:08.309 01:18:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:08.309 01:18:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1148189 00:26:08.309 01:18:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:08.309 01:18:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:08.309 01:18:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1148189' 00:26:08.309 killing process with pid 1148189 00:26:08.309 01:18:58 -- common/autotest_common.sh@955 -- # kill 1148189 00:26:08.309 01:18:58 -- common/autotest_common.sh@960 -- # wait 1148189 00:26:08.566 01:18:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:08.566 01:18:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:08.566 01:18:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:08.566 01:18:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:08.566 01:18:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:08.566 01:18:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:08.566 01:18:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:08.566 01:18:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.484 01:19:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:10.484 00:26:10.484 real 0m37.675s 00:26:10.484 user 2m12.978s 00:26:10.484 sys 0m6.320s 00:26:10.484 01:19:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:10.484 01:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:10.484 ************************************ 00:26:10.484 END TEST nvmf_failover 00:26:10.484 ************************************ 00:26:10.484 01:19:00 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:10.484 01:19:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:10.484 01:19:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:10.484 01:19:00 -- common/autotest_common.sh@10 -- # set +x 00:26:10.484 ************************************ 00:26:10.484 START TEST nvmf_discovery 00:26:10.484 ************************************ 00:26:10.484 01:19:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:10.743 * Looking for test storage... 00:26:10.743 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:10.743 01:19:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:10.743 01:19:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:10.743 01:19:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:10.743 01:19:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:10.743 01:19:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:10.743 01:19:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:10.743 01:19:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:10.743 01:19:01 -- scripts/common.sh@335 -- # IFS=.-: 00:26:10.743 01:19:01 -- scripts/common.sh@335 -- # read -ra ver1 00:26:10.743 01:19:01 -- scripts/common.sh@336 -- # IFS=.-: 00:26:10.743 01:19:01 -- scripts/common.sh@336 -- # read -ra ver2 00:26:10.743 01:19:01 -- scripts/common.sh@337 -- # local 'op=<' 00:26:10.743 01:19:01 -- scripts/common.sh@339 -- # ver1_l=2 00:26:10.743 01:19:01 -- scripts/common.sh@340 -- # ver2_l=1 00:26:10.743 01:19:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:10.743 01:19:01 -- scripts/common.sh@343 -- # case "$op" in 00:26:10.743 01:19:01 -- scripts/common.sh@344 -- # : 1 00:26:10.743 01:19:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:10.743 01:19:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:10.743 01:19:01 -- scripts/common.sh@364 -- # decimal 1 00:26:10.743 01:19:01 -- scripts/common.sh@352 -- # local d=1 00:26:10.743 01:19:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:10.743 01:19:01 -- scripts/common.sh@354 -- # echo 1 00:26:10.743 01:19:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:10.743 01:19:01 -- scripts/common.sh@365 -- # decimal 2 00:26:10.743 01:19:01 -- scripts/common.sh@352 -- # local d=2 00:26:10.743 01:19:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:10.743 01:19:01 -- scripts/common.sh@354 -- # echo 2 00:26:10.743 01:19:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:10.743 01:19:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:10.743 01:19:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:10.743 01:19:01 -- scripts/common.sh@367 -- # return 0 00:26:10.743 01:19:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:10.743 01:19:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:10.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.743 --rc genhtml_branch_coverage=1 00:26:10.743 --rc genhtml_function_coverage=1 00:26:10.743 --rc genhtml_legend=1 00:26:10.743 --rc geninfo_all_blocks=1 00:26:10.743 --rc geninfo_unexecuted_blocks=1 00:26:10.743 00:26:10.743 ' 00:26:10.743 01:19:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:10.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.743 --rc genhtml_branch_coverage=1 00:26:10.743 --rc genhtml_function_coverage=1 00:26:10.743 --rc genhtml_legend=1 00:26:10.743 --rc geninfo_all_blocks=1 00:26:10.743 --rc geninfo_unexecuted_blocks=1 00:26:10.743 00:26:10.743 ' 00:26:10.743 01:19:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:10.743 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.743 --rc genhtml_branch_coverage=1 00:26:10.743 --rc genhtml_function_coverage=1 00:26:10.743 --rc genhtml_legend=1 00:26:10.743 --rc geninfo_all_blocks=1 00:26:10.743 --rc geninfo_unexecuted_blocks=1 00:26:10.743 00:26:10.743 ' 00:26:10.743 01:19:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:10.744 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:10.744 --rc genhtml_branch_coverage=1 00:26:10.744 --rc genhtml_function_coverage=1 00:26:10.744 --rc genhtml_legend=1 00:26:10.744 --rc geninfo_all_blocks=1 00:26:10.744 --rc geninfo_unexecuted_blocks=1 00:26:10.744 00:26:10.744 ' 00:26:10.744 01:19:01 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:10.744 01:19:01 -- nvmf/common.sh@7 -- # uname -s 00:26:10.744 01:19:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:10.744 01:19:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:10.744 01:19:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:10.744 01:19:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:10.744 01:19:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:10.744 01:19:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:10.744 01:19:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:10.744 01:19:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:10.744 01:19:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:10.744 01:19:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:10.744 01:19:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.744 01:19:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:10.744 01:19:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:10.744 01:19:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:10.744 01:19:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:10.744 01:19:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:10.744 01:19:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:10.744 01:19:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:10.744 01:19:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:10.744 01:19:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.744 01:19:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.744 01:19:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.744 01:19:01 -- paths/export.sh@5 -- # export PATH 00:26:10.744 01:19:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:10.744 01:19:01 -- nvmf/common.sh@46 -- # : 0 00:26:10.744 01:19:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:10.744 01:19:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:10.744 01:19:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:10.744 01:19:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:10.744 01:19:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:10.744 01:19:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:10.744 01:19:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:10.744 01:19:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:10.744 01:19:01 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:10.744 01:19:01 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:10.744 01:19:01 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:10.744 01:19:01 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:10.744 01:19:01 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:10.744 01:19:01 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:10.744 01:19:01 -- host/discovery.sh@25 -- # nvmftestinit 00:26:10.744 01:19:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:10.744 01:19:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:10.744 01:19:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:10.744 01:19:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:10.744 01:19:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:10.744 01:19:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:10.744 01:19:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:10.744 01:19:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:10.744 01:19:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:10.744 01:19:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:10.744 01:19:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:10.744 01:19:01 -- common/autotest_common.sh@10 -- # set +x 00:26:12.651 01:19:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:12.651 01:19:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:12.651 01:19:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:12.651 01:19:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:12.651 01:19:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:12.651 01:19:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:12.651 01:19:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:12.651 01:19:03 -- nvmf/common.sh@294 -- # net_devs=() 00:26:12.651 01:19:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:12.651 01:19:03 -- nvmf/common.sh@295 -- # e810=() 00:26:12.651 01:19:03 -- nvmf/common.sh@295 -- # local -ga e810 00:26:12.651 01:19:03 -- nvmf/common.sh@296 -- # x722=() 00:26:12.651 01:19:03 -- nvmf/common.sh@296 -- # local -ga x722 00:26:12.651 01:19:03 -- nvmf/common.sh@297 -- # mlx=() 00:26:12.651 01:19:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:12.651 01:19:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:12.651 01:19:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:12.651 01:19:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:12.651 01:19:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:12.651 01:19:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:12.651 01:19:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:12.651 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:12.651 01:19:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:12.651 01:19:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:12.651 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:12.651 01:19:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:12.651 01:19:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:12.651 01:19:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:12.651 01:19:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:12.651 01:19:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:12.651 01:19:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:12.651 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:12.651 01:19:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:12.651 01:19:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:12.651 01:19:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:12.651 01:19:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:12.651 01:19:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:12.651 01:19:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:12.651 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:12.651 01:19:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:12.651 01:19:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:12.651 01:19:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:12.651 01:19:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:12.651 01:19:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:12.651 01:19:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:12.651 01:19:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:12.651 01:19:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:12.651 01:19:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:12.651 01:19:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:12.651 01:19:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:12.651 01:19:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:12.651 01:19:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:12.651 01:19:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:12.651 01:19:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:12.651 01:19:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:12.651 01:19:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:12.651 01:19:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:12.651 01:19:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:12.651 01:19:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:12.651 01:19:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:12.651 01:19:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:12.651 01:19:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:12.651 01:19:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:12.651 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:12.651 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.217 ms 00:26:12.651 00:26:12.651 --- 10.0.0.2 ping statistics --- 00:26:12.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:12.651 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:26:12.651 01:19:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:12.651 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:12.651 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:26:12.651 00:26:12.651 --- 10.0.0.1 ping statistics --- 00:26:12.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:12.651 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:26:12.651 01:19:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:12.651 01:19:03 -- nvmf/common.sh@410 -- # return 0 00:26:12.651 01:19:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:12.651 01:19:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:12.651 01:19:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:12.651 01:19:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:12.651 01:19:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:12.651 01:19:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:12.910 01:19:03 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:12.910 01:19:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:12.910 01:19:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:12.910 01:19:03 -- common/autotest_common.sh@10 -- # set +x 00:26:12.910 01:19:03 -- nvmf/common.sh@469 -- # nvmfpid=1154129 00:26:12.910 01:19:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:12.910 01:19:03 -- nvmf/common.sh@470 -- # waitforlisten 1154129 00:26:12.910 01:19:03 -- common/autotest_common.sh@829 -- # '[' -z 1154129 ']' 00:26:12.910 01:19:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:12.910 01:19:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:12.910 01:19:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:12.910 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:12.910 01:19:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:12.910 01:19:03 -- common/autotest_common.sh@10 -- # set +x 00:26:12.910 [2024-11-26 01:19:03.243273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:12.910 [2024-11-26 01:19:03.243362] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:12.910 EAL: No free 2048 kB hugepages reported on node 1 00:26:12.910 [2024-11-26 01:19:03.311161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:12.910 [2024-11-26 01:19:03.426778] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:12.910 [2024-11-26 01:19:03.426924] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:12.910 [2024-11-26 01:19:03.426942] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:12.910 [2024-11-26 01:19:03.426955] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:12.910 [2024-11-26 01:19:03.427011] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:13.847 01:19:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:13.847 01:19:04 -- common/autotest_common.sh@862 -- # return 0 00:26:13.847 01:19:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:13.847 01:19:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 01:19:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:13.847 01:19:04 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:13.847 01:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 [2024-11-26 01:19:04.265016] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:13.847 01:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.847 01:19:04 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:13.847 01:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 [2024-11-26 01:19:04.273264] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:13.847 01:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.847 01:19:04 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:13.847 01:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 null0 00:26:13.847 01:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.847 01:19:04 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:13.847 01:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 null1 00:26:13.847 01:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.847 01:19:04 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:13.847 01:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 01:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:13.847 01:19:04 -- host/discovery.sh@45 -- # hostpid=1154289 00:26:13.847 01:19:04 -- host/discovery.sh@46 -- # waitforlisten 1154289 /tmp/host.sock 00:26:13.847 01:19:04 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:13.847 01:19:04 -- common/autotest_common.sh@829 -- # '[' -z 1154289 ']' 00:26:13.847 01:19:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:13.847 01:19:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:13.847 01:19:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:13.847 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:13.847 01:19:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:13.847 01:19:04 -- common/autotest_common.sh@10 -- # set +x 00:26:13.847 [2024-11-26 01:19:04.342942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:13.847 [2024-11-26 01:19:04.343034] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1154289 ] 00:26:13.847 EAL: No free 2048 kB hugepages reported on node 1 00:26:14.106 [2024-11-26 01:19:04.400734] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:14.106 [2024-11-26 01:19:04.506977] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:14.106 [2024-11-26 01:19:04.507146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:15.043 01:19:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:15.043 01:19:05 -- common/autotest_common.sh@862 -- # return 0 00:26:15.043 01:19:05 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:15.043 01:19:05 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@72 -- # notify_id=0 00:26:15.043 01:19:05 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # sort 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # xargs 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:15.043 01:19:05 -- host/discovery.sh@79 -- # get_bdev_list 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # sort 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # xargs 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:15.043 01:19:05 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # sort 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # xargs 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:15.043 01:19:05 -- host/discovery.sh@83 -- # get_bdev_list 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # sort 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # xargs 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:15.043 01:19:05 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # sort 00:26:15.043 01:19:05 -- host/discovery.sh@59 -- # xargs 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.043 01:19:05 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:15.043 01:19:05 -- host/discovery.sh@87 -- # get_bdev_list 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.043 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.043 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # sort 00:26:15.043 01:19:05 -- host/discovery.sh@55 -- # xargs 00:26:15.043 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:15.303 01:19:05 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:15.303 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.303 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.303 [2024-11-26 01:19:05.596920] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:15.303 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:15.303 01:19:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:15.303 01:19:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:15.303 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.303 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.303 01:19:05 -- host/discovery.sh@59 -- # sort 00:26:15.303 01:19:05 -- host/discovery.sh@59 -- # xargs 00:26:15.303 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:15.303 01:19:05 -- host/discovery.sh@93 -- # get_bdev_list 00:26:15.303 01:19:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:15.303 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.303 01:19:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:15.303 01:19:05 -- host/discovery.sh@55 -- # sort 00:26:15.303 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.303 01:19:05 -- host/discovery.sh@55 -- # xargs 00:26:15.303 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:15.303 01:19:05 -- host/discovery.sh@94 -- # get_notification_count 00:26:15.303 01:19:05 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:15.303 01:19:05 -- host/discovery.sh@74 -- # jq '. | length' 00:26:15.303 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.303 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.303 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@74 -- # notification_count=0 00:26:15.303 01:19:05 -- host/discovery.sh@75 -- # notify_id=0 00:26:15.303 01:19:05 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:15.303 01:19:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:15.303 01:19:05 -- common/autotest_common.sh@10 -- # set +x 00:26:15.303 01:19:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:15.303 01:19:05 -- host/discovery.sh@100 -- # sleep 1 00:26:15.870 [2024-11-26 01:19:06.323973] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:15.870 [2024-11-26 01:19:06.324023] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:15.871 [2024-11-26 01:19:06.324053] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:16.128 [2024-11-26 01:19:06.410319] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:16.128 [2024-11-26 01:19:06.627432] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:16.128 [2024-11-26 01:19:06.627459] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:16.387 01:19:06 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:16.387 01:19:06 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:16.387 01:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.387 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:16.387 01:19:06 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:16.387 01:19:06 -- host/discovery.sh@59 -- # sort 00:26:16.387 01:19:06 -- host/discovery.sh@59 -- # xargs 00:26:16.387 01:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.387 01:19:06 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:16.387 01:19:06 -- host/discovery.sh@102 -- # get_bdev_list 00:26:16.387 01:19:06 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:16.387 01:19:06 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:16.387 01:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.387 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:16.387 01:19:06 -- host/discovery.sh@55 -- # sort 00:26:16.387 01:19:06 -- host/discovery.sh@55 -- # xargs 00:26:16.387 01:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.387 01:19:06 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:16.387 01:19:06 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:16.387 01:19:06 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:16.387 01:19:06 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:16.387 01:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.388 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:16.388 01:19:06 -- host/discovery.sh@63 -- # sort -n 00:26:16.388 01:19:06 -- host/discovery.sh@63 -- # xargs 00:26:16.388 01:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.388 01:19:06 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:16.388 01:19:06 -- host/discovery.sh@104 -- # get_notification_count 00:26:16.388 01:19:06 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:16.388 01:19:06 -- host/discovery.sh@74 -- # jq '. | length' 00:26:16.388 01:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.388 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:16.388 01:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.388 01:19:06 -- host/discovery.sh@74 -- # notification_count=1 00:26:16.388 01:19:06 -- host/discovery.sh@75 -- # notify_id=1 00:26:16.388 01:19:06 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:16.388 01:19:06 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:16.388 01:19:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:16.388 01:19:06 -- common/autotest_common.sh@10 -- # set +x 00:26:16.388 01:19:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:16.388 01:19:06 -- host/discovery.sh@109 -- # sleep 1 00:26:17.768 01:19:07 -- host/discovery.sh@110 -- # get_bdev_list 00:26:17.768 01:19:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:17.768 01:19:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:17.768 01:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.768 01:19:07 -- host/discovery.sh@55 -- # sort 00:26:17.768 01:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:17.768 01:19:07 -- host/discovery.sh@55 -- # xargs 00:26:17.768 01:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.768 01:19:07 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:17.768 01:19:07 -- host/discovery.sh@111 -- # get_notification_count 00:26:17.768 01:19:07 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:17.768 01:19:07 -- host/discovery.sh@74 -- # jq '. | length' 00:26:17.768 01:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.768 01:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:17.768 01:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.768 01:19:07 -- host/discovery.sh@74 -- # notification_count=1 00:26:17.768 01:19:07 -- host/discovery.sh@75 -- # notify_id=2 00:26:17.768 01:19:07 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:17.768 01:19:07 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:17.768 01:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:17.768 01:19:07 -- common/autotest_common.sh@10 -- # set +x 00:26:17.768 [2024-11-26 01:19:07.983922] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:17.768 [2024-11-26 01:19:07.984566] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:17.768 [2024-11-26 01:19:07.984607] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:17.768 01:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:17.768 01:19:07 -- host/discovery.sh@117 -- # sleep 1 00:26:17.768 [2024-11-26 01:19:08.112007] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:17.768 [2024-11-26 01:19:08.170591] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:17.768 [2024-11-26 01:19:08.170617] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:17.768 [2024-11-26 01:19:08.170628] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:18.708 01:19:08 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:18.708 01:19:08 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:18.708 01:19:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.708 01:19:08 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:18.708 01:19:08 -- common/autotest_common.sh@10 -- # set +x 00:26:18.708 01:19:08 -- host/discovery.sh@59 -- # sort 00:26:18.708 01:19:08 -- host/discovery.sh@59 -- # xargs 00:26:18.708 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@119 -- # get_bdev_list 00:26:18.708 01:19:09 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:18.708 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.708 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:26:18.708 01:19:09 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:18.708 01:19:09 -- host/discovery.sh@55 -- # sort 00:26:18.708 01:19:09 -- host/discovery.sh@55 -- # xargs 00:26:18.708 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:18.708 01:19:09 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:18.708 01:19:09 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:18.708 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.708 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:26:18.708 01:19:09 -- host/discovery.sh@63 -- # xargs 00:26:18.708 01:19:09 -- host/discovery.sh@63 -- # sort -n 00:26:18.708 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@121 -- # get_notification_count 00:26:18.708 01:19:09 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:18.708 01:19:09 -- host/discovery.sh@74 -- # jq '. | length' 00:26:18.708 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.708 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:26:18.708 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@74 -- # notification_count=0 00:26:18.708 01:19:09 -- host/discovery.sh@75 -- # notify_id=2 00:26:18.708 01:19:09 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:18.708 01:19:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:18.708 01:19:09 -- common/autotest_common.sh@10 -- # set +x 00:26:18.708 [2024-11-26 01:19:09.156303] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:18.708 [2024-11-26 01:19:09.156337] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:18.708 01:19:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:18.708 01:19:09 -- host/discovery.sh@127 -- # sleep 1 00:26:18.708 [2024-11-26 01:19:09.160937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.708 [2024-11-26 01:19:09.160997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.708 [2024-11-26 01:19:09.161021] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.708 [2024-11-26 01:19:09.161059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.708 [2024-11-26 01:19:09.161075] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.708 [2024-11-26 01:19:09.161088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.708 [2024-11-26 01:19:09.161103] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:18.708 [2024-11-26 01:19:09.161127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:18.708 [2024-11-26 01:19:09.161140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.708 [2024-11-26 01:19:09.170943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.708 [2024-11-26 01:19:09.181005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.708 [2024-11-26 01:19:09.181228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.708 [2024-11-26 01:19:09.181414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.708 [2024-11-26 01:19:09.181442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.708 [2024-11-26 01:19:09.181460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.708 [2024-11-26 01:19:09.181484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.708 [2024-11-26 01:19:09.181518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.709 [2024-11-26 01:19:09.181536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.709 [2024-11-26 01:19:09.181568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.709 [2024-11-26 01:19:09.181590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.709 [2024-11-26 01:19:09.191099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.709 [2024-11-26 01:19:09.191289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.191424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.191456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.709 [2024-11-26 01:19:09.191474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.709 [2024-11-26 01:19:09.191499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.709 [2024-11-26 01:19:09.191534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.709 [2024-11-26 01:19:09.191553] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.709 [2024-11-26 01:19:09.191569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.709 [2024-11-26 01:19:09.191604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.709 [2024-11-26 01:19:09.201177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.709 [2024-11-26 01:19:09.201354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.201528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.201559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.709 [2024-11-26 01:19:09.201577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.709 [2024-11-26 01:19:09.201604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.709 [2024-11-26 01:19:09.201655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.709 [2024-11-26 01:19:09.201678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.709 [2024-11-26 01:19:09.201706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.709 [2024-11-26 01:19:09.201755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.709 [2024-11-26 01:19:09.211268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.709 [2024-11-26 01:19:09.211473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.211611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.211642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.709 [2024-11-26 01:19:09.211660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.709 [2024-11-26 01:19:09.211695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.709 [2024-11-26 01:19:09.211758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.709 [2024-11-26 01:19:09.211778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.709 [2024-11-26 01:19:09.211793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.709 [2024-11-26 01:19:09.211812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.709 [2024-11-26 01:19:09.221348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.709 [2024-11-26 01:19:09.221532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.221673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.221712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.709 [2024-11-26 01:19:09.221746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.709 [2024-11-26 01:19:09.221769] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.709 [2024-11-26 01:19:09.221803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.709 [2024-11-26 01:19:09.221821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.709 [2024-11-26 01:19:09.221835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.709 [2024-11-26 01:19:09.221854] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.709 [2024-11-26 01:19:09.231426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.709 [2024-11-26 01:19:09.231623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.231807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.709 [2024-11-26 01:19:09.231841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.709 [2024-11-26 01:19:09.231859] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.709 [2024-11-26 01:19:09.231882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.709 [2024-11-26 01:19:09.231924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.709 [2024-11-26 01:19:09.231945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.709 [2024-11-26 01:19:09.231959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.709 [2024-11-26 01:19:09.231979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.969 [2024-11-26 01:19:09.241503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:18.969 [2024-11-26 01:19:09.241702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.969 [2024-11-26 01:19:09.241834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:18.969 [2024-11-26 01:19:09.241860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3810 with addr=10.0.0.2, port=4420 00:26:18.969 [2024-11-26 01:19:09.241876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3810 is same with the state(5) to be set 00:26:18.969 [2024-11-26 01:19:09.241899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3810 (9): Bad file descriptor 00:26:18.969 [2024-11-26 01:19:09.241920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:18.969 [2024-11-26 01:19:09.241934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:18.969 [2024-11-26 01:19:09.241948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:18.969 [2024-11-26 01:19:09.241981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:18.969 [2024-11-26 01:19:09.242952] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:18.969 [2024-11-26 01:19:09.242997] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:19.907 01:19:10 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:19.907 01:19:10 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:19.907 01:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.907 01:19:10 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:19.907 01:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:19.907 01:19:10 -- host/discovery.sh@59 -- # sort 00:26:19.907 01:19:10 -- host/discovery.sh@59 -- # xargs 00:26:19.907 01:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@129 -- # get_bdev_list 00:26:19.907 01:19:10 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:19.907 01:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.907 01:19:10 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:19.907 01:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:19.907 01:19:10 -- host/discovery.sh@55 -- # sort 00:26:19.907 01:19:10 -- host/discovery.sh@55 -- # xargs 00:26:19.907 01:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:19.907 01:19:10 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:19.907 01:19:10 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:19.907 01:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.907 01:19:10 -- host/discovery.sh@63 -- # sort -n 00:26:19.907 01:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:19.907 01:19:10 -- host/discovery.sh@63 -- # xargs 00:26:19.907 01:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@131 -- # get_notification_count 00:26:19.907 01:19:10 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:19.907 01:19:10 -- host/discovery.sh@74 -- # jq '. | length' 00:26:19.907 01:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.907 01:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:19.907 01:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@74 -- # notification_count=0 00:26:19.907 01:19:10 -- host/discovery.sh@75 -- # notify_id=2 00:26:19.907 01:19:10 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:19.907 01:19:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:19.907 01:19:10 -- common/autotest_common.sh@10 -- # set +x 00:26:19.907 01:19:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:19.907 01:19:10 -- host/discovery.sh@135 -- # sleep 1 00:26:20.848 01:19:11 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:20.848 01:19:11 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:20.848 01:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.848 01:19:11 -- common/autotest_common.sh@10 -- # set +x 00:26:20.848 01:19:11 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:20.848 01:19:11 -- host/discovery.sh@59 -- # sort 00:26:20.849 01:19:11 -- host/discovery.sh@59 -- # xargs 00:26:20.849 01:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:20.849 01:19:11 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:20.849 01:19:11 -- host/discovery.sh@137 -- # get_bdev_list 00:26:20.849 01:19:11 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:20.849 01:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:20.849 01:19:11 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:20.849 01:19:11 -- common/autotest_common.sh@10 -- # set +x 00:26:20.849 01:19:11 -- host/discovery.sh@55 -- # sort 00:26:20.849 01:19:11 -- host/discovery.sh@55 -- # xargs 00:26:21.107 01:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.107 01:19:11 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:21.107 01:19:11 -- host/discovery.sh@138 -- # get_notification_count 00:26:21.107 01:19:11 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:21.107 01:19:11 -- host/discovery.sh@74 -- # jq '. | length' 00:26:21.107 01:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.107 01:19:11 -- common/autotest_common.sh@10 -- # set +x 00:26:21.107 01:19:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.107 01:19:11 -- host/discovery.sh@74 -- # notification_count=2 00:26:21.107 01:19:11 -- host/discovery.sh@75 -- # notify_id=4 00:26:21.107 01:19:11 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:21.107 01:19:11 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:21.107 01:19:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.107 01:19:11 -- common/autotest_common.sh@10 -- # set +x 00:26:22.045 [2024-11-26 01:19:12.470137] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:22.046 [2024-11-26 01:19:12.470169] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:22.046 [2024-11-26 01:19:12.470194] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:22.046 [2024-11-26 01:19:12.557446] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:22.305 [2024-11-26 01:19:12.624767] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:22.305 [2024-11-26 01:19:12.624803] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:22.305 01:19:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.305 01:19:12 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.305 01:19:12 -- common/autotest_common.sh@650 -- # local es=0 00:26:22.305 01:19:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.305 01:19:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:22.305 01:19:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:22.305 01:19:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:22.305 01:19:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:22.305 01:19:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.305 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.305 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:22.305 request: 00:26:22.305 { 00:26:22.305 "name": "nvme", 00:26:22.305 "trtype": "tcp", 00:26:22.305 "traddr": "10.0.0.2", 00:26:22.305 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:22.305 "adrfam": "ipv4", 00:26:22.305 "trsvcid": "8009", 00:26:22.305 "wait_for_attach": true, 00:26:22.305 "method": "bdev_nvme_start_discovery", 00:26:22.305 "req_id": 1 00:26:22.305 } 00:26:22.305 Got JSON-RPC error response 00:26:22.305 response: 00:26:22.305 { 00:26:22.305 "code": -17, 00:26:22.305 "message": "File exists" 00:26:22.305 } 00:26:22.305 01:19:12 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:22.305 01:19:12 -- common/autotest_common.sh@653 -- # es=1 00:26:22.305 01:19:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:22.305 01:19:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:22.305 01:19:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:22.305 01:19:12 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:22.305 01:19:12 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:22.305 01:19:12 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:22.305 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.305 01:19:12 -- host/discovery.sh@67 -- # sort 00:26:22.305 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:22.305 01:19:12 -- host/discovery.sh@67 -- # xargs 00:26:22.305 01:19:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.305 01:19:12 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:22.305 01:19:12 -- host/discovery.sh@147 -- # get_bdev_list 00:26:22.305 01:19:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.305 01:19:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.305 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.305 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:22.305 01:19:12 -- host/discovery.sh@55 -- # sort 00:26:22.305 01:19:12 -- host/discovery.sh@55 -- # xargs 00:26:22.305 01:19:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.305 01:19:12 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.305 01:19:12 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.305 01:19:12 -- common/autotest_common.sh@650 -- # local es=0 00:26:22.305 01:19:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.305 01:19:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:22.305 01:19:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:22.305 01:19:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:22.305 01:19:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:22.305 01:19:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:22.305 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.305 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:22.305 request: 00:26:22.305 { 00:26:22.305 "name": "nvme_second", 00:26:22.305 "trtype": "tcp", 00:26:22.305 "traddr": "10.0.0.2", 00:26:22.305 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:22.305 "adrfam": "ipv4", 00:26:22.305 "trsvcid": "8009", 00:26:22.305 "wait_for_attach": true, 00:26:22.305 "method": "bdev_nvme_start_discovery", 00:26:22.305 "req_id": 1 00:26:22.305 } 00:26:22.305 Got JSON-RPC error response 00:26:22.305 response: 00:26:22.305 { 00:26:22.305 "code": -17, 00:26:22.305 "message": "File exists" 00:26:22.305 } 00:26:22.305 01:19:12 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:22.305 01:19:12 -- common/autotest_common.sh@653 -- # es=1 00:26:22.305 01:19:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:22.305 01:19:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:22.305 01:19:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:22.305 01:19:12 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:22.305 01:19:12 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:22.305 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.305 01:19:12 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:22.305 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:22.306 01:19:12 -- host/discovery.sh@67 -- # sort 00:26:22.306 01:19:12 -- host/discovery.sh@67 -- # xargs 00:26:22.306 01:19:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.306 01:19:12 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:22.306 01:19:12 -- host/discovery.sh@153 -- # get_bdev_list 00:26:22.306 01:19:12 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.306 01:19:12 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.306 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.306 01:19:12 -- host/discovery.sh@55 -- # sort 00:26:22.306 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:22.306 01:19:12 -- host/discovery.sh@55 -- # xargs 00:26:22.306 01:19:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.306 01:19:12 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:22.306 01:19:12 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:22.306 01:19:12 -- common/autotest_common.sh@650 -- # local es=0 00:26:22.306 01:19:12 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:22.306 01:19:12 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:22.306 01:19:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:22.306 01:19:12 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:22.306 01:19:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:22.306 01:19:12 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:22.306 01:19:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.306 01:19:12 -- common/autotest_common.sh@10 -- # set +x 00:26:23.682 [2024-11-26 01:19:13.832200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.682 [2024-11-26 01:19:13.832455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:23.682 [2024-11-26 01:19:13.832486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9c73d0 with addr=10.0.0.2, port=8010 00:26:23.682 [2024-11-26 01:19:13.832509] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:23.682 [2024-11-26 01:19:13.832525] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:23.682 [2024-11-26 01:19:13.832538] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:24.619 [2024-11-26 01:19:14.834573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.619 [2024-11-26 01:19:14.834753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:24.619 [2024-11-26 01:19:14.834784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x993d30 with addr=10.0.0.2, port=8010 00:26:24.619 [2024-11-26 01:19:14.834805] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:24.619 [2024-11-26 01:19:14.834819] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:24.619 [2024-11-26 01:19:14.834832] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:25.555 [2024-11-26 01:19:15.836851] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:25.555 request: 00:26:25.555 { 00:26:25.555 "name": "nvme_second", 00:26:25.555 "trtype": "tcp", 00:26:25.555 "traddr": "10.0.0.2", 00:26:25.555 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:25.555 "adrfam": "ipv4", 00:26:25.555 "trsvcid": "8010", 00:26:25.555 "attach_timeout_ms": 3000, 00:26:25.555 "method": "bdev_nvme_start_discovery", 00:26:25.555 "req_id": 1 00:26:25.555 } 00:26:25.555 Got JSON-RPC error response 00:26:25.555 response: 00:26:25.555 { 00:26:25.555 "code": -110, 00:26:25.555 "message": "Connection timed out" 00:26:25.555 } 00:26:25.555 01:19:15 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:25.555 01:19:15 -- common/autotest_common.sh@653 -- # es=1 00:26:25.555 01:19:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:25.555 01:19:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:25.555 01:19:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:25.555 01:19:15 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:25.555 01:19:15 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:25.555 01:19:15 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:25.555 01:19:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.556 01:19:15 -- host/discovery.sh@67 -- # sort 00:26:25.556 01:19:15 -- common/autotest_common.sh@10 -- # set +x 00:26:25.556 01:19:15 -- host/discovery.sh@67 -- # xargs 00:26:25.556 01:19:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.556 01:19:15 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:25.556 01:19:15 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:25.556 01:19:15 -- host/discovery.sh@162 -- # kill 1154289 00:26:25.556 01:19:15 -- host/discovery.sh@163 -- # nvmftestfini 00:26:25.556 01:19:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:25.556 01:19:15 -- nvmf/common.sh@116 -- # sync 00:26:25.556 01:19:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:25.556 01:19:15 -- nvmf/common.sh@119 -- # set +e 00:26:25.556 01:19:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:25.556 01:19:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:25.556 rmmod nvme_tcp 00:26:25.556 rmmod nvme_fabrics 00:26:25.556 rmmod nvme_keyring 00:26:25.556 01:19:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:25.556 01:19:15 -- nvmf/common.sh@123 -- # set -e 00:26:25.556 01:19:15 -- nvmf/common.sh@124 -- # return 0 00:26:25.556 01:19:15 -- nvmf/common.sh@477 -- # '[' -n 1154129 ']' 00:26:25.556 01:19:15 -- nvmf/common.sh@478 -- # killprocess 1154129 00:26:25.556 01:19:15 -- common/autotest_common.sh@936 -- # '[' -z 1154129 ']' 00:26:25.556 01:19:15 -- common/autotest_common.sh@940 -- # kill -0 1154129 00:26:25.556 01:19:15 -- common/autotest_common.sh@941 -- # uname 00:26:25.556 01:19:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:25.556 01:19:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1154129 00:26:25.556 01:19:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:25.556 01:19:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:25.556 01:19:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1154129' 00:26:25.556 killing process with pid 1154129 00:26:25.556 01:19:15 -- common/autotest_common.sh@955 -- # kill 1154129 00:26:25.556 01:19:15 -- common/autotest_common.sh@960 -- # wait 1154129 00:26:25.814 01:19:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:25.814 01:19:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:25.814 01:19:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:25.814 01:19:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:25.814 01:19:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:25.814 01:19:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:25.814 01:19:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:25.814 01:19:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:28.350 01:19:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:28.350 00:26:28.350 real 0m17.343s 00:26:28.350 user 0m26.978s 00:26:28.350 sys 0m2.785s 00:26:28.350 01:19:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:28.350 01:19:18 -- common/autotest_common.sh@10 -- # set +x 00:26:28.350 ************************************ 00:26:28.350 END TEST nvmf_discovery 00:26:28.350 ************************************ 00:26:28.350 01:19:18 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:28.350 01:19:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:28.350 01:19:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:28.350 01:19:18 -- common/autotest_common.sh@10 -- # set +x 00:26:28.350 ************************************ 00:26:28.350 START TEST nvmf_discovery_remove_ifc 00:26:28.350 ************************************ 00:26:28.350 01:19:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:28.350 * Looking for test storage... 00:26:28.350 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:28.350 01:19:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:28.350 01:19:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:28.350 01:19:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:28.350 01:19:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:28.350 01:19:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:28.350 01:19:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:28.350 01:19:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:28.350 01:19:18 -- scripts/common.sh@335 -- # IFS=.-: 00:26:28.350 01:19:18 -- scripts/common.sh@335 -- # read -ra ver1 00:26:28.350 01:19:18 -- scripts/common.sh@336 -- # IFS=.-: 00:26:28.350 01:19:18 -- scripts/common.sh@336 -- # read -ra ver2 00:26:28.350 01:19:18 -- scripts/common.sh@337 -- # local 'op=<' 00:26:28.350 01:19:18 -- scripts/common.sh@339 -- # ver1_l=2 00:26:28.350 01:19:18 -- scripts/common.sh@340 -- # ver2_l=1 00:26:28.350 01:19:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:28.351 01:19:18 -- scripts/common.sh@343 -- # case "$op" in 00:26:28.351 01:19:18 -- scripts/common.sh@344 -- # : 1 00:26:28.351 01:19:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:28.351 01:19:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:28.351 01:19:18 -- scripts/common.sh@364 -- # decimal 1 00:26:28.351 01:19:18 -- scripts/common.sh@352 -- # local d=1 00:26:28.351 01:19:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:28.351 01:19:18 -- scripts/common.sh@354 -- # echo 1 00:26:28.351 01:19:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:28.351 01:19:18 -- scripts/common.sh@365 -- # decimal 2 00:26:28.351 01:19:18 -- scripts/common.sh@352 -- # local d=2 00:26:28.351 01:19:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:28.351 01:19:18 -- scripts/common.sh@354 -- # echo 2 00:26:28.351 01:19:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:28.351 01:19:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:28.351 01:19:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:28.351 01:19:18 -- scripts/common.sh@367 -- # return 0 00:26:28.351 01:19:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:28.351 01:19:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:28.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:28.351 --rc genhtml_branch_coverage=1 00:26:28.351 --rc genhtml_function_coverage=1 00:26:28.351 --rc genhtml_legend=1 00:26:28.351 --rc geninfo_all_blocks=1 00:26:28.351 --rc geninfo_unexecuted_blocks=1 00:26:28.351 00:26:28.351 ' 00:26:28.351 01:19:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:28.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:28.351 --rc genhtml_branch_coverage=1 00:26:28.351 --rc genhtml_function_coverage=1 00:26:28.351 --rc genhtml_legend=1 00:26:28.351 --rc geninfo_all_blocks=1 00:26:28.351 --rc geninfo_unexecuted_blocks=1 00:26:28.351 00:26:28.351 ' 00:26:28.351 01:19:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:28.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:28.351 --rc genhtml_branch_coverage=1 00:26:28.351 --rc genhtml_function_coverage=1 00:26:28.351 --rc genhtml_legend=1 00:26:28.351 --rc geninfo_all_blocks=1 00:26:28.351 --rc geninfo_unexecuted_blocks=1 00:26:28.351 00:26:28.351 ' 00:26:28.351 01:19:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:28.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:28.351 --rc genhtml_branch_coverage=1 00:26:28.351 --rc genhtml_function_coverage=1 00:26:28.351 --rc genhtml_legend=1 00:26:28.351 --rc geninfo_all_blocks=1 00:26:28.351 --rc geninfo_unexecuted_blocks=1 00:26:28.351 00:26:28.351 ' 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:28.351 01:19:18 -- nvmf/common.sh@7 -- # uname -s 00:26:28.351 01:19:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:28.351 01:19:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:28.351 01:19:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:28.351 01:19:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:28.351 01:19:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:28.351 01:19:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:28.351 01:19:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:28.351 01:19:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:28.351 01:19:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:28.351 01:19:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:28.351 01:19:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:28.351 01:19:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:28.351 01:19:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:28.351 01:19:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:28.351 01:19:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:28.351 01:19:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:28.351 01:19:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:28.351 01:19:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:28.351 01:19:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:28.351 01:19:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.351 01:19:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.351 01:19:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.351 01:19:18 -- paths/export.sh@5 -- # export PATH 00:26:28.351 01:19:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:28.351 01:19:18 -- nvmf/common.sh@46 -- # : 0 00:26:28.351 01:19:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:28.351 01:19:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:28.351 01:19:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:28.351 01:19:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:28.351 01:19:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:28.351 01:19:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:28.351 01:19:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:28.351 01:19:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:28.351 01:19:18 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:28.351 01:19:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:28.351 01:19:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:28.351 01:19:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:28.351 01:19:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:28.351 01:19:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:28.351 01:19:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:28.351 01:19:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:28.351 01:19:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:28.351 01:19:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:28.351 01:19:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:28.351 01:19:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:28.351 01:19:18 -- common/autotest_common.sh@10 -- # set +x 00:26:30.258 01:19:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:30.258 01:19:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:30.258 01:19:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:30.258 01:19:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:30.258 01:19:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:30.258 01:19:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:30.258 01:19:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:30.258 01:19:20 -- nvmf/common.sh@294 -- # net_devs=() 00:26:30.258 01:19:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:30.258 01:19:20 -- nvmf/common.sh@295 -- # e810=() 00:26:30.258 01:19:20 -- nvmf/common.sh@295 -- # local -ga e810 00:26:30.258 01:19:20 -- nvmf/common.sh@296 -- # x722=() 00:26:30.258 01:19:20 -- nvmf/common.sh@296 -- # local -ga x722 00:26:30.258 01:19:20 -- nvmf/common.sh@297 -- # mlx=() 00:26:30.258 01:19:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:30.258 01:19:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:30.258 01:19:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:30.258 01:19:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:30.258 01:19:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:30.259 01:19:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:30.259 01:19:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:30.259 01:19:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:30.259 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:30.259 01:19:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:30.259 01:19:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:30.259 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:30.259 01:19:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:30.259 01:19:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:30.259 01:19:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.259 01:19:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:30.259 01:19:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.259 01:19:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:30.259 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:30.259 01:19:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.259 01:19:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:30.259 01:19:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:30.259 01:19:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:30.259 01:19:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:30.259 01:19:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:30.259 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:30.259 01:19:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:30.259 01:19:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:30.259 01:19:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:30.259 01:19:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:30.259 01:19:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:30.259 01:19:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:30.259 01:19:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:30.259 01:19:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:30.259 01:19:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:30.259 01:19:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:30.259 01:19:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:30.259 01:19:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:30.259 01:19:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:30.259 01:19:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:30.259 01:19:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:30.259 01:19:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:30.259 01:19:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:30.259 01:19:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:30.259 01:19:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:30.259 01:19:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:30.259 01:19:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:30.259 01:19:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:30.259 01:19:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:30.259 01:19:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:30.259 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:30.259 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:26:30.259 00:26:30.259 --- 10.0.0.2 ping statistics --- 00:26:30.259 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:30.259 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:26:30.259 01:19:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:30.259 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:30.259 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:26:30.259 00:26:30.259 --- 10.0.0.1 ping statistics --- 00:26:30.259 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:30.259 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:26:30.259 01:19:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:30.259 01:19:20 -- nvmf/common.sh@410 -- # return 0 00:26:30.259 01:19:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:30.259 01:19:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:30.259 01:19:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:30.259 01:19:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:30.259 01:19:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:30.259 01:19:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:30.259 01:19:20 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:30.259 01:19:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:30.259 01:19:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:30.259 01:19:20 -- common/autotest_common.sh@10 -- # set +x 00:26:30.259 01:19:20 -- nvmf/common.sh@469 -- # nvmfpid=1157880 00:26:30.259 01:19:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:30.259 01:19:20 -- nvmf/common.sh@470 -- # waitforlisten 1157880 00:26:30.259 01:19:20 -- common/autotest_common.sh@829 -- # '[' -z 1157880 ']' 00:26:30.259 01:19:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:30.259 01:19:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:30.259 01:19:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:30.259 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:30.259 01:19:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:30.259 01:19:20 -- common/autotest_common.sh@10 -- # set +x 00:26:30.259 [2024-11-26 01:19:20.665526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:30.259 [2024-11-26 01:19:20.665620] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:30.259 EAL: No free 2048 kB hugepages reported on node 1 00:26:30.259 [2024-11-26 01:19:20.738068] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:30.517 [2024-11-26 01:19:20.850914] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:30.517 [2024-11-26 01:19:20.851097] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:30.517 [2024-11-26 01:19:20.851117] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:30.517 [2024-11-26 01:19:20.851133] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:30.517 [2024-11-26 01:19:20.851165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:31.085 01:19:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:31.085 01:19:21 -- common/autotest_common.sh@862 -- # return 0 00:26:31.085 01:19:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:31.085 01:19:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:31.085 01:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:31.345 01:19:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:31.345 01:19:21 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:31.345 01:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.345 01:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:31.345 [2024-11-26 01:19:21.651525] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:31.345 [2024-11-26 01:19:21.659762] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:31.345 null0 00:26:31.345 [2024-11-26 01:19:21.691683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:31.345 01:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.345 01:19:21 -- host/discovery_remove_ifc.sh@59 -- # hostpid=1158034 00:26:31.345 01:19:21 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:31.345 01:19:21 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 1158034 /tmp/host.sock 00:26:31.345 01:19:21 -- common/autotest_common.sh@829 -- # '[' -z 1158034 ']' 00:26:31.345 01:19:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:31.345 01:19:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:31.345 01:19:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:31.345 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:31.345 01:19:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:31.345 01:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:31.345 [2024-11-26 01:19:21.752555] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:31.345 [2024-11-26 01:19:21.752619] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1158034 ] 00:26:31.345 EAL: No free 2048 kB hugepages reported on node 1 00:26:31.345 [2024-11-26 01:19:21.813355] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:31.605 [2024-11-26 01:19:21.927283] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:31.605 [2024-11-26 01:19:21.927492] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:31.605 01:19:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:31.605 01:19:21 -- common/autotest_common.sh@862 -- # return 0 00:26:31.605 01:19:21 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:31.605 01:19:21 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:31.605 01:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.605 01:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:31.605 01:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.605 01:19:21 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:31.605 01:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.605 01:19:21 -- common/autotest_common.sh@10 -- # set +x 00:26:31.605 01:19:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:31.605 01:19:22 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:31.605 01:19:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:31.605 01:19:22 -- common/autotest_common.sh@10 -- # set +x 00:26:32.984 [2024-11-26 01:19:23.129465] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:32.984 [2024-11-26 01:19:23.129501] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:32.984 [2024-11-26 01:19:23.129529] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:32.984 [2024-11-26 01:19:23.257971] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:32.984 [2024-11-26 01:19:23.359796] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:32.984 [2024-11-26 01:19:23.359844] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:32.984 [2024-11-26 01:19:23.359881] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:32.984 [2024-11-26 01:19:23.359903] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:32.984 [2024-11-26 01:19:23.359927] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:32.984 01:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.984 01:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.984 01:19:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.984 [2024-11-26 01:19:23.367626] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xa73d40 was disconnected and freed. delete nvme_qpair. 00:26:32.984 01:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:32.984 01:19:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:32.984 01:19:23 -- common/autotest_common.sh@10 -- # set +x 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:32.984 01:19:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:32.984 01:19:23 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:34.363 01:19:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:34.363 01:19:24 -- common/autotest_common.sh@10 -- # set +x 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:34.363 01:19:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:34.363 01:19:24 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:35.302 01:19:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:35.302 01:19:25 -- common/autotest_common.sh@10 -- # set +x 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:35.302 01:19:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:35.302 01:19:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:36.239 01:19:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:36.239 01:19:26 -- common/autotest_common.sh@10 -- # set +x 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:36.239 01:19:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:36.239 01:19:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:37.177 01:19:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:37.177 01:19:27 -- common/autotest_common.sh@10 -- # set +x 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:37.177 01:19:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:37.177 01:19:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:38.591 01:19:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:38.591 01:19:28 -- common/autotest_common.sh@10 -- # set +x 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:38.591 01:19:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:38.591 01:19:28 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:38.591 [2024-11-26 01:19:28.800721] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:38.591 [2024-11-26 01:19:28.800797] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.591 [2024-11-26 01:19:28.800818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.591 [2024-11-26 01:19:28.800833] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.591 [2024-11-26 01:19:28.800847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.591 [2024-11-26 01:19:28.800861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.591 [2024-11-26 01:19:28.800884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.592 [2024-11-26 01:19:28.800898] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.592 [2024-11-26 01:19:28.800911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.592 [2024-11-26 01:19:28.800926] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:38.592 [2024-11-26 01:19:28.800938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:38.592 [2024-11-26 01:19:28.800951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa3a430 is same with the state(5) to be set 00:26:38.592 [2024-11-26 01:19:28.810739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa3a430 (9): Bad file descriptor 00:26:38.592 [2024-11-26 01:19:28.820788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:39.544 01:19:29 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:39.544 01:19:29 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:39.544 01:19:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.544 01:19:29 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:39.544 01:19:29 -- common/autotest_common.sh@10 -- # set +x 00:26:39.544 01:19:29 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:39.544 01:19:29 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:39.544 [2024-11-26 01:19:29.857724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:40.481 [2024-11-26 01:19:30.881725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:40.481 [2024-11-26 01:19:30.881799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xa3a430 with addr=10.0.0.2, port=4420 00:26:40.481 [2024-11-26 01:19:30.881827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa3a430 is same with the state(5) to be set 00:26:40.481 [2024-11-26 01:19:30.881866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:40.481 [2024-11-26 01:19:30.881885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:40.482 [2024-11-26 01:19:30.881901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:40.482 [2024-11-26 01:19:30.881917] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:40.482 [2024-11-26 01:19:30.882373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa3a430 (9): Bad file descriptor 00:26:40.482 [2024-11-26 01:19:30.882420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:40.482 [2024-11-26 01:19:30.882466] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:40.482 [2024-11-26 01:19:30.882508] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.482 [2024-11-26 01:19:30.882531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.482 [2024-11-26 01:19:30.882551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.482 [2024-11-26 01:19:30.882566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.482 [2024-11-26 01:19:30.882582] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.482 [2024-11-26 01:19:30.882598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.482 [2024-11-26 01:19:30.882625] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.482 [2024-11-26 01:19:30.882642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.482 [2024-11-26 01:19:30.882659] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:40.482 [2024-11-26 01:19:30.882674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:40.482 [2024-11-26 01:19:30.882710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:40.482 [2024-11-26 01:19:30.882864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa3a840 (9): Bad file descriptor 00:26:40.482 [2024-11-26 01:19:30.883881] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:40.482 [2024-11-26 01:19:30.883902] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:40.482 01:19:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:40.482 01:19:30 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:40.482 01:19:30 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.417 01:19:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.417 01:19:31 -- common/autotest_common.sh@10 -- # set +x 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.417 01:19:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:41.417 01:19:31 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.677 01:19:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.677 01:19:32 -- common/autotest_common.sh@10 -- # set +x 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.677 01:19:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:41.677 01:19:32 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.616 [2024-11-26 01:19:32.894484] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:42.616 [2024-11-26 01:19:32.894509] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:42.616 [2024-11-26 01:19:32.894530] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:42.616 [2024-11-26 01:19:32.982840] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.616 01:19:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.616 01:19:33 -- common/autotest_common.sh@10 -- # set +x 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.616 01:19:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:42.616 01:19:33 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.874 [2024-11-26 01:19:33.206114] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:42.874 [2024-11-26 01:19:33.206167] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:42.875 [2024-11-26 01:19:33.206204] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:42.875 [2024-11-26 01:19:33.206229] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:42.875 [2024-11-26 01:19:33.206245] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:42.875 [2024-11-26 01:19:33.254346] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0xa48ef0 was disconnected and freed. delete nvme_qpair. 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.810 01:19:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.810 01:19:34 -- common/autotest_common.sh@10 -- # set +x 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.810 01:19:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:43.810 01:19:34 -- host/discovery_remove_ifc.sh@90 -- # killprocess 1158034 00:26:43.810 01:19:34 -- common/autotest_common.sh@936 -- # '[' -z 1158034 ']' 00:26:43.810 01:19:34 -- common/autotest_common.sh@940 -- # kill -0 1158034 00:26:43.810 01:19:34 -- common/autotest_common.sh@941 -- # uname 00:26:43.810 01:19:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:43.810 01:19:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1158034 00:26:43.810 01:19:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:43.810 01:19:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:43.810 01:19:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1158034' 00:26:43.810 killing process with pid 1158034 00:26:43.810 01:19:34 -- common/autotest_common.sh@955 -- # kill 1158034 00:26:43.810 01:19:34 -- common/autotest_common.sh@960 -- # wait 1158034 00:26:44.069 01:19:34 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:44.069 01:19:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:44.069 01:19:34 -- nvmf/common.sh@116 -- # sync 00:26:44.069 01:19:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:44.069 01:19:34 -- nvmf/common.sh@119 -- # set +e 00:26:44.069 01:19:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:44.069 01:19:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:44.069 rmmod nvme_tcp 00:26:44.069 rmmod nvme_fabrics 00:26:44.069 rmmod nvme_keyring 00:26:44.069 01:19:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:44.069 01:19:34 -- nvmf/common.sh@123 -- # set -e 00:26:44.069 01:19:34 -- nvmf/common.sh@124 -- # return 0 00:26:44.069 01:19:34 -- nvmf/common.sh@477 -- # '[' -n 1157880 ']' 00:26:44.069 01:19:34 -- nvmf/common.sh@478 -- # killprocess 1157880 00:26:44.069 01:19:34 -- common/autotest_common.sh@936 -- # '[' -z 1157880 ']' 00:26:44.069 01:19:34 -- common/autotest_common.sh@940 -- # kill -0 1157880 00:26:44.069 01:19:34 -- common/autotest_common.sh@941 -- # uname 00:26:44.069 01:19:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:44.069 01:19:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1157880 00:26:44.328 01:19:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:44.328 01:19:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:44.328 01:19:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1157880' 00:26:44.328 killing process with pid 1157880 00:26:44.328 01:19:34 -- common/autotest_common.sh@955 -- # kill 1157880 00:26:44.328 01:19:34 -- common/autotest_common.sh@960 -- # wait 1157880 00:26:44.585 01:19:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:44.585 01:19:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:44.585 01:19:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:44.585 01:19:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:44.585 01:19:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:44.585 01:19:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:44.585 01:19:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:44.585 01:19:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:46.491 01:19:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:46.491 00:26:46.491 real 0m18.554s 00:26:46.491 user 0m25.856s 00:26:46.491 sys 0m2.890s 00:26:46.491 01:19:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:46.491 01:19:36 -- common/autotest_common.sh@10 -- # set +x 00:26:46.491 ************************************ 00:26:46.491 END TEST nvmf_discovery_remove_ifc 00:26:46.491 ************************************ 00:26:46.491 01:19:36 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:46.491 01:19:36 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:46.491 01:19:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:46.491 01:19:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:46.491 01:19:36 -- common/autotest_common.sh@10 -- # set +x 00:26:46.491 ************************************ 00:26:46.491 START TEST nvmf_digest 00:26:46.491 ************************************ 00:26:46.491 01:19:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:46.491 * Looking for test storage... 00:26:46.491 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:46.491 01:19:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:46.491 01:19:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:46.491 01:19:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:46.751 01:19:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:46.751 01:19:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:46.751 01:19:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:46.751 01:19:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:46.751 01:19:37 -- scripts/common.sh@335 -- # IFS=.-: 00:26:46.751 01:19:37 -- scripts/common.sh@335 -- # read -ra ver1 00:26:46.751 01:19:37 -- scripts/common.sh@336 -- # IFS=.-: 00:26:46.751 01:19:37 -- scripts/common.sh@336 -- # read -ra ver2 00:26:46.751 01:19:37 -- scripts/common.sh@337 -- # local 'op=<' 00:26:46.751 01:19:37 -- scripts/common.sh@339 -- # ver1_l=2 00:26:46.751 01:19:37 -- scripts/common.sh@340 -- # ver2_l=1 00:26:46.751 01:19:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:46.751 01:19:37 -- scripts/common.sh@343 -- # case "$op" in 00:26:46.751 01:19:37 -- scripts/common.sh@344 -- # : 1 00:26:46.751 01:19:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:46.751 01:19:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:46.751 01:19:37 -- scripts/common.sh@364 -- # decimal 1 00:26:46.751 01:19:37 -- scripts/common.sh@352 -- # local d=1 00:26:46.751 01:19:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:46.751 01:19:37 -- scripts/common.sh@354 -- # echo 1 00:26:46.751 01:19:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:46.751 01:19:37 -- scripts/common.sh@365 -- # decimal 2 00:26:46.751 01:19:37 -- scripts/common.sh@352 -- # local d=2 00:26:46.751 01:19:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:46.751 01:19:37 -- scripts/common.sh@354 -- # echo 2 00:26:46.751 01:19:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:46.751 01:19:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:46.751 01:19:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:46.751 01:19:37 -- scripts/common.sh@367 -- # return 0 00:26:46.751 01:19:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:46.751 01:19:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:46.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:46.751 --rc genhtml_branch_coverage=1 00:26:46.751 --rc genhtml_function_coverage=1 00:26:46.751 --rc genhtml_legend=1 00:26:46.751 --rc geninfo_all_blocks=1 00:26:46.751 --rc geninfo_unexecuted_blocks=1 00:26:46.751 00:26:46.751 ' 00:26:46.751 01:19:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:46.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:46.751 --rc genhtml_branch_coverage=1 00:26:46.751 --rc genhtml_function_coverage=1 00:26:46.751 --rc genhtml_legend=1 00:26:46.751 --rc geninfo_all_blocks=1 00:26:46.751 --rc geninfo_unexecuted_blocks=1 00:26:46.751 00:26:46.751 ' 00:26:46.751 01:19:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:46.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:46.751 --rc genhtml_branch_coverage=1 00:26:46.751 --rc genhtml_function_coverage=1 00:26:46.751 --rc genhtml_legend=1 00:26:46.751 --rc geninfo_all_blocks=1 00:26:46.751 --rc geninfo_unexecuted_blocks=1 00:26:46.751 00:26:46.751 ' 00:26:46.751 01:19:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:46.751 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:46.751 --rc genhtml_branch_coverage=1 00:26:46.751 --rc genhtml_function_coverage=1 00:26:46.751 --rc genhtml_legend=1 00:26:46.751 --rc geninfo_all_blocks=1 00:26:46.751 --rc geninfo_unexecuted_blocks=1 00:26:46.751 00:26:46.751 ' 00:26:46.751 01:19:37 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:46.751 01:19:37 -- nvmf/common.sh@7 -- # uname -s 00:26:46.751 01:19:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:46.751 01:19:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:46.751 01:19:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:46.751 01:19:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:46.751 01:19:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:46.751 01:19:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:46.751 01:19:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:46.751 01:19:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:46.751 01:19:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:46.751 01:19:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:46.751 01:19:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:46.751 01:19:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:46.751 01:19:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:46.751 01:19:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:46.751 01:19:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:46.751 01:19:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:46.751 01:19:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:46.751 01:19:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:46.751 01:19:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:46.751 01:19:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.751 01:19:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.751 01:19:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.751 01:19:37 -- paths/export.sh@5 -- # export PATH 00:26:46.752 01:19:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:46.752 01:19:37 -- nvmf/common.sh@46 -- # : 0 00:26:46.752 01:19:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:46.752 01:19:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:46.752 01:19:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:46.752 01:19:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:46.752 01:19:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:46.752 01:19:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:46.752 01:19:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:46.752 01:19:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:46.752 01:19:37 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:46.752 01:19:37 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:46.752 01:19:37 -- host/digest.sh@16 -- # runtime=2 00:26:46.752 01:19:37 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:46.752 01:19:37 -- host/digest.sh@132 -- # nvmftestinit 00:26:46.752 01:19:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:46.752 01:19:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:46.752 01:19:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:46.752 01:19:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:46.752 01:19:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:46.752 01:19:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:46.752 01:19:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:46.752 01:19:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:46.752 01:19:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:46.752 01:19:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:46.752 01:19:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:46.752 01:19:37 -- common/autotest_common.sh@10 -- # set +x 00:26:48.654 01:19:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:48.654 01:19:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:48.654 01:19:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:48.654 01:19:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:48.654 01:19:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:48.654 01:19:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:48.654 01:19:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:48.654 01:19:39 -- nvmf/common.sh@294 -- # net_devs=() 00:26:48.654 01:19:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:48.654 01:19:39 -- nvmf/common.sh@295 -- # e810=() 00:26:48.654 01:19:39 -- nvmf/common.sh@295 -- # local -ga e810 00:26:48.654 01:19:39 -- nvmf/common.sh@296 -- # x722=() 00:26:48.654 01:19:39 -- nvmf/common.sh@296 -- # local -ga x722 00:26:48.654 01:19:39 -- nvmf/common.sh@297 -- # mlx=() 00:26:48.654 01:19:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:48.654 01:19:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:48.654 01:19:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:48.654 01:19:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:48.654 01:19:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:48.654 01:19:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:48.654 01:19:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:48.654 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:48.654 01:19:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:48.654 01:19:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:48.654 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:48.654 01:19:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:48.654 01:19:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:48.654 01:19:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:48.654 01:19:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:48.654 01:19:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:48.654 01:19:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:48.654 01:19:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:48.654 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:48.654 01:19:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:48.654 01:19:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:48.654 01:19:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:48.654 01:19:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:48.654 01:19:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:48.654 01:19:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:48.655 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:48.655 01:19:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:48.655 01:19:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:48.655 01:19:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:48.655 01:19:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:48.655 01:19:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:48.655 01:19:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:48.655 01:19:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:48.655 01:19:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:48.655 01:19:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:48.655 01:19:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:48.655 01:19:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:48.655 01:19:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:48.655 01:19:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:48.655 01:19:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:48.655 01:19:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:48.655 01:19:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:48.655 01:19:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:48.655 01:19:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:48.655 01:19:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:48.913 01:19:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:48.913 01:19:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:48.913 01:19:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:48.913 01:19:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:48.913 01:19:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:48.913 01:19:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:48.913 01:19:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:48.913 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:48.913 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.261 ms 00:26:48.913 00:26:48.913 --- 10.0.0.2 ping statistics --- 00:26:48.913 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:48.913 rtt min/avg/max/mdev = 0.261/0.261/0.261/0.000 ms 00:26:48.913 01:19:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:48.913 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:48.913 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:26:48.913 00:26:48.913 --- 10.0.0.1 ping statistics --- 00:26:48.913 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:48.913 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:26:48.913 01:19:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:48.913 01:19:39 -- nvmf/common.sh@410 -- # return 0 00:26:48.913 01:19:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:48.913 01:19:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:48.913 01:19:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:48.913 01:19:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:48.913 01:19:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:48.913 01:19:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:48.913 01:19:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:48.913 01:19:39 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:48.913 01:19:39 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:48.913 01:19:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:48.913 01:19:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:48.913 01:19:39 -- common/autotest_common.sh@10 -- # set +x 00:26:48.913 ************************************ 00:26:48.913 START TEST nvmf_digest_clean 00:26:48.913 ************************************ 00:26:48.913 01:19:39 -- common/autotest_common.sh@1114 -- # run_digest 00:26:48.913 01:19:39 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:48.913 01:19:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:48.913 01:19:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:48.913 01:19:39 -- common/autotest_common.sh@10 -- # set +x 00:26:48.913 01:19:39 -- nvmf/common.sh@469 -- # nvmfpid=1161559 00:26:48.913 01:19:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:48.913 01:19:39 -- nvmf/common.sh@470 -- # waitforlisten 1161559 00:26:48.913 01:19:39 -- common/autotest_common.sh@829 -- # '[' -z 1161559 ']' 00:26:48.913 01:19:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:48.913 01:19:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:48.913 01:19:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:48.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:48.913 01:19:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:48.913 01:19:39 -- common/autotest_common.sh@10 -- # set +x 00:26:48.913 [2024-11-26 01:19:39.328189] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:48.913 [2024-11-26 01:19:39.328268] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:48.913 EAL: No free 2048 kB hugepages reported on node 1 00:26:48.913 [2024-11-26 01:19:39.401031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:49.171 [2024-11-26 01:19:39.515997] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:49.171 [2024-11-26 01:19:39.516185] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:49.171 [2024-11-26 01:19:39.516205] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:49.171 [2024-11-26 01:19:39.516220] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:49.171 [2024-11-26 01:19:39.516262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:49.171 01:19:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:49.171 01:19:39 -- common/autotest_common.sh@862 -- # return 0 00:26:49.171 01:19:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:49.171 01:19:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:49.171 01:19:39 -- common/autotest_common.sh@10 -- # set +x 00:26:49.171 01:19:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:49.171 01:19:39 -- host/digest.sh@120 -- # common_target_config 00:26:49.171 01:19:39 -- host/digest.sh@43 -- # rpc_cmd 00:26:49.171 01:19:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.171 01:19:39 -- common/autotest_common.sh@10 -- # set +x 00:26:49.430 null0 00:26:49.430 [2024-11-26 01:19:39.718171] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:49.430 [2024-11-26 01:19:39.742405] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:49.430 01:19:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.430 01:19:39 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:49.430 01:19:39 -- host/digest.sh@77 -- # local rw bs qd 00:26:49.430 01:19:39 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:49.430 01:19:39 -- host/digest.sh@80 -- # rw=randread 00:26:49.430 01:19:39 -- host/digest.sh@80 -- # bs=4096 00:26:49.430 01:19:39 -- host/digest.sh@80 -- # qd=128 00:26:49.430 01:19:39 -- host/digest.sh@82 -- # bperfpid=1161605 00:26:49.430 01:19:39 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:49.430 01:19:39 -- host/digest.sh@83 -- # waitforlisten 1161605 /var/tmp/bperf.sock 00:26:49.430 01:19:39 -- common/autotest_common.sh@829 -- # '[' -z 1161605 ']' 00:26:49.430 01:19:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:49.430 01:19:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:49.430 01:19:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:49.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:49.430 01:19:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:49.430 01:19:39 -- common/autotest_common.sh@10 -- # set +x 00:26:49.430 [2024-11-26 01:19:39.785824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:49.430 [2024-11-26 01:19:39.785888] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1161605 ] 00:26:49.430 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.430 [2024-11-26 01:19:39.848895] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:49.688 [2024-11-26 01:19:39.963339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:49.688 01:19:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:49.688 01:19:40 -- common/autotest_common.sh@862 -- # return 0 00:26:49.688 01:19:40 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:49.688 01:19:40 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:49.688 01:19:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:49.945 01:19:40 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:49.945 01:19:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:50.511 nvme0n1 00:26:50.511 01:19:40 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:50.511 01:19:40 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:50.511 Running I/O for 2 seconds... 00:26:53.048 00:26:53.048 Latency(us) 00:26:53.048 [2024-11-26T00:19:43.583Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:53.048 [2024-11-26T00:19:43.583Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:26:53.048 nvme0n1 : 2.00 15796.75 61.71 0.00 0.00 8094.92 2803.48 16117.00 00:26:53.048 [2024-11-26T00:19:43.583Z] =================================================================================================================== 00:26:53.048 [2024-11-26T00:19:43.583Z] Total : 15796.75 61.71 0.00 0.00 8094.92 2803.48 16117.00 00:26:53.048 0 00:26:53.048 01:19:42 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:53.048 01:19:42 -- host/digest.sh@92 -- # get_accel_stats 00:26:53.048 01:19:42 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:53.048 01:19:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:53.048 01:19:42 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:53.048 | select(.opcode=="crc32c") 00:26:53.048 | "\(.module_name) \(.executed)"' 00:26:53.048 01:19:43 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:53.048 01:19:43 -- host/digest.sh@93 -- # exp_module=software 00:26:53.048 01:19:43 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:53.048 01:19:43 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:53.048 01:19:43 -- host/digest.sh@97 -- # killprocess 1161605 00:26:53.048 01:19:43 -- common/autotest_common.sh@936 -- # '[' -z 1161605 ']' 00:26:53.048 01:19:43 -- common/autotest_common.sh@940 -- # kill -0 1161605 00:26:53.048 01:19:43 -- common/autotest_common.sh@941 -- # uname 00:26:53.048 01:19:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:53.048 01:19:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1161605 00:26:53.048 01:19:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:53.048 01:19:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:53.048 01:19:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1161605' 00:26:53.048 killing process with pid 1161605 00:26:53.048 01:19:43 -- common/autotest_common.sh@955 -- # kill 1161605 00:26:53.048 Received shutdown signal, test time was about 2.000000 seconds 00:26:53.048 00:26:53.048 Latency(us) 00:26:53.048 [2024-11-26T00:19:43.583Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:53.048 [2024-11-26T00:19:43.583Z] =================================================================================================================== 00:26:53.048 [2024-11-26T00:19:43.583Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:53.048 01:19:43 -- common/autotest_common.sh@960 -- # wait 1161605 00:26:53.048 01:19:43 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:26:53.048 01:19:43 -- host/digest.sh@77 -- # local rw bs qd 00:26:53.048 01:19:43 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:53.048 01:19:43 -- host/digest.sh@80 -- # rw=randread 00:26:53.048 01:19:43 -- host/digest.sh@80 -- # bs=131072 00:26:53.048 01:19:43 -- host/digest.sh@80 -- # qd=16 00:26:53.048 01:19:43 -- host/digest.sh@82 -- # bperfpid=1162133 00:26:53.048 01:19:43 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:26:53.048 01:19:43 -- host/digest.sh@83 -- # waitforlisten 1162133 /var/tmp/bperf.sock 00:26:53.048 01:19:43 -- common/autotest_common.sh@829 -- # '[' -z 1162133 ']' 00:26:53.048 01:19:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:53.048 01:19:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:53.048 01:19:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:53.048 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:53.048 01:19:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:53.307 01:19:43 -- common/autotest_common.sh@10 -- # set +x 00:26:53.307 [2024-11-26 01:19:43.616595] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:53.307 [2024-11-26 01:19:43.616681] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162133 ] 00:26:53.307 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:53.307 Zero copy mechanism will not be used. 00:26:53.307 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.307 [2024-11-26 01:19:43.678158] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:53.307 [2024-11-26 01:19:43.789170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:53.307 01:19:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:53.307 01:19:43 -- common/autotest_common.sh@862 -- # return 0 00:26:53.307 01:19:43 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:53.307 01:19:43 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:53.308 01:19:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:53.874 01:19:44 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:53.874 01:19:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:54.134 nvme0n1 00:26:54.134 01:19:44 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:54.134 01:19:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:54.134 I/O size of 131072 is greater than zero copy threshold (65536). 00:26:54.134 Zero copy mechanism will not be used. 00:26:54.134 Running I/O for 2 seconds... 00:26:56.669 00:26:56.669 Latency(us) 00:26:56.669 [2024-11-26T00:19:47.204Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.669 [2024-11-26T00:19:47.204Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:26:56.669 nvme0n1 : 2.00 5507.38 688.42 0.00 0.00 2901.04 873.81 8495.41 00:26:56.669 [2024-11-26T00:19:47.204Z] =================================================================================================================== 00:26:56.669 [2024-11-26T00:19:47.204Z] Total : 5507.38 688.42 0.00 0.00 2901.04 873.81 8495.41 00:26:56.669 0 00:26:56.669 01:19:46 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:56.669 01:19:46 -- host/digest.sh@92 -- # get_accel_stats 00:26:56.669 01:19:46 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:56.669 01:19:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:56.669 01:19:46 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:56.669 | select(.opcode=="crc32c") 00:26:56.669 | "\(.module_name) \(.executed)"' 00:26:56.669 01:19:46 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:26:56.669 01:19:46 -- host/digest.sh@93 -- # exp_module=software 00:26:56.669 01:19:46 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:26:56.669 01:19:46 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:26:56.669 01:19:46 -- host/digest.sh@97 -- # killprocess 1162133 00:26:56.669 01:19:46 -- common/autotest_common.sh@936 -- # '[' -z 1162133 ']' 00:26:56.669 01:19:46 -- common/autotest_common.sh@940 -- # kill -0 1162133 00:26:56.669 01:19:46 -- common/autotest_common.sh@941 -- # uname 00:26:56.669 01:19:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:56.669 01:19:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1162133 00:26:56.669 01:19:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:56.669 01:19:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:56.669 01:19:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1162133' 00:26:56.669 killing process with pid 1162133 00:26:56.669 01:19:46 -- common/autotest_common.sh@955 -- # kill 1162133 00:26:56.669 Received shutdown signal, test time was about 2.000000 seconds 00:26:56.669 00:26:56.669 Latency(us) 00:26:56.669 [2024-11-26T00:19:47.204Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:56.669 [2024-11-26T00:19:47.204Z] =================================================================================================================== 00:26:56.669 [2024-11-26T00:19:47.204Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:56.669 01:19:46 -- common/autotest_common.sh@960 -- # wait 1162133 00:26:56.928 01:19:47 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:26:56.928 01:19:47 -- host/digest.sh@77 -- # local rw bs qd 00:26:56.928 01:19:47 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:56.928 01:19:47 -- host/digest.sh@80 -- # rw=randwrite 00:26:56.928 01:19:47 -- host/digest.sh@80 -- # bs=4096 00:26:56.928 01:19:47 -- host/digest.sh@80 -- # qd=128 00:26:56.928 01:19:47 -- host/digest.sh@82 -- # bperfpid=1162549 00:26:56.928 01:19:47 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:56.928 01:19:47 -- host/digest.sh@83 -- # waitforlisten 1162549 /var/tmp/bperf.sock 00:26:56.928 01:19:47 -- common/autotest_common.sh@829 -- # '[' -z 1162549 ']' 00:26:56.928 01:19:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:56.928 01:19:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.928 01:19:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:56.928 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:56.928 01:19:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.928 01:19:47 -- common/autotest_common.sh@10 -- # set +x 00:26:56.928 [2024-11-26 01:19:47.255112] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.928 [2024-11-26 01:19:47.255204] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162549 ] 00:26:56.928 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.928 [2024-11-26 01:19:47.317302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:56.928 [2024-11-26 01:19:47.428248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.186 01:19:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.186 01:19:47 -- common/autotest_common.sh@862 -- # return 0 00:26:57.186 01:19:47 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:57.186 01:19:47 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:57.186 01:19:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:57.445 01:19:47 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.445 01:19:47 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.703 nvme0n1 00:26:57.703 01:19:48 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:57.703 01:19:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:57.963 Running I/O for 2 seconds... 00:26:59.875 00:26:59.875 Latency(us) 00:26:59.875 [2024-11-26T00:19:50.410Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:59.875 [2024-11-26T00:19:50.410Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:26:59.875 nvme0n1 : 2.01 19210.76 75.04 0.00 0.00 6648.86 5704.06 12233.39 00:26:59.875 [2024-11-26T00:19:50.410Z] =================================================================================================================== 00:26:59.875 [2024-11-26T00:19:50.410Z] Total : 19210.76 75.04 0.00 0.00 6648.86 5704.06 12233.39 00:26:59.875 0 00:26:59.875 01:19:50 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:26:59.875 01:19:50 -- host/digest.sh@92 -- # get_accel_stats 00:26:59.875 01:19:50 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:26:59.875 01:19:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:26:59.875 01:19:50 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:26:59.875 | select(.opcode=="crc32c") 00:26:59.875 | "\(.module_name) \(.executed)"' 00:27:00.134 01:19:50 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:00.134 01:19:50 -- host/digest.sh@93 -- # exp_module=software 00:27:00.134 01:19:50 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:00.134 01:19:50 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:00.134 01:19:50 -- host/digest.sh@97 -- # killprocess 1162549 00:27:00.134 01:19:50 -- common/autotest_common.sh@936 -- # '[' -z 1162549 ']' 00:27:00.134 01:19:50 -- common/autotest_common.sh@940 -- # kill -0 1162549 00:27:00.134 01:19:50 -- common/autotest_common.sh@941 -- # uname 00:27:00.134 01:19:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.134 01:19:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1162549 00:27:00.134 01:19:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:00.134 01:19:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:00.134 01:19:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1162549' 00:27:00.134 killing process with pid 1162549 00:27:00.134 01:19:50 -- common/autotest_common.sh@955 -- # kill 1162549 00:27:00.134 Received shutdown signal, test time was about 2.000000 seconds 00:27:00.134 00:27:00.134 Latency(us) 00:27:00.134 [2024-11-26T00:19:50.669Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.134 [2024-11-26T00:19:50.669Z] =================================================================================================================== 00:27:00.134 [2024-11-26T00:19:50.669Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:00.134 01:19:50 -- common/autotest_common.sh@960 -- # wait 1162549 00:27:00.392 01:19:50 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:00.392 01:19:50 -- host/digest.sh@77 -- # local rw bs qd 00:27:00.392 01:19:50 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:00.392 01:19:50 -- host/digest.sh@80 -- # rw=randwrite 00:27:00.392 01:19:50 -- host/digest.sh@80 -- # bs=131072 00:27:00.392 01:19:50 -- host/digest.sh@80 -- # qd=16 00:27:00.392 01:19:50 -- host/digest.sh@82 -- # bperfpid=1162971 00:27:00.392 01:19:50 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:00.392 01:19:50 -- host/digest.sh@83 -- # waitforlisten 1162971 /var/tmp/bperf.sock 00:27:00.392 01:19:50 -- common/autotest_common.sh@829 -- # '[' -z 1162971 ']' 00:27:00.392 01:19:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.392 01:19:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.392 01:19:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.392 01:19:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.392 01:19:50 -- common/autotest_common.sh@10 -- # set +x 00:27:00.392 [2024-11-26 01:19:50.877574] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.392 [2024-11-26 01:19:50.877661] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1162971 ] 00:27:00.392 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.392 Zero copy mechanism will not be used. 00:27:00.392 EAL: No free 2048 kB hugepages reported on node 1 00:27:00.649 [2024-11-26 01:19:50.938219] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:00.649 [2024-11-26 01:19:51.052327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:00.649 01:19:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:00.649 01:19:51 -- common/autotest_common.sh@862 -- # return 0 00:27:00.649 01:19:51 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:00.649 01:19:51 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:00.649 01:19:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:01.219 01:19:51 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.219 01:19:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.478 nvme0n1 00:27:01.478 01:19:51 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:01.478 01:19:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:01.478 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:01.478 Zero copy mechanism will not be used. 00:27:01.478 Running I/O for 2 seconds... 00:27:04.008 00:27:04.008 Latency(us) 00:27:04.008 [2024-11-26T00:19:54.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.008 [2024-11-26T00:19:54.543Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:04.008 nvme0n1 : 2.00 6410.45 801.31 0.00 0.00 2488.89 1856.85 7815.77 00:27:04.008 [2024-11-26T00:19:54.543Z] =================================================================================================================== 00:27:04.008 [2024-11-26T00:19:54.543Z] Total : 6410.45 801.31 0.00 0.00 2488.89 1856.85 7815.77 00:27:04.008 0 00:27:04.008 01:19:53 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:04.008 01:19:53 -- host/digest.sh@92 -- # get_accel_stats 00:27:04.008 01:19:53 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:04.008 01:19:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:04.008 01:19:53 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:04.008 | select(.opcode=="crc32c") 00:27:04.008 | "\(.module_name) \(.executed)"' 00:27:04.008 01:19:54 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:04.008 01:19:54 -- host/digest.sh@93 -- # exp_module=software 00:27:04.008 01:19:54 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:04.008 01:19:54 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:04.008 01:19:54 -- host/digest.sh@97 -- # killprocess 1162971 00:27:04.008 01:19:54 -- common/autotest_common.sh@936 -- # '[' -z 1162971 ']' 00:27:04.008 01:19:54 -- common/autotest_common.sh@940 -- # kill -0 1162971 00:27:04.008 01:19:54 -- common/autotest_common.sh@941 -- # uname 00:27:04.008 01:19:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:04.008 01:19:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1162971 00:27:04.008 01:19:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:04.008 01:19:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:04.008 01:19:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1162971' 00:27:04.008 killing process with pid 1162971 00:27:04.008 01:19:54 -- common/autotest_common.sh@955 -- # kill 1162971 00:27:04.008 Received shutdown signal, test time was about 2.000000 seconds 00:27:04.008 00:27:04.008 Latency(us) 00:27:04.008 [2024-11-26T00:19:54.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.008 [2024-11-26T00:19:54.543Z] =================================================================================================================== 00:27:04.008 [2024-11-26T00:19:54.543Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:04.008 01:19:54 -- common/autotest_common.sh@960 -- # wait 1162971 00:27:04.008 01:19:54 -- host/digest.sh@126 -- # killprocess 1161559 00:27:04.008 01:19:54 -- common/autotest_common.sh@936 -- # '[' -z 1161559 ']' 00:27:04.008 01:19:54 -- common/autotest_common.sh@940 -- # kill -0 1161559 00:27:04.008 01:19:54 -- common/autotest_common.sh@941 -- # uname 00:27:04.008 01:19:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:04.008 01:19:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1161559 00:27:04.268 01:19:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:04.268 01:19:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:04.268 01:19:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1161559' 00:27:04.268 killing process with pid 1161559 00:27:04.268 01:19:54 -- common/autotest_common.sh@955 -- # kill 1161559 00:27:04.268 01:19:54 -- common/autotest_common.sh@960 -- # wait 1161559 00:27:04.529 00:27:04.529 real 0m15.552s 00:27:04.529 user 0m30.924s 00:27:04.529 sys 0m4.342s 00:27:04.529 01:19:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:04.529 01:19:54 -- common/autotest_common.sh@10 -- # set +x 00:27:04.529 ************************************ 00:27:04.529 END TEST nvmf_digest_clean 00:27:04.529 ************************************ 00:27:04.529 01:19:54 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:04.529 01:19:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:04.529 01:19:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:04.529 01:19:54 -- common/autotest_common.sh@10 -- # set +x 00:27:04.529 ************************************ 00:27:04.529 START TEST nvmf_digest_error 00:27:04.529 ************************************ 00:27:04.529 01:19:54 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:04.529 01:19:54 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:04.529 01:19:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:04.529 01:19:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:04.529 01:19:54 -- common/autotest_common.sh@10 -- # set +x 00:27:04.529 01:19:54 -- nvmf/common.sh@469 -- # nvmfpid=1163542 00:27:04.529 01:19:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:04.529 01:19:54 -- nvmf/common.sh@470 -- # waitforlisten 1163542 00:27:04.529 01:19:54 -- common/autotest_common.sh@829 -- # '[' -z 1163542 ']' 00:27:04.529 01:19:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:04.529 01:19:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:04.529 01:19:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:04.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:04.529 01:19:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:04.529 01:19:54 -- common/autotest_common.sh@10 -- # set +x 00:27:04.529 [2024-11-26 01:19:54.914851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:04.529 [2024-11-26 01:19:54.914946] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:04.529 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.529 [2024-11-26 01:19:54.977924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.788 [2024-11-26 01:19:55.084817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:04.789 [2024-11-26 01:19:55.084974] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:04.789 [2024-11-26 01:19:55.084991] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:04.789 [2024-11-26 01:19:55.085003] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:04.789 [2024-11-26 01:19:55.085031] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:04.789 01:19:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:04.789 01:19:55 -- common/autotest_common.sh@862 -- # return 0 00:27:04.789 01:19:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:04.789 01:19:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:04.789 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.789 01:19:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:04.789 01:19:55 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:04.789 01:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.789 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.789 [2024-11-26 01:19:55.161649] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:04.789 01:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.789 01:19:55 -- host/digest.sh@104 -- # common_target_config 00:27:04.789 01:19:55 -- host/digest.sh@43 -- # rpc_cmd 00:27:04.789 01:19:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:04.789 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:27:04.789 null0 00:27:04.789 [2024-11-26 01:19:55.283079] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:04.789 [2024-11-26 01:19:55.307375] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:04.789 01:19:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:04.789 01:19:55 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:04.789 01:19:55 -- host/digest.sh@54 -- # local rw bs qd 00:27:04.789 01:19:55 -- host/digest.sh@56 -- # rw=randread 00:27:04.789 01:19:55 -- host/digest.sh@56 -- # bs=4096 00:27:04.789 01:19:55 -- host/digest.sh@56 -- # qd=128 00:27:04.789 01:19:55 -- host/digest.sh@58 -- # bperfpid=1163561 00:27:04.789 01:19:55 -- host/digest.sh@60 -- # waitforlisten 1163561 /var/tmp/bperf.sock 00:27:04.789 01:19:55 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:04.789 01:19:55 -- common/autotest_common.sh@829 -- # '[' -z 1163561 ']' 00:27:04.789 01:19:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:04.789 01:19:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:04.789 01:19:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:04.789 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:04.789 01:19:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:04.789 01:19:55 -- common/autotest_common.sh@10 -- # set +x 00:27:05.047 [2024-11-26 01:19:55.350443] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:05.047 [2024-11-26 01:19:55.350506] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1163561 ] 00:27:05.047 EAL: No free 2048 kB hugepages reported on node 1 00:27:05.047 [2024-11-26 01:19:55.411024] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:05.047 [2024-11-26 01:19:55.525014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:05.983 01:19:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:05.983 01:19:56 -- common/autotest_common.sh@862 -- # return 0 00:27:05.983 01:19:56 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:05.983 01:19:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:06.241 01:19:56 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:06.241 01:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.241 01:19:56 -- common/autotest_common.sh@10 -- # set +x 00:27:06.241 01:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.241 01:19:56 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.241 01:19:56 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:06.810 nvme0n1 00:27:06.810 01:19:57 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:06.810 01:19:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:06.810 01:19:57 -- common/autotest_common.sh@10 -- # set +x 00:27:06.810 01:19:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:06.810 01:19:57 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:06.810 01:19:57 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:06.810 Running I/O for 2 seconds... 00:27:06.810 [2024-11-26 01:19:57.187410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.187463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:20721 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.187485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.203059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.203097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:23425 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.203118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.214732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.214762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:13260 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.214778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.231324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.231360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24552 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.231380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.248459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.248506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:2056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.248523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.259672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.259724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:22108 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.259745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.275791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.275820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:16441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.275835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.293138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.293174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19950 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.293194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.309413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.309443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7590 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.309460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:06.810 [2024-11-26 01:19:57.326722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:06.810 [2024-11-26 01:19:57.326772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:17591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:06.810 [2024-11-26 01:19:57.326789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.344218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.344250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14777 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.344283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.355867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.355897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16588 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.355915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.371861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.371890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:21102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.371907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.388745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.388777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:1072 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.388800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.399530] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.399574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:454 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.399591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.415415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.415445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:1980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.415462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.431640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.431690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:17460 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.431709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.448641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.448678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11543 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.448706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.466152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.466189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.466208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.482821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.482850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:19363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.482865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.498112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.498145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:15355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.498178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.510360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.510395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:1132 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.510415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.526245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.526281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:24169 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.526301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.543144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.543173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:17689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.543189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.559993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.560042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:12279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.560061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.576085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.576130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8670 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.576146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.069 [2024-11-26 01:19:57.587720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.069 [2024-11-26 01:19:57.587766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:13030 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.069 [2024-11-26 01:19:57.587781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.328 [2024-11-26 01:19:57.604648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.328 [2024-11-26 01:19:57.604693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:23142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.328 [2024-11-26 01:19:57.604716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.328 [2024-11-26 01:19:57.621949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.328 [2024-11-26 01:19:57.621978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:9610 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.328 [2024-11-26 01:19:57.622011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.328 [2024-11-26 01:19:57.639076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.328 [2024-11-26 01:19:57.639113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:10700 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.328 [2024-11-26 01:19:57.639133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.328 [2024-11-26 01:19:57.655936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.328 [2024-11-26 01:19:57.655984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15806 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.328 [2024-11-26 01:19:57.656007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.328 [2024-11-26 01:19:57.672796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.328 [2024-11-26 01:19:57.672828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:13698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.328 [2024-11-26 01:19:57.672861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.328 [2024-11-26 01:19:57.688246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.688278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:13130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.688295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.700325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.700360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:24390 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.700380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.716372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.716420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24925 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.716445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.732506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.732554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17939 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.732575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.744886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.744915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:1785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.744938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.760037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.760066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:2572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.760082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.777571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.777618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:607 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.777640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.793300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.793342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23409 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.793362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.810056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.810102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.810119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.825452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.825501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:23693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.825527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.836725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.836760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:22929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.836780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.329 [2024-11-26 01:19:57.854189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.329 [2024-11-26 01:19:57.854224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:7845 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.329 [2024-11-26 01:19:57.854243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.587 [2024-11-26 01:19:57.871036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.587 [2024-11-26 01:19:57.871078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:12066 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.587 [2024-11-26 01:19:57.871098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.587 [2024-11-26 01:19:57.887205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.587 [2024-11-26 01:19:57.887240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:13800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.587 [2024-11-26 01:19:57.887263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.587 [2024-11-26 01:19:57.904869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.587 [2024-11-26 01:19:57.904899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:492 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.904916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:57.922428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:57.922458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:13413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.922475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:57.939252] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:57.939288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:7443 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.939307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:57.956317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:57.956346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:18414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.956370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:57.973175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:57.973205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:2716 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.973224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:57.988634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:57.988666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:16152 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.988699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:57.999935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:57.999965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:21473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:57.999996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.017393] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.017429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.017450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.033984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.034016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:19709 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.034035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.045263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.045298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.045318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.061429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.061465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23361 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.061493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.078416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.078452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:11941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.078471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.093882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.093929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:16027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.093948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.588 [2024-11-26 01:19:58.106390] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.588 [2024-11-26 01:19:58.106434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.588 [2024-11-26 01:19:58.106454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.123046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.123082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:9748 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.123104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.134944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.134998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:1638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.135017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.151202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.151250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.151275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.167422] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.167453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:11332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.167489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.178709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.178744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:11374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.178775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.202967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.203015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9455 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.203034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.218073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.218108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:682 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.218128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.229874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.229904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:21137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.229920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.247096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.247132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:18837 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.247152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.262935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.262968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:14207 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.262986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.275103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.275138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:8994 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.275158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.291964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.291993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:18728 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.292009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.308684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.308729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:17913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.308763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.325600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.325630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:24070 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.325651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.341639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.848 [2024-11-26 01:19:58.341675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22244 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.848 [2024-11-26 01:19:58.341707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.848 [2024-11-26 01:19:58.353798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.849 [2024-11-26 01:19:58.353828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:17039 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.849 [2024-11-26 01:19:58.353845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:07.849 [2024-11-26 01:19:58.370618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:07.849 [2024-11-26 01:19:58.370654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:21824 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:07.849 [2024-11-26 01:19:58.370674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.387958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.388007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:10533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.388025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.399061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.399096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:15981 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.399115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.415308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.415340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2304 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.415357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.432993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.433025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:6205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.433042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.444118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.444148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:11304 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.444180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.458644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.458692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:15974 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.458715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.476051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.476087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:95 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.476106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.492961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.493007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:3827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.493027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.504126] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.504156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:23313 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.504173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.520060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.520095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:1453 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.109 [2024-11-26 01:19:58.520115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.109 [2024-11-26 01:19:58.538004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.109 [2024-11-26 01:19:58.538039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10311 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.538058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.110 [2024-11-26 01:19:58.549070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.110 [2024-11-26 01:19:58.549106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:11924 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.549125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.110 [2024-11-26 01:19:58.563795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.110 [2024-11-26 01:19:58.563824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:6288 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.563840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.110 [2024-11-26 01:19:58.580669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.110 [2024-11-26 01:19:58.580714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:16204 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.580735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.110 [2024-11-26 01:19:58.597766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.110 [2024-11-26 01:19:58.597795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:13820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.597811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.110 [2024-11-26 01:19:58.613320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.110 [2024-11-26 01:19:58.613350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:903 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.613367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.110 [2024-11-26 01:19:58.624931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.110 [2024-11-26 01:19:58.624974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:19459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.110 [2024-11-26 01:19:58.624991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.642604] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.642635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:21630 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.642653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.659046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.659093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:6776 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.659111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.674696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.674729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5982 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.674746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.686768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.686798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:22395 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.686814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.703804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.703834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:14002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.703865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.714265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.714300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.714327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.730415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.730462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:14043 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.730480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.745060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.745092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1461 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.745110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.755845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.369 [2024-11-26 01:19:58.755876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.369 [2024-11-26 01:19:58.755894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.369 [2024-11-26 01:19:58.770061] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.770095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:19986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.770114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.785188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.785224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.785258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.800075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.800107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:3107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.800124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.811298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.811332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15538 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.811352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.829065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.829100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.829120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.844313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.844344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.844362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.856394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.856442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:20707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.856458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.872774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.872812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:14921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.872829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.889465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.889496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:11405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.889513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.370 [2024-11-26 01:19:58.900140] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.370 [2024-11-26 01:19:58.900175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:11442 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.370 [2024-11-26 01:19:58.900194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.629 [2024-11-26 01:19:58.916245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.629 [2024-11-26 01:19:58.916281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:24773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.629 [2024-11-26 01:19:58.916301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.629 [2024-11-26 01:19:58.933037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.629 [2024-11-26 01:19:58.933085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:18539 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.629 [2024-11-26 01:19:58.933106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.629 [2024-11-26 01:19:58.948400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.629 [2024-11-26 01:19:58.948433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:14970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.629 [2024-11-26 01:19:58.948450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.629 [2024-11-26 01:19:58.959568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.629 [2024-11-26 01:19:58.959605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:18478 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.629 [2024-11-26 01:19:58.959637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.629 [2024-11-26 01:19:58.976945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.629 [2024-11-26 01:19:58.976996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:13641 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:58.977016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:58.993460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:58.993494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21367 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:58.993514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.010523] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.010553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:19049 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.010570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.027646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.027682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:22773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.027711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.044233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.044263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:3742 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.044280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.060609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.060639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:24568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.060656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.077433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.077464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:25379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.077480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.094314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.094351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:15590 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.094371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.110980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.111015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:420 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.111031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.121539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.121581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:23720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.121597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.138335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.138370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:13088 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.138389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.630 [2024-11-26 01:19:59.154171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.630 [2024-11-26 01:19:59.154206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:11032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.630 [2024-11-26 01:19:59.154225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.888 [2024-11-26 01:19:59.171079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x13f3bb0) 00:27:08.888 [2024-11-26 01:19:59.171111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17896 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:08.888 [2024-11-26 01:19:59.171128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:08.888 00:27:08.888 Latency(us) 00:27:08.888 [2024-11-26T00:19:59.423Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.888 [2024-11-26T00:19:59.423Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:08.888 nvme0n1 : 2.00 16586.50 64.79 0.00 0.00 7709.94 2852.03 30874.74 00:27:08.888 [2024-11-26T00:19:59.423Z] =================================================================================================================== 00:27:08.888 [2024-11-26T00:19:59.423Z] Total : 16586.50 64.79 0.00 0.00 7709.94 2852.03 30874.74 00:27:08.888 0 00:27:08.888 01:19:59 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:08.888 01:19:59 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:08.888 01:19:59 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:08.888 01:19:59 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:08.888 | .driver_specific 00:27:08.888 | .nvme_error 00:27:08.888 | .status_code 00:27:08.888 | .command_transient_transport_error' 00:27:09.146 01:19:59 -- host/digest.sh@71 -- # (( 130 > 0 )) 00:27:09.146 01:19:59 -- host/digest.sh@73 -- # killprocess 1163561 00:27:09.146 01:19:59 -- common/autotest_common.sh@936 -- # '[' -z 1163561 ']' 00:27:09.146 01:19:59 -- common/autotest_common.sh@940 -- # kill -0 1163561 00:27:09.146 01:19:59 -- common/autotest_common.sh@941 -- # uname 00:27:09.146 01:19:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:09.146 01:19:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1163561 00:27:09.146 01:19:59 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:09.146 01:19:59 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:09.146 01:19:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1163561' 00:27:09.146 killing process with pid 1163561 00:27:09.146 01:19:59 -- common/autotest_common.sh@955 -- # kill 1163561 00:27:09.146 Received shutdown signal, test time was about 2.000000 seconds 00:27:09.146 00:27:09.146 Latency(us) 00:27:09.146 [2024-11-26T00:19:59.681Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:09.146 [2024-11-26T00:19:59.681Z] =================================================================================================================== 00:27:09.146 [2024-11-26T00:19:59.681Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:09.146 01:19:59 -- common/autotest_common.sh@960 -- # wait 1163561 00:27:09.405 01:19:59 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:09.405 01:19:59 -- host/digest.sh@54 -- # local rw bs qd 00:27:09.405 01:19:59 -- host/digest.sh@56 -- # rw=randread 00:27:09.405 01:19:59 -- host/digest.sh@56 -- # bs=131072 00:27:09.405 01:19:59 -- host/digest.sh@56 -- # qd=16 00:27:09.405 01:19:59 -- host/digest.sh@58 -- # bperfpid=1164120 00:27:09.405 01:19:59 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:09.405 01:19:59 -- host/digest.sh@60 -- # waitforlisten 1164120 /var/tmp/bperf.sock 00:27:09.405 01:19:59 -- common/autotest_common.sh@829 -- # '[' -z 1164120 ']' 00:27:09.405 01:19:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:09.405 01:19:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:09.405 01:19:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:09.405 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:09.405 01:19:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:09.405 01:19:59 -- common/autotest_common.sh@10 -- # set +x 00:27:09.405 [2024-11-26 01:19:59.760840] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:09.405 [2024-11-26 01:19:59.760913] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164120 ] 00:27:09.405 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:09.405 Zero copy mechanism will not be used. 00:27:09.405 EAL: No free 2048 kB hugepages reported on node 1 00:27:09.405 [2024-11-26 01:19:59.817925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:09.405 [2024-11-26 01:19:59.923053] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:10.339 01:20:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:10.339 01:20:00 -- common/autotest_common.sh@862 -- # return 0 00:27:10.339 01:20:00 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.339 01:20:00 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:10.598 01:20:01 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:10.598 01:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:10.598 01:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:10.598 01:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:10.598 01:20:01 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:10.598 01:20:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:11.166 nvme0n1 00:27:11.166 01:20:01 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:11.166 01:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:11.166 01:20:01 -- common/autotest_common.sh@10 -- # set +x 00:27:11.166 01:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:11.166 01:20:01 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:11.166 01:20:01 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:11.166 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:11.166 Zero copy mechanism will not be used. 00:27:11.166 Running I/O for 2 seconds... 00:27:11.166 [2024-11-26 01:20:01.582431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.166 [2024-11-26 01:20:01.582495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.166 [2024-11-26 01:20:01.582516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.166 [2024-11-26 01:20:01.588279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.166 [2024-11-26 01:20:01.588314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.166 [2024-11-26 01:20:01.588331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.166 [2024-11-26 01:20:01.593802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.166 [2024-11-26 01:20:01.593835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.166 [2024-11-26 01:20:01.593853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.166 [2024-11-26 01:20:01.599150] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.166 [2024-11-26 01:20:01.599179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.166 [2024-11-26 01:20:01.599196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.166 [2024-11-26 01:20:01.604707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.166 [2024-11-26 01:20:01.604753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.166 [2024-11-26 01:20:01.604771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.166 [2024-11-26 01:20:01.610357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.166 [2024-11-26 01:20:01.610387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.166 [2024-11-26 01:20:01.610405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.615943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.615974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.615991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.621545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.621578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.621595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.626764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.626796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.626823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.631608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.631640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.631658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.636398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.636430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.636462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.642354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.642386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.642404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.647948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.647979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.647996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.654753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.654785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.654803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.661709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.661740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.661773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.669597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.669629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.669646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.675448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.675481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.675499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.680406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.680438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.680455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.685063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.685094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.685111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.689580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.689611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.689628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.167 [2024-11-26 01:20:01.695069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.167 [2024-11-26 01:20:01.695102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.167 [2024-11-26 01:20:01.695135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.700344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.700376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.700397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.705764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.705797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.705815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.710961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.711011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.711032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.716178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.716211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.716228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.721545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.721590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.721615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.726747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.726778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.726794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.731911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.731941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.731958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.737216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.737246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.737278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.742524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.742555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.742571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.747913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.747944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.747960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.752963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.752993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.753010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.758226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.758256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.758273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.763643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.763696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.763715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.768930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.768968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.768986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.774285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.774317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.774334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.779539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.779569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.779586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.784948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.446 [2024-11-26 01:20:01.784980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.446 [2024-11-26 01:20:01.785012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.446 [2024-11-26 01:20:01.790206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.790236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.790252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.795418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.795448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.795465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.800618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.800649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.800665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.805928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.805959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.805992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.811044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.811073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.811105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.816056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.816101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.816118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.821905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.821937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.821970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.826597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.826642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.826659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.831041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.831072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.831088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.836138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.836171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.836189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.841791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.841823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.841840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.847385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.847416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.847433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.852899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.852929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.852945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.858473] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.858507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.858534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.864097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.864128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.864146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.870520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.870555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.870575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.877283] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.877318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.877337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.884873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.884905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.884923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.892098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.892129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.892146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.899862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.899893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.899911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.907426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.907461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.907480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.915111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.915145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.915163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.921667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.921743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.921763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.928818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.928850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.928867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.936887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.936919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.936936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.945262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.945298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.945317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.953621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.447 [2024-11-26 01:20:01.953656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.447 [2024-11-26 01:20:01.953676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.447 [2024-11-26 01:20:01.962007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.448 [2024-11-26 01:20:01.962040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.448 [2024-11-26 01:20:01.962058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:01.969670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:01.969711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:01.969730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:01.976413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:01.976449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:01.976468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:01.983542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:01.983583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:01.983604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:01.990333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:01.990372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:01.990392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:01.997055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:01.997090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:01.997110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.003669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.003716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.003752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.009084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.009119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.009138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.014562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.014596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.014616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.019426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.019460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.019479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.023805] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.023833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.023849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.030340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.030374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.030393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.037497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.037533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.037559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.044900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.044931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.044947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.053172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.053207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.053226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.061045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.061081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.061100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.068641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.068678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.068729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.074794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.074827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.074845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.080276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.080311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.080330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.086548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.086584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.086603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.092880] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.092912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.737 [2024-11-26 01:20:02.092930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.737 [2024-11-26 01:20:02.099053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.737 [2024-11-26 01:20:02.099089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.099109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.105444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.105479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.105499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.110238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.110273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.110292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.115119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.115154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.115174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.119871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.119902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.119918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.125176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.125205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.125222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.131070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.131105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.131124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.136759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.136803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.136819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.142448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.142481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.142506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.148069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.148104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.148122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.153775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.153820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.153836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.159306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.159340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.159358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.164917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.164949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.164985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.170556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.170589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.170607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.176437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.176472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.176491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.182108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.182142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.182160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.187775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.187819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.187834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.193536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.193576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.193596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.199174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.199208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.199227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.204928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.204973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.204990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.210943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.210989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.211005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.216664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.216703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.216723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.222411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.222445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.222464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.228024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.228057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.228076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.233790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.233838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.233854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.239424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.239459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.239478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.738 [2024-11-26 01:20:02.245434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.738 [2024-11-26 01:20:02.245475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.738 [2024-11-26 01:20:02.245499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.251131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.251171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.251192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.256930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.256961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.256978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.262850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.262894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.262910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.268657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.268702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.268748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.274466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.274501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.274520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.280178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.280212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.280231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.286075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.286111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.286130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.291732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.291779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.291807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.297486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.297519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.297537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.303195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.303229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.303248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.308972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.309018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.309036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.314977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.315022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.315042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.320868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.320897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.320913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.326405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:11.999 [2024-11-26 01:20:02.326452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:11.999 [2024-11-26 01:20:02.326471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:11.999 [2024-11-26 01:20:02.332200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.332234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.332252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.338048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.338083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.338101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.343902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.343937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.343954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.349943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.349972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.350007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.355799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.355828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.355845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.361612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.361657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.361676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.367467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.367500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.367518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.373303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.373337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.373355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.379065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.379099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.379117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.384864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.384908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.384924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.390577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.390611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.390629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.396205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.396236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.396253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.401883] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.401914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.401956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.407585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.407618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.407637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.413336] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.413369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.413388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.419001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.419030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.419064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.424855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.424899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.424915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.430997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.431032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.431051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.436639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.436670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.436695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.442292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.442322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.442345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.447614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.447647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.447665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.454226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.454261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.454280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.459428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.000 [2024-11-26 01:20:02.459462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.000 [2024-11-26 01:20:02.459481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.000 [2024-11-26 01:20:02.465435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.465470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.465490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.471102] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.471136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.471155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.476945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.476979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.477022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.482864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.482895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.482913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.489637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.489672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.489704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.496410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.496446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.496465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.503281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.503317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.503336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.509383] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.509420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.509440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.514605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.514645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.514663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.519434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.519468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.519486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.524025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.524058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.524077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.001 [2024-11-26 01:20:02.529040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.001 [2024-11-26 01:20:02.529074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.001 [2024-11-26 01:20:02.529093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.534828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.534859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.534877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.540254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.540289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.540314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.545890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.545921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.545938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.551448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.551481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.551499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.556118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.556152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.556171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.560789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.560820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.560837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.565461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.565495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.565513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.569825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.569857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.569874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.574201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.574235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.574254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.262 [2024-11-26 01:20:02.579384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.262 [2024-11-26 01:20:02.579418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.262 [2024-11-26 01:20:02.579437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.585215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.585255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.585274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.590924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.590955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.590972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.596662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.596703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.596740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.602291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.602323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.602341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.607976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.608022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.608042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.613668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.613710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.613730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.619637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.619671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.619699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.625264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.625298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.625316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.630971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.631001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.631018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.636661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.636704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.636741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.642299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.642332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.642350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.647968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.647999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.648017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.653886] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.653917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.653933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.659564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.659598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.659617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.665256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.665290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.665309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.670832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.670863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.670880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.676634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.676668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.676695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.682417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.682449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.682474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.687907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.687937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.687953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.693511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.693544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.693563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.698307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.698341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.698360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.703226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.703259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.703277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.706611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.706643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.706661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.713533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.713582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.713601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.720395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.720441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.720460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.726999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.727048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.727068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.263 [2024-11-26 01:20:02.733611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.263 [2024-11-26 01:20:02.733652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.263 [2024-11-26 01:20:02.733672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.739739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.739770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.739788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.744997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.745046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.745065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.750695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.750752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.750769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.756444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.756478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.756497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.761763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.761793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.761825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.767863] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.767893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.767909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.774821] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.774853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.774885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.782801] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.782831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.782852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.264 [2024-11-26 01:20:02.789369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.264 [2024-11-26 01:20:02.789405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.264 [2024-11-26 01:20:02.789424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.795218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.795254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.795273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.800558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.800593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.800612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.805983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.806014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.806031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.812812] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.812843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.812874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.819744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.819776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.819809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.826575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.826611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.826631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.833268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.833304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.833323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.839238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.839291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.839309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.846583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.846619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.846639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.854787] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.854820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.854838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.862232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.862268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.862287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.870219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.870256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.870275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.877170] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.877218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.877237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.884037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.884072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.884091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.891189] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.891222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.891242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.898443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.898478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.898497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.905749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.905779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.905795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.526 [2024-11-26 01:20:02.913161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.526 [2024-11-26 01:20:02.913193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.526 [2024-11-26 01:20:02.913210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.920342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.920372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.920388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.926051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.926082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.926099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.932007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.932038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.932056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.938355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.938401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.938417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.945819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.945852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.945870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.953218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.953250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.953268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.960885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.960930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.960955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.967943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.967975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.967992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.975790] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.975822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.975840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.983944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.983976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.983993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.991713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.991745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.991781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:02.997567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:02.997614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:02.997631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.004047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.004079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.004096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.010469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.010505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.010523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.017208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.017239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.017256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.024247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.024290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.024308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.031070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.031101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.031119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.037525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.037557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.037574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.043700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.043732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.043750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.527 [2024-11-26 01:20:03.050399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.527 [2024-11-26 01:20:03.050431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.527 [2024-11-26 01:20:03.050448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.057176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.057209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.057227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.063959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.063990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.064008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.070718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.070750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.070767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.077723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.077754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.077771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.084449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.084480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.084497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.091106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.091153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.091170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.097910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.097941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.097958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.104757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.104790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.104808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.111548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.111579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.111596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.118292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.118324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.118341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.125131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.125178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.125195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.132026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.787 [2024-11-26 01:20:03.132058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.787 [2024-11-26 01:20:03.132075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.787 [2024-11-26 01:20:03.139104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.139136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.139161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.145999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.146030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.146062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.152615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.152646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.152663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.159267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.159297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.159314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.166081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.166112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.166130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.172830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.172860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.172891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.179506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.179537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.179569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.186095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.186125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.186141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.192755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.192786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.192802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.199410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.199459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.199476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.206045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.206089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.206105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.212900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.212930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.212947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.219360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.219390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.219406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.226023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.226053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.226070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.232739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.232770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.232803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.240028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.240075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.240092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.246834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.246866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.246883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.253656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.253694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.253720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.260344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.260374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.260391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.266889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.266928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.266945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.273627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.273657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.273674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.280212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.280243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.280260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.286771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.286802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.286818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.293513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.293544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.293575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.300261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.300292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.300309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.306934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.306966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.306997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:12.788 [2024-11-26 01:20:03.313654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:12.788 [2024-11-26 01:20:03.313715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:12.788 [2024-11-26 01:20:03.313734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.320501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.320534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.320551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.327254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.327286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.327303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.333911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.333942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.333959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.340528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.340558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.340591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.347185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.347215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.347231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.353791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.353822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.353839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.360445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.360475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.360492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.367087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.367118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.367137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.373973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.374018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.374034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.380682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.380720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.380737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.387302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.387334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.387351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.393924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.393955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.393971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.400745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.400776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.400793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.407278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.407309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.407342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.413870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.413899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.413916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.420632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.420662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.420680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.427254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.427285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.427324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.433987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.434018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.434034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.440570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.440601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.440618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.447272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.047 [2024-11-26 01:20:03.447319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.047 [2024-11-26 01:20:03.447337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.047 [2024-11-26 01:20:03.453892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.453923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.453940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.460535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.460580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.460597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.467130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.467161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.467178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.472608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.472639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.472656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.478476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.478505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.478523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.484324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.484361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.484378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.490754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.490784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.490800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.497355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.497386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.497402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.503989] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.504019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.504035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.510745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.510774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.510791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.516481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.516512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.516529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.521925] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.521956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.521973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.526185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.526239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.526257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.531643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.531694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.531714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.538316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.538347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.538379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.545030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.545060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.545076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.551574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.551619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.551637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.558335] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.558365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.558382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.564231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.564261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.564277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.570912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.570943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.570961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:13.048 [2024-11-26 01:20:03.577209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x177bbb0) 00:27:13.048 [2024-11-26 01:20:03.577242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:13.048 [2024-11-26 01:20:03.577260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:13.306 00:27:13.306 Latency(us) 00:27:13.306 [2024-11-26T00:20:03.841Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.306 [2024-11-26T00:20:03.841Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:13.306 nvme0n1 : 2.00 5052.15 631.52 0.00 0.00 3161.68 673.56 8980.86 00:27:13.306 [2024-11-26T00:20:03.841Z] =================================================================================================================== 00:27:13.306 [2024-11-26T00:20:03.841Z] Total : 5052.15 631.52 0.00 0.00 3161.68 673.56 8980.86 00:27:13.306 0 00:27:13.306 01:20:03 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:13.306 01:20:03 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:13.306 01:20:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:13.306 01:20:03 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:13.306 | .driver_specific 00:27:13.306 | .nvme_error 00:27:13.306 | .status_code 00:27:13.306 | .command_transient_transport_error' 00:27:13.566 01:20:03 -- host/digest.sh@71 -- # (( 326 > 0 )) 00:27:13.566 01:20:03 -- host/digest.sh@73 -- # killprocess 1164120 00:27:13.566 01:20:03 -- common/autotest_common.sh@936 -- # '[' -z 1164120 ']' 00:27:13.566 01:20:03 -- common/autotest_common.sh@940 -- # kill -0 1164120 00:27:13.566 01:20:03 -- common/autotest_common.sh@941 -- # uname 00:27:13.566 01:20:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:13.566 01:20:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1164120 00:27:13.566 01:20:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:13.566 01:20:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:13.566 01:20:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1164120' 00:27:13.566 killing process with pid 1164120 00:27:13.566 01:20:03 -- common/autotest_common.sh@955 -- # kill 1164120 00:27:13.566 Received shutdown signal, test time was about 2.000000 seconds 00:27:13.566 00:27:13.566 Latency(us) 00:27:13.566 [2024-11-26T00:20:04.101Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:13.566 [2024-11-26T00:20:04.101Z] =================================================================================================================== 00:27:13.566 [2024-11-26T00:20:04.101Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:13.566 01:20:03 -- common/autotest_common.sh@960 -- # wait 1164120 00:27:13.871 01:20:04 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:13.871 01:20:04 -- host/digest.sh@54 -- # local rw bs qd 00:27:13.871 01:20:04 -- host/digest.sh@56 -- # rw=randwrite 00:27:13.871 01:20:04 -- host/digest.sh@56 -- # bs=4096 00:27:13.871 01:20:04 -- host/digest.sh@56 -- # qd=128 00:27:13.871 01:20:04 -- host/digest.sh@58 -- # bperfpid=1164675 00:27:13.871 01:20:04 -- host/digest.sh@60 -- # waitforlisten 1164675 /var/tmp/bperf.sock 00:27:13.871 01:20:04 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:13.871 01:20:04 -- common/autotest_common.sh@829 -- # '[' -z 1164675 ']' 00:27:13.871 01:20:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:13.871 01:20:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:13.871 01:20:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:13.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:13.871 01:20:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:13.871 01:20:04 -- common/autotest_common.sh@10 -- # set +x 00:27:13.871 [2024-11-26 01:20:04.215198] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:13.871 [2024-11-26 01:20:04.215271] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1164675 ] 00:27:13.871 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.871 [2024-11-26 01:20:04.276500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:13.871 [2024-11-26 01:20:04.386698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.804 01:20:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:14.804 01:20:05 -- common/autotest_common.sh@862 -- # return 0 00:27:14.804 01:20:05 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.804 01:20:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:15.062 01:20:05 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:15.062 01:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:15.062 01:20:05 -- common/autotest_common.sh@10 -- # set +x 00:27:15.062 01:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:15.062 01:20:05 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:15.062 01:20:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:15.630 nvme0n1 00:27:15.630 01:20:05 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:15.630 01:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:15.630 01:20:05 -- common/autotest_common.sh@10 -- # set +x 00:27:15.630 01:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:15.630 01:20:05 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:15.630 01:20:05 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:15.630 Running I/O for 2 seconds... 00:27:15.630 [2024-11-26 01:20:06.000442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eea00 00:27:15.630 [2024-11-26 01:20:06.001893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:8894 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.001931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.013480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ee190 00:27:15.630 [2024-11-26 01:20:06.014822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:1923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.014854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.025761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e49b0 00:27:15.630 [2024-11-26 01:20:06.027557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:10742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.027592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.037510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e4140 00:27:15.630 [2024-11-26 01:20:06.038707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:23850 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.038753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.049522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f2d80 00:27:15.630 [2024-11-26 01:20:06.050085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:19172 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.050120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.062655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e9e10 00:27:15.630 [2024-11-26 01:20:06.063824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:2917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.063854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.074120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:15.630 [2024-11-26 01:20:06.075194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:18064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.075239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.087448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:15.630 [2024-11-26 01:20:06.087974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:24810 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.088020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.100120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fa7d8 00:27:15.630 [2024-11-26 01:20:06.100801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:16827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.100851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.112391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eff18 00:27:15.630 [2024-11-26 01:20:06.113047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7873 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.113081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.124672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190de470 00:27:15.630 [2024-11-26 01:20:06.125310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:1231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.125344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.137173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb480 00:27:15.630 [2024-11-26 01:20:06.137759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:11191 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.137789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.630 [2024-11-26 01:20:06.149418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190de470 00:27:15.630 [2024-11-26 01:20:06.149932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.630 [2024-11-26 01:20:06.149960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:15.891 [2024-11-26 01:20:06.161699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eff18 00:27:15.891 [2024-11-26 01:20:06.162207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:18121 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.891 [2024-11-26 01:20:06.162241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:15.891 [2024-11-26 01:20:06.174071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eaef0 00:27:15.891 [2024-11-26 01:20:06.174501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:21348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.891 [2024-11-26 01:20:06.174535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:15.891 [2024-11-26 01:20:06.186279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:15.892 [2024-11-26 01:20:06.186828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:12443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.186858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.198587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f96f8 00:27:15.892 [2024-11-26 01:20:06.199014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:20355 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.199048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.210897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1f80 00:27:15.892 [2024-11-26 01:20:06.211375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:9186 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.211408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.223173] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fa7d8 00:27:15.892 [2024-11-26 01:20:06.223626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:13741 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.223659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.235423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f96f8 00:27:15.892 [2024-11-26 01:20:06.235953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:7380 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.235983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.247477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f1ca0 00:27:15.892 [2024-11-26 01:20:06.248880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:4278 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.248926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.259972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f35f0 00:27:15.892 [2024-11-26 01:20:06.261105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:24479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.261139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.273274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb480 00:27:15.892 [2024-11-26 01:20:06.273848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:5562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.273876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.285734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e27f0 00:27:15.892 [2024-11-26 01:20:06.286489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:7629 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.286522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.298114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f1430 00:27:15.892 [2024-11-26 01:20:06.298833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:10518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.298877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.310323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb480 00:27:15.892 [2024-11-26 01:20:06.311049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:19138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.311082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.322593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e99d8 00:27:15.892 [2024-11-26 01:20:06.323231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:8779 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.323265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.335113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eee38 00:27:15.892 [2024-11-26 01:20:06.335731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:25376 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.335760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.347349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fa7d8 00:27:15.892 [2024-11-26 01:20:06.347893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:4858 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.347922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.359543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f4298 00:27:15.892 [2024-11-26 01:20:06.360098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:23359 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.360131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.371828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190efae0 00:27:15.892 [2024-11-26 01:20:06.372363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:1230 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.372395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0063 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.384110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ee5c8 00:27:15.892 [2024-11-26 01:20:06.384564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.384597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0062 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.396402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e95a0 00:27:15.892 [2024-11-26 01:20:06.396889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:22124 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.396924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.408624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3060 00:27:15.892 [2024-11-26 01:20:06.409160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:10811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.409193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:15.892 [2024-11-26 01:20:06.420771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eff18 00:27:15.892 [2024-11-26 01:20:06.422303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:19301 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:15.892 [2024-11-26 01:20:06.422338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.433161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190de470 00:27:16.153 [2024-11-26 01:20:06.434578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:18485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.434612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.445353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190de038 00:27:16.153 [2024-11-26 01:20:06.446371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:23331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.446405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.457866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190df118 00:27:16.153 [2024-11-26 01:20:06.459128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:25098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.459162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.470110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e95a0 00:27:16.153 [2024-11-26 01:20:06.471408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:10973 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.471441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.483223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e0630 00:27:16.153 [2024-11-26 01:20:06.483802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:15391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.483831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.496018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190efae0 00:27:16.153 [2024-11-26 01:20:06.497306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:24197 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.497339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.508537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3060 00:27:16.153 [2024-11-26 01:20:06.509819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:12333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.153 [2024-11-26 01:20:06.509854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:16.153 [2024-11-26 01:20:06.520986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.154 [2024-11-26 01:20:06.522287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21687 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.522322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.533440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eb760 00:27:16.154 [2024-11-26 01:20:06.534789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:10417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.534834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.545904] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eb760 00:27:16.154 [2024-11-26 01:20:06.547243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:8619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.547276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.558501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.154 [2024-11-26 01:20:06.559864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:2905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.559893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.571003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3060 00:27:16.154 [2024-11-26 01:20:06.572367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.572400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.583611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190efae0 00:27:16.154 [2024-11-26 01:20:06.584963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:1655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.584992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.596194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ebb98 00:27:16.154 [2024-11-26 01:20:06.597578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:17242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.597611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.608682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1710 00:27:16.154 [2024-11-26 01:20:06.610058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:20849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.610102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.621227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3d08 00:27:16.154 [2024-11-26 01:20:06.622674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:23806 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.622736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.633773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1710 00:27:16.154 [2024-11-26 01:20:06.635172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:6190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.635204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.646326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ebb98 00:27:16.154 [2024-11-26 01:20:06.647843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:15885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.647872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.658830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1710 00:27:16.154 [2024-11-26 01:20:06.660301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.660333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.671423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3d08 00:27:16.154 [2024-11-26 01:20:06.672890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:20441 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.154 [2024-11-26 01:20:06.672932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:16.154 [2024-11-26 01:20:06.683873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1710 00:27:16.413 [2024-11-26 01:20:06.685377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:5311 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.413 [2024-11-26 01:20:06.685412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:16.413 [2024-11-26 01:20:06.696432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ebb98 00:27:16.413 [2024-11-26 01:20:06.697981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:5610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.413 [2024-11-26 01:20:06.698008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:16.413 [2024-11-26 01:20:06.708841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e12d8 00:27:16.413 [2024-11-26 01:20:06.710366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:9699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.413 [2024-11-26 01:20:06.710399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.413 [2024-11-26 01:20:06.719776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.413 [2024-11-26 01:20:06.720737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:8692 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.413 [2024-11-26 01:20:06.720766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:16.413 [2024-11-26 01:20:06.732216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e0a68 00:27:16.413 [2024-11-26 01:20:06.733137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:1352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.733170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.744823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e0630 00:27:16.414 [2024-11-26 01:20:06.745797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:16071 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.745826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.757238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e0630 00:27:16.414 [2024-11-26 01:20:06.758178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:15861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.758212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.769813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e0a68 00:27:16.414 [2024-11-26 01:20:06.770793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:24126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.770823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.782219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.414 [2024-11-26 01:20:06.783177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:23315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.783209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.794764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.795738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:12845 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.795772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.807211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.808199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:12385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.808231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.819773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.820848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:11350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.820890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.832200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.833222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:17820 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.833261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.844609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.845653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:23893 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.845698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.857139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.858185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:3322 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.858217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.869653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.870766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:12941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.870793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.882188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.883287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:24719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.883320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.894792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.895938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:1827 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.895964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.907267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.908381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:25284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.908413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.919869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.920985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:11234 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.921025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.414 [2024-11-26 01:20:06.932458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:16.414 [2024-11-26 01:20:06.933580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:13766 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.414 [2024-11-26 01:20:06.933612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0060 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:06.945939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f1ca0 00:27:16.674 [2024-11-26 01:20:06.947876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:11824 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:06.947906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:06.956791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fd208 00:27:16.674 [2024-11-26 01:20:06.957682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:2547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:06.957737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:06.969458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ecc78 00:27:16.674 [2024-11-26 01:20:06.970295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25091 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:06.970326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:06.981127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e12d8 00:27:16.674 [2024-11-26 01:20:06.981966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:846 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:06.981995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:06.992907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ef270 00:27:16.674 [2024-11-26 01:20:06.993837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:18118 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:06.993868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.005387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1b48 00:27:16.674 [2024-11-26 01:20:07.006182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:23019 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.006212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.017311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1b48 00:27:16.674 [2024-11-26 01:20:07.018235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.018268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.029931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ef270 00:27:16.674 [2024-11-26 01:20:07.030832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:5474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.030861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.042578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e12d8 00:27:16.674 [2024-11-26 01:20:07.043491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:20696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.043524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.055130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ecc78 00:27:16.674 [2024-11-26 01:20:07.056040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:22333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.056086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.067679] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fd208 00:27:16.674 [2024-11-26 01:20:07.068589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:7386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.068620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.079981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fcdd0 00:27:16.674 [2024-11-26 01:20:07.080972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:17517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.081016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.092404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.674 [2024-11-26 01:20:07.093375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:7696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.674 [2024-11-26 01:20:07.093407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:16.674 [2024-11-26 01:20:07.105089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.106087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:19888 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.106120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.117617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.118626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:11360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.118658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.130165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.131203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:7947 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.131234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.142730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.143803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:1991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.143844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.155167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.156235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:8757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.156273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.167746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.168840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:3664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.168866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.180261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.181402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:9224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.181433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.192812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.675 [2024-11-26 01:20:07.193925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:20738 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.675 [2024-11-26 01:20:07.193951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:16.675 [2024-11-26 01:20:07.205322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.934 [2024-11-26 01:20:07.206465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:22768 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.934 [2024-11-26 01:20:07.206498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:16.934 [2024-11-26 01:20:07.217823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.934 [2024-11-26 01:20:07.218948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:4043 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.934 [2024-11-26 01:20:07.218980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:16.934 [2024-11-26 01:20:07.230301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fc998 00:27:16.935 [2024-11-26 01:20:07.231420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:23646 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.231452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.243929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f20d8 00:27:16.935 [2024-11-26 01:20:07.245826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:16504 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.245856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.254793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e9e10 00:27:16.935 [2024-11-26 01:20:07.255643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:12085 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.255674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.267246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e8d30 00:27:16.935 [2024-11-26 01:20:07.268091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:23712 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.268123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0048 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.279750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eb328 00:27:16.935 [2024-11-26 01:20:07.280617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:10553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.280648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.292119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eb328 00:27:16.935 [2024-11-26 01:20:07.293012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:19092 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.293044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:004a p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.304665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e8d30 00:27:16.935 [2024-11-26 01:20:07.305603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:6534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.305633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:004b p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.317067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e9e10 00:27:16.935 [2024-11-26 01:20:07.317956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.318002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.329696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eee38 00:27:16.935 [2024-11-26 01:20:07.330628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:25078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.330659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.342202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ee5c8 00:27:16.935 [2024-11-26 01:20:07.343148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:18282 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.343179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.354787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3060 00:27:16.935 [2024-11-26 01:20:07.355766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:22937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.355808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.367283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eb760 00:27:16.935 [2024-11-26 01:20:07.368280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:21767 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.368311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.379823] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e9e10 00:27:16.935 [2024-11-26 01:20:07.380836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:6688 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.380862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.392329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fd640 00:27:16.935 [2024-11-26 01:20:07.393359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:3266 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.393390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.404947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:16.935 [2024-11-26 01:20:07.405955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:12367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.405996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.417405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:16.935 [2024-11-26 01:20:07.418425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:13223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.418456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.430011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:16.935 [2024-11-26 01:20:07.431030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:16241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.431074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.442485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:16.935 [2024-11-26 01:20:07.443520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:7190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.443552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:16.935 [2024-11-26 01:20:07.454942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:16.935 [2024-11-26 01:20:07.456035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:25534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:16.935 [2024-11-26 01:20:07.456067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.467500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.468575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:22463 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.468607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.480011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.481100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:4054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.481136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.492550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.493635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:15499 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.493666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.505053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.506148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:12584 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.506179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.517537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.518640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:1166 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.518671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.530010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.531133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:19305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.531165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.542468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.543594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:3321 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.543625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:005e p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.554959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fb8b8 00:27:17.196 [2024-11-26 01:20:07.556153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:15104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.556185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:005f p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.568914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f4298 00:27:17.196 [2024-11-26 01:20:07.570193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:12293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.570225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.579324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e38d0 00:27:17.196 [2024-11-26 01:20:07.579962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:13943 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.580004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0035 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.592893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e38d0 00:27:17.196 [2024-11-26 01:20:07.594139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2537 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.594178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0046 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.605479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fbcf0 00:27:17.196 [2024-11-26 01:20:07.606508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:747 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.606538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0056 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.618138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fbcf0 00:27:17.196 [2024-11-26 01:20:07.619349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:18627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.619380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.630599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fbcf0 00:27:17.196 [2024-11-26 01:20:07.631799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:1915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.631827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.643889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e84c0 00:27:17.196 [2024-11-26 01:20:07.644753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:9104 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.644781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.654921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f1868 00:27:17.196 [2024-11-26 01:20:07.655892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.655920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.667300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ea680 00:27:17.196 [2024-11-26 01:20:07.668525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:18454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.668557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.679640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190df988 00:27:17.196 [2024-11-26 01:20:07.680665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:3360 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.680704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.692005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190dece0 00:27:17.196 [2024-11-26 01:20:07.692824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:7127 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.692850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.704538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f20d8 00:27:17.196 [2024-11-26 01:20:07.705361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:16243 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.705392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:17.196 [2024-11-26 01:20:07.716800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e9168 00:27:17.196 [2024-11-26 01:20:07.717627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:4095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.196 [2024-11-26 01:20:07.717659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.728926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ff3c8 00:27:17.457 [2024-11-26 01:20:07.730583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:11330 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.730616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.742918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e0a68 00:27:17.457 [2024-11-26 01:20:07.744186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:1110 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.744218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.755221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ec840 00:27:17.457 [2024-11-26 01:20:07.756512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:15690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.756544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.767716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e6fa8 00:27:17.457 [2024-11-26 01:20:07.768934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:23853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.768962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.779946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e9e10 00:27:17.457 [2024-11-26 01:20:07.781142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:2541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.781175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.792312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ef6a8 00:27:17.457 [2024-11-26 01:20:07.793479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23635 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.793510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.804581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190fbcf0 00:27:17.457 [2024-11-26 01:20:07.805392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:10143 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.805425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.817096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190eb760 00:27:17.457 [2024-11-26 01:20:07.817894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:7423 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.817921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.829303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190de038 00:27:17.457 [2024-11-26 01:20:07.830101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:21851 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.830134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.841626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e6b70 00:27:17.457 [2024-11-26 01:20:07.842325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:8902 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.842358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.853901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e88f8 00:27:17.457 [2024-11-26 01:20:07.854575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:23049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.854607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0078 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.866127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190de038 00:27:17.457 [2024-11-26 01:20:07.866770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.866799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0077 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.878322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f3e60 00:27:17.457 [2024-11-26 01:20:07.878985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25081 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.879032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.890660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e88f8 00:27:17.457 [2024-11-26 01:20:07.891442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:18520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.891474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0075 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.902868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190ecc78 00:27:17.457 [2024-11-26 01:20:07.903723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:3914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.903768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.915167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1f80 00:27:17.457 [2024-11-26 01:20:07.916026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7553 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.916068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.927478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190f20d8 00:27:17.457 [2024-11-26 01:20:07.928422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:2402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.928453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.939841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e3498 00:27:17.457 [2024-11-26 01:20:07.940548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:16735 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.940579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:27:17.457 [2024-11-26 01:20:07.952071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1710 00:27:17.457 [2024-11-26 01:20:07.952784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.457 [2024-11-26 01:20:07.952812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:27:17.458 [2024-11-26 01:20:07.964342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e73e0 00:27:17.458 [2024-11-26 01:20:07.965018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.458 [2024-11-26 01:20:07.965049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:27:17.458 [2024-11-26 01:20:07.976807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e73e0 00:27:17.458 [2024-11-26 01:20:07.977655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:14689 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.458 [2024-11-26 01:20:07.977694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:27:17.716 [2024-11-26 01:20:07.989009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514ad0) with pdu=0x2000190e1710 00:27:17.716 [2024-11-26 01:20:07.989780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:25571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:17.716 [2024-11-26 01:20:07.989822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:27:17.716 00:27:17.716 Latency(us) 00:27:17.716 [2024-11-26T00:20:08.251Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.716 [2024-11-26T00:20:08.251Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:17.716 nvme0n1 : 2.00 20534.65 80.21 0.00 0.00 6227.25 3046.21 15534.46 00:27:17.716 [2024-11-26T00:20:08.251Z] =================================================================================================================== 00:27:17.716 [2024-11-26T00:20:08.251Z] Total : 20534.65 80.21 0.00 0.00 6227.25 3046.21 15534.46 00:27:17.716 0 00:27:17.716 01:20:08 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:17.716 01:20:08 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:17.716 01:20:08 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:17.716 | .driver_specific 00:27:17.716 | .nvme_error 00:27:17.716 | .status_code 00:27:17.716 | .command_transient_transport_error' 00:27:17.716 01:20:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:17.976 01:20:08 -- host/digest.sh@71 -- # (( 161 > 0 )) 00:27:17.976 01:20:08 -- host/digest.sh@73 -- # killprocess 1164675 00:27:17.976 01:20:08 -- common/autotest_common.sh@936 -- # '[' -z 1164675 ']' 00:27:17.976 01:20:08 -- common/autotest_common.sh@940 -- # kill -0 1164675 00:27:17.976 01:20:08 -- common/autotest_common.sh@941 -- # uname 00:27:17.976 01:20:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:17.976 01:20:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1164675 00:27:17.976 01:20:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:17.976 01:20:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:17.976 01:20:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1164675' 00:27:17.976 killing process with pid 1164675 00:27:17.976 01:20:08 -- common/autotest_common.sh@955 -- # kill 1164675 00:27:17.976 Received shutdown signal, test time was about 2.000000 seconds 00:27:17.976 00:27:17.976 Latency(us) 00:27:17.976 [2024-11-26T00:20:08.511Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.976 [2024-11-26T00:20:08.511Z] =================================================================================================================== 00:27:17.976 [2024-11-26T00:20:08.511Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:17.976 01:20:08 -- common/autotest_common.sh@960 -- # wait 1164675 00:27:18.234 01:20:08 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:18.234 01:20:08 -- host/digest.sh@54 -- # local rw bs qd 00:27:18.234 01:20:08 -- host/digest.sh@56 -- # rw=randwrite 00:27:18.234 01:20:08 -- host/digest.sh@56 -- # bs=131072 00:27:18.234 01:20:08 -- host/digest.sh@56 -- # qd=16 00:27:18.235 01:20:08 -- host/digest.sh@58 -- # bperfpid=1165224 00:27:18.235 01:20:08 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:18.235 01:20:08 -- host/digest.sh@60 -- # waitforlisten 1165224 /var/tmp/bperf.sock 00:27:18.235 01:20:08 -- common/autotest_common.sh@829 -- # '[' -z 1165224 ']' 00:27:18.235 01:20:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:18.235 01:20:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:18.235 01:20:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:18.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:18.235 01:20:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:18.235 01:20:08 -- common/autotest_common.sh@10 -- # set +x 00:27:18.235 [2024-11-26 01:20:08.638969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:18.235 [2024-11-26 01:20:08.639040] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1165224 ] 00:27:18.235 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:18.235 Zero copy mechanism will not be used. 00:27:18.235 EAL: No free 2048 kB hugepages reported on node 1 00:27:18.235 [2024-11-26 01:20:08.703490] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:18.493 [2024-11-26 01:20:08.817681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:19.066 01:20:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:19.327 01:20:09 -- common/autotest_common.sh@862 -- # return 0 00:27:19.327 01:20:09 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:19.327 01:20:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:19.327 01:20:09 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:19.327 01:20:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.327 01:20:09 -- common/autotest_common.sh@10 -- # set +x 00:27:19.586 01:20:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.586 01:20:09 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:19.586 01:20:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:19.844 nvme0n1 00:27:19.844 01:20:10 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:19.844 01:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.844 01:20:10 -- common/autotest_common.sh@10 -- # set +x 00:27:19.844 01:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.844 01:20:10 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:19.844 01:20:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:19.844 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:19.844 Zero copy mechanism will not be used. 00:27:19.844 Running I/O for 2 seconds... 00:27:19.844 [2024-11-26 01:20:10.360062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:19.844 [2024-11-26 01:20:10.360417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.844 [2024-11-26 01:20:10.360459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.844 [2024-11-26 01:20:10.366982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:19.844 [2024-11-26 01:20:10.367195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.844 [2024-11-26 01:20:10.367230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.844 [2024-11-26 01:20:10.373267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:19.845 [2024-11-26 01:20:10.373397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.845 [2024-11-26 01:20:10.373431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.379787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.379970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.103 [2024-11-26 01:20:10.380007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.386912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.387147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.103 [2024-11-26 01:20:10.387179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.394680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.394939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.103 [2024-11-26 01:20:10.394968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.402454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.402666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.103 [2024-11-26 01:20:10.402709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.408746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.408995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.103 [2024-11-26 01:20:10.409042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.415071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.415338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.103 [2024-11-26 01:20:10.415370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.103 [2024-11-26 01:20:10.421316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.103 [2024-11-26 01:20:10.421505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.421548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.427478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.427649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.427700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.433445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.433654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.433704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.440388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.440683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.440751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.448112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.448297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.448325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.455682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.455849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.455878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.463829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.464133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.464168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.471189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.471391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.471439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.477900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.478076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.478105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.484854] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.484999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.485027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.491813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.491926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.491954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.498917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.499038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.499089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.505755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.505902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.505930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.513444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.513684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.513721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.521597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.521915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.521945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.529828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.530088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.530115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.537148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.537370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.537398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.545120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.545277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.545304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.553307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.553481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.553508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.560228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.560385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.560427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.566402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.566622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.566650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.572497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.572676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.572711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.578855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.579094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.579122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.584862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.585049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.585077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.590817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.590996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.591024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.596455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.596665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.596702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.603193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.603405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.603432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.610879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.611121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.611148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.618709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.618924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.618953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.626328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.104 [2024-11-26 01:20:10.626550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.104 [2024-11-26 01:20:10.626577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.104 [2024-11-26 01:20:10.634427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.634771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.634800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.642316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.642570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.642602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.650394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.650550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.650601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.658539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.658716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.658743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.666775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.667054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.667081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.674919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.675040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.675067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.683107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.683255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.683282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.691460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.691696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.691725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.699924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.700232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.700260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.707981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.708226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.708252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.716281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.716479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.716522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.724557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.724742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.724771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.732511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.732733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.732761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.740804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.741002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.741028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.748304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.748559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.748586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.756624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.756806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.756834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.764801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.765094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.765122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.772590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.772749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.772791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.780099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.780271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.780298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.788045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.788217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.788243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.796232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.796378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.796404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.804391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.804548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.804574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.812079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.812327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.812355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.818607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.363 [2024-11-26 01:20:10.818809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.363 [2024-11-26 01:20:10.818839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.363 [2024-11-26 01:20:10.825451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.825725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.825768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.831546] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.831823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.831852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.838125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.838331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.838360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.845318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.845509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.845536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.852187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.852417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.852449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.858561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.858827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.858856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.865821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.866010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.866044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.872715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.872850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.872877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.880205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.880464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.880492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.364 [2024-11-26 01:20:10.887732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.364 [2024-11-26 01:20:10.887950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.364 [2024-11-26 01:20:10.887985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.895588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.895810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.895840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.903006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.903154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.903182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.911034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.911250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.911277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.919191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.919358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.919385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.927382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.927527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.927572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.934749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.934924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.934951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.943071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.943439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.943467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.950905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.951070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.951098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.958350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.958572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.958599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.966469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.966633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.966660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.974493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.974703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.974731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.982671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.982860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.982892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.990956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.991243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.991271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:10.999082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:10.999313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:10.999340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:11.007579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:11.007879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:11.007908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:11.014834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:11.015052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:11.015079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:11.022487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:11.022734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.623 [2024-11-26 01:20:11.022760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.623 [2024-11-26 01:20:11.030430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.623 [2024-11-26 01:20:11.030590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.030633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.037867] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.037999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.038026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.045849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.046044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.046073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.053842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.054023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.054051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.061088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.061282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.061309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.069218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.069463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.069490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.077120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.077410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.077438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.084604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.084795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.084825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.092386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.092598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.092624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.100582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.100796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.100824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.107613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.107803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.107832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.113484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.113676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.113713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.119296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.119448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.119476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.125214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.125494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.125522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.130661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.130890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.130918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.136184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.136352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.136379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.141875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.142067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.142095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.147245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.147408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.147434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.624 [2024-11-26 01:20:11.152520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.624 [2024-11-26 01:20:11.152731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.624 [2024-11-26 01:20:11.152759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.157874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.158080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.158108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.163073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.163259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.163293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.168539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.168771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.168799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.174557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.174745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.174773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.179824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.179976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.180018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.184826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.184995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.185022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.189830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.189983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.190011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.194750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.194878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.194905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.199912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.200183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.200209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.205311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.205510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.205537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.211102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.211350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.211377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.217397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.217578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.217606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.223607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.223854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.223881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.230678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.230932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.230959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.238313] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.238515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.238541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.246217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.246362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.246390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.253075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.253212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.253239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.260777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.261046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.261073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.268379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.885 [2024-11-26 01:20:11.268636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.885 [2024-11-26 01:20:11.268664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.885 [2024-11-26 01:20:11.275286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.275540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.275568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.282555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.282716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.282757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.289962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.290162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.290189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.297148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.297309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.297334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.304725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.304947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.304974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.310855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.311039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.311065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.316714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.316919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.316947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.322256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.322510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.322537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.328086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.328365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.328398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.335375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.335576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.335604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.340781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.340948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.340975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.346300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.346463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.346489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.351539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.351715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.351742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.356966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.357179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.357205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.362544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.362749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.362776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.368554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.368794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.368823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.374236] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.374461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.374489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.379738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.379937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.379965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.385222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.385459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.385486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.391018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.391214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.391241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.396497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.396697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.396723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.402226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.402393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.402419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.407757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.407957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.407984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.886 [2024-11-26 01:20:11.413245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:20.886 [2024-11-26 01:20:11.413458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.886 [2024-11-26 01:20:11.413485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.418603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.418857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.418886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.424039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.424184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.424211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.429484] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.429644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.429693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.434929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.435051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.435078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.440388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.440580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.440608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.445729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.445888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.445929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.451239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.451496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.451525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.456621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.456855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.456884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.462105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.462336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.462364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.467712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.467870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.467898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.473400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.473585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.473623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.478925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.479078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.479104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.484573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.484776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.484804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.490151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.490336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.490363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.495895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.496050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.496076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.501626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.501825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.501854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.507217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.507466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.507493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.512811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.512960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.512988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.518426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.518629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.518656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.523950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.524161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.524188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.529607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.529855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.529884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.535129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.535308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.535335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.540990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.541141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.541169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.546487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.546713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.546741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.552366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.552607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.552635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.558073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.558318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.558345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.563850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.564050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.564080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.569379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.569580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.569606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.575069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.575242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.575269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.580592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.580783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.580812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.586439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.586625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.586652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.592182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.592403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.592431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.597813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.598015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.598056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.603432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.603637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.603694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.608865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.609088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.609115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.614467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.614676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.614713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.620226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.620416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.620449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.625836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.626013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.626056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.148 [2024-11-26 01:20:11.631605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.148 [2024-11-26 01:20:11.631797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.148 [2024-11-26 01:20:11.631826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.637413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.637625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.637653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.643108] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.643352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.643380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.648606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.648760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.648788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.654164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.654366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.654408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.659659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.659894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.659922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.665421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.665609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.665636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.671082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.671280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.671307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.149 [2024-11-26 01:20:11.676884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.149 [2024-11-26 01:20:11.677083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.149 [2024-11-26 01:20:11.677111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.682521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.682755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.682784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.688164] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.688376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.688403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.693822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.694011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.694039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.699361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.699516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.699543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.704862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.705049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.705075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.710319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.710530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.710558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.715923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.716108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.716135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.721294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.721518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.721545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.727017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.727231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.727258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.732577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.732846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.732875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.738082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.738281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.738308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.743643] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.743838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.743866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.749266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.749414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.749441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.754974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.755149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.755176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.760481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.760650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.760699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.766160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.766401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.766434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.771772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.772043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.772071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.777577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.777788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.777817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.783075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.783243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.783270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.788642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.788889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.788917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.794214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.794396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.794424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.799605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.799802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.799830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.805141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.805346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.805388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.411 [2024-11-26 01:20:11.810746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.411 [2024-11-26 01:20:11.810926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.411 [2024-11-26 01:20:11.810954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.816384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.816585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.816613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.822115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.822335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.822364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.827416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.827575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.827603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.833098] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.833321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.833349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.838543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.838729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.838757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.844206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.844421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.844449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.849827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.850027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.850055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.855354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.855531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.855559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.860796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.861022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.861049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.866334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.866539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.866566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.872030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.872224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.872252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.877351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.877535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.877562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.882855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.883014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.883043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.888449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.888624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.888651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.894354] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.894530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.894558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.899928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.900065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.900092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.905737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.906001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.906028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.911303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.911516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.911549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.916627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.916826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.916856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.922072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.922290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.922317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.927535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.927716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.927745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.933205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.933379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.933406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.412 [2024-11-26 01:20:11.938506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.412 [2024-11-26 01:20:11.938738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.412 [2024-11-26 01:20:11.938767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.943963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.944161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.944189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.949392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.949606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.949634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.955233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.955439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.955467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.960936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.961084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.961111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.966393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.966614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.966641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.971737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.971932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.971960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.674 [2024-11-26 01:20:11.977389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.674 [2024-11-26 01:20:11.977528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.674 [2024-11-26 01:20:11.977554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:11.982877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:11.983107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:11.983134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:11.988517] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:11.988758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:11.988787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:11.994129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:11.994382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:11.994409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:11.999496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:11.999774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:11.999803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.005192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.005355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.005386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.010750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.010900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.010928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.016152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.016395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.016422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.021434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.021636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.021663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.026915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.027101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.027129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.032344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.032591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.032618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.037993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.038209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.038236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.043551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.043779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.043821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.049309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.049509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.049536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.054837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.055025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.055052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.060374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.060547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.060575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.066123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.066317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.066345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.071445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.071611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.071653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.077827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.078069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.078097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.084695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.084918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.084946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.092101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.092386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.092414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.099885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.100136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.100163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.107359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.107571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.107601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.113873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.114097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.114124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.120464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.120714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.120742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.128130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.128290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.128317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.135432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.135654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.675 [2024-11-26 01:20:12.135705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.675 [2024-11-26 01:20:12.142987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.675 [2024-11-26 01:20:12.143156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.143184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.150727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.151002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.151029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.157812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.157945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.157991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.165266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.165467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.165495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.173076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.173270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.173302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.180920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.181184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.181212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.188863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.189027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.189055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.196891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.197095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.197125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.676 [2024-11-26 01:20:12.204271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.676 [2024-11-26 01:20:12.204489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.676 [2024-11-26 01:20:12.204521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.212185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.212473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.212503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.219873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.220099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.220129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.227463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.227731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.227760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.234218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.234460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.234490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.240278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.240480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.240512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.245935] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.246046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.246075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.252288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.252457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.252485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.259375] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.259663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.259698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.267142] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.267437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.267465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.274190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.274354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.274382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.281793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.281936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.281963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.288741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.288859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.288887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.294497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.294665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.294704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.300148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.300338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.300367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.305810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.306043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.306072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.311367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.311580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.311608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.318802] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.319069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.319097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.324737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.324877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.324905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.331039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.331218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.331247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.336603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.336805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.336833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.344057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.344318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.344346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.935 [2024-11-26 01:20:12.351677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x514fb0) with pdu=0x2000190fef90 00:27:21.935 [2024-11-26 01:20:12.351877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.935 [2024-11-26 01:20:12.351909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.935 00:27:21.935 Latency(us) 00:27:21.935 [2024-11-26T00:20:12.470Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.936 [2024-11-26T00:20:12.471Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:21.936 nvme0n1 : 2.00 4799.68 599.96 0.00 0.00 3324.76 2354.44 12233.39 00:27:21.936 [2024-11-26T00:20:12.471Z] =================================================================================================================== 00:27:21.936 [2024-11-26T00:20:12.471Z] Total : 4799.68 599.96 0.00 0.00 3324.76 2354.44 12233.39 00:27:21.936 0 00:27:21.936 01:20:12 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:21.936 01:20:12 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:21.936 01:20:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:21.936 01:20:12 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:21.936 | .driver_specific 00:27:21.936 | .nvme_error 00:27:21.936 | .status_code 00:27:21.936 | .command_transient_transport_error' 00:27:22.193 01:20:12 -- host/digest.sh@71 -- # (( 310 > 0 )) 00:27:22.193 01:20:12 -- host/digest.sh@73 -- # killprocess 1165224 00:27:22.193 01:20:12 -- common/autotest_common.sh@936 -- # '[' -z 1165224 ']' 00:27:22.193 01:20:12 -- common/autotest_common.sh@940 -- # kill -0 1165224 00:27:22.193 01:20:12 -- common/autotest_common.sh@941 -- # uname 00:27:22.193 01:20:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:22.193 01:20:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1165224 00:27:22.193 01:20:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:22.193 01:20:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:22.193 01:20:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1165224' 00:27:22.193 killing process with pid 1165224 00:27:22.193 01:20:12 -- common/autotest_common.sh@955 -- # kill 1165224 00:27:22.193 Received shutdown signal, test time was about 2.000000 seconds 00:27:22.193 00:27:22.193 Latency(us) 00:27:22.193 [2024-11-26T00:20:12.728Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:22.193 [2024-11-26T00:20:12.728Z] =================================================================================================================== 00:27:22.193 [2024-11-26T00:20:12.728Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:22.193 01:20:12 -- common/autotest_common.sh@960 -- # wait 1165224 00:27:22.451 01:20:12 -- host/digest.sh@115 -- # killprocess 1163542 00:27:22.451 01:20:12 -- common/autotest_common.sh@936 -- # '[' -z 1163542 ']' 00:27:22.451 01:20:12 -- common/autotest_common.sh@940 -- # kill -0 1163542 00:27:22.451 01:20:12 -- common/autotest_common.sh@941 -- # uname 00:27:22.451 01:20:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:22.451 01:20:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1163542 00:27:22.451 01:20:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:22.451 01:20:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:22.451 01:20:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1163542' 00:27:22.451 killing process with pid 1163542 00:27:22.451 01:20:12 -- common/autotest_common.sh@955 -- # kill 1163542 00:27:22.451 01:20:12 -- common/autotest_common.sh@960 -- # wait 1163542 00:27:22.709 00:27:22.709 real 0m18.349s 00:27:22.709 user 0m37.546s 00:27:22.709 sys 0m4.385s 00:27:22.709 01:20:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:22.709 01:20:13 -- common/autotest_common.sh@10 -- # set +x 00:27:22.709 ************************************ 00:27:22.709 END TEST nvmf_digest_error 00:27:22.709 ************************************ 00:27:22.969 01:20:13 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:22.969 01:20:13 -- host/digest.sh@139 -- # nvmftestfini 00:27:22.969 01:20:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:22.969 01:20:13 -- nvmf/common.sh@116 -- # sync 00:27:22.969 01:20:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:22.969 01:20:13 -- nvmf/common.sh@119 -- # set +e 00:27:22.969 01:20:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:22.969 01:20:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:22.969 rmmod nvme_tcp 00:27:22.969 rmmod nvme_fabrics 00:27:22.969 rmmod nvme_keyring 00:27:22.969 01:20:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:22.969 01:20:13 -- nvmf/common.sh@123 -- # set -e 00:27:22.969 01:20:13 -- nvmf/common.sh@124 -- # return 0 00:27:22.969 01:20:13 -- nvmf/common.sh@477 -- # '[' -n 1163542 ']' 00:27:22.969 01:20:13 -- nvmf/common.sh@478 -- # killprocess 1163542 00:27:22.969 01:20:13 -- common/autotest_common.sh@936 -- # '[' -z 1163542 ']' 00:27:22.969 01:20:13 -- common/autotest_common.sh@940 -- # kill -0 1163542 00:27:22.969 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1163542) - No such process 00:27:22.969 01:20:13 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1163542 is not found' 00:27:22.969 Process with pid 1163542 is not found 00:27:22.969 01:20:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:22.969 01:20:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:22.969 01:20:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:22.969 01:20:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:22.969 01:20:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:22.969 01:20:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:22.969 01:20:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:22.969 01:20:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:24.873 01:20:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:24.873 00:27:24.873 real 0m38.392s 00:27:24.873 user 1m9.373s 00:27:24.873 sys 0m10.311s 00:27:24.873 01:20:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:24.873 01:20:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.873 ************************************ 00:27:24.873 END TEST nvmf_digest 00:27:24.873 ************************************ 00:27:24.873 01:20:15 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:24.873 01:20:15 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:24.873 01:20:15 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:24.873 01:20:15 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:24.873 01:20:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:24.873 01:20:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:24.873 01:20:15 -- common/autotest_common.sh@10 -- # set +x 00:27:24.873 ************************************ 00:27:24.873 START TEST nvmf_bdevperf 00:27:24.873 ************************************ 00:27:24.873 01:20:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:25.132 * Looking for test storage... 00:27:25.132 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:25.132 01:20:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:25.132 01:20:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:25.132 01:20:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:25.132 01:20:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:25.132 01:20:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:25.132 01:20:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:25.132 01:20:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:25.132 01:20:15 -- scripts/common.sh@335 -- # IFS=.-: 00:27:25.132 01:20:15 -- scripts/common.sh@335 -- # read -ra ver1 00:27:25.132 01:20:15 -- scripts/common.sh@336 -- # IFS=.-: 00:27:25.132 01:20:15 -- scripts/common.sh@336 -- # read -ra ver2 00:27:25.132 01:20:15 -- scripts/common.sh@337 -- # local 'op=<' 00:27:25.132 01:20:15 -- scripts/common.sh@339 -- # ver1_l=2 00:27:25.132 01:20:15 -- scripts/common.sh@340 -- # ver2_l=1 00:27:25.132 01:20:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:25.132 01:20:15 -- scripts/common.sh@343 -- # case "$op" in 00:27:25.132 01:20:15 -- scripts/common.sh@344 -- # : 1 00:27:25.132 01:20:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:25.132 01:20:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:25.132 01:20:15 -- scripts/common.sh@364 -- # decimal 1 00:27:25.132 01:20:15 -- scripts/common.sh@352 -- # local d=1 00:27:25.132 01:20:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:25.132 01:20:15 -- scripts/common.sh@354 -- # echo 1 00:27:25.132 01:20:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:25.132 01:20:15 -- scripts/common.sh@365 -- # decimal 2 00:27:25.132 01:20:15 -- scripts/common.sh@352 -- # local d=2 00:27:25.132 01:20:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:25.132 01:20:15 -- scripts/common.sh@354 -- # echo 2 00:27:25.132 01:20:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:25.132 01:20:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:25.132 01:20:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:25.132 01:20:15 -- scripts/common.sh@367 -- # return 0 00:27:25.132 01:20:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:25.132 01:20:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:25.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:25.132 --rc genhtml_branch_coverage=1 00:27:25.132 --rc genhtml_function_coverage=1 00:27:25.132 --rc genhtml_legend=1 00:27:25.132 --rc geninfo_all_blocks=1 00:27:25.132 --rc geninfo_unexecuted_blocks=1 00:27:25.132 00:27:25.132 ' 00:27:25.132 01:20:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:25.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:25.132 --rc genhtml_branch_coverage=1 00:27:25.132 --rc genhtml_function_coverage=1 00:27:25.132 --rc genhtml_legend=1 00:27:25.132 --rc geninfo_all_blocks=1 00:27:25.132 --rc geninfo_unexecuted_blocks=1 00:27:25.132 00:27:25.132 ' 00:27:25.132 01:20:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:25.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:25.132 --rc genhtml_branch_coverage=1 00:27:25.132 --rc genhtml_function_coverage=1 00:27:25.132 --rc genhtml_legend=1 00:27:25.132 --rc geninfo_all_blocks=1 00:27:25.132 --rc geninfo_unexecuted_blocks=1 00:27:25.132 00:27:25.132 ' 00:27:25.132 01:20:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:25.132 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:25.132 --rc genhtml_branch_coverage=1 00:27:25.132 --rc genhtml_function_coverage=1 00:27:25.132 --rc genhtml_legend=1 00:27:25.132 --rc geninfo_all_blocks=1 00:27:25.132 --rc geninfo_unexecuted_blocks=1 00:27:25.132 00:27:25.132 ' 00:27:25.132 01:20:15 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:25.132 01:20:15 -- nvmf/common.sh@7 -- # uname -s 00:27:25.132 01:20:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:25.132 01:20:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:25.132 01:20:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:25.132 01:20:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:25.132 01:20:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:25.132 01:20:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:25.132 01:20:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:25.132 01:20:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:25.132 01:20:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:25.132 01:20:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:25.132 01:20:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:25.132 01:20:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:25.132 01:20:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:25.132 01:20:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:25.132 01:20:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:25.132 01:20:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:25.133 01:20:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:25.133 01:20:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:25.133 01:20:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:25.133 01:20:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:25.133 01:20:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:25.133 01:20:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:25.133 01:20:15 -- paths/export.sh@5 -- # export PATH 00:27:25.133 01:20:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:25.133 01:20:15 -- nvmf/common.sh@46 -- # : 0 00:27:25.133 01:20:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:25.133 01:20:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:25.133 01:20:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:25.133 01:20:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:25.133 01:20:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:25.133 01:20:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:25.133 01:20:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:25.133 01:20:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:25.133 01:20:15 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:25.133 01:20:15 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:25.133 01:20:15 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:25.133 01:20:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:25.133 01:20:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:25.133 01:20:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:25.133 01:20:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:25.133 01:20:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:25.133 01:20:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:25.133 01:20:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:25.133 01:20:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:25.133 01:20:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:25.133 01:20:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:25.133 01:20:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:25.133 01:20:15 -- common/autotest_common.sh@10 -- # set +x 00:27:27.036 01:20:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:27.036 01:20:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:27.036 01:20:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:27.036 01:20:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:27.036 01:20:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:27.036 01:20:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:27.036 01:20:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:27.036 01:20:17 -- nvmf/common.sh@294 -- # net_devs=() 00:27:27.036 01:20:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:27.036 01:20:17 -- nvmf/common.sh@295 -- # e810=() 00:27:27.036 01:20:17 -- nvmf/common.sh@295 -- # local -ga e810 00:27:27.036 01:20:17 -- nvmf/common.sh@296 -- # x722=() 00:27:27.036 01:20:17 -- nvmf/common.sh@296 -- # local -ga x722 00:27:27.036 01:20:17 -- nvmf/common.sh@297 -- # mlx=() 00:27:27.036 01:20:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:27.036 01:20:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:27.036 01:20:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:27.037 01:20:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:27.037 01:20:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:27.037 01:20:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:27.037 01:20:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:27.037 01:20:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:27.037 01:20:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:27.037 01:20:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:27.037 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:27.037 01:20:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:27.037 01:20:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:27.037 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:27.037 01:20:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:27.037 01:20:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:27.037 01:20:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:27.037 01:20:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:27.037 01:20:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:27.037 01:20:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:27.037 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:27.037 01:20:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:27.037 01:20:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:27.037 01:20:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:27.037 01:20:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:27.037 01:20:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:27.037 01:20:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:27.037 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:27.037 01:20:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:27.037 01:20:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:27.037 01:20:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:27.037 01:20:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:27.037 01:20:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:27.037 01:20:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:27.037 01:20:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:27.037 01:20:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:27.037 01:20:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:27.037 01:20:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:27.037 01:20:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:27.037 01:20:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:27.037 01:20:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:27.037 01:20:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:27.037 01:20:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:27.037 01:20:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:27.037 01:20:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:27.037 01:20:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:27.297 01:20:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:27.297 01:20:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:27.297 01:20:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:27.297 01:20:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:27.297 01:20:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:27.297 01:20:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:27.297 01:20:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:27.297 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:27.297 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.236 ms 00:27:27.297 00:27:27.297 --- 10.0.0.2 ping statistics --- 00:27:27.297 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:27.297 rtt min/avg/max/mdev = 0.236/0.236/0.236/0.000 ms 00:27:27.297 01:20:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:27.297 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:27.297 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:27:27.297 00:27:27.297 --- 10.0.0.1 ping statistics --- 00:27:27.297 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:27.297 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:27:27.297 01:20:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:27.297 01:20:17 -- nvmf/common.sh@410 -- # return 0 00:27:27.297 01:20:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:27.297 01:20:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:27.297 01:20:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:27.297 01:20:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:27.297 01:20:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:27.297 01:20:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:27.297 01:20:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:27.297 01:20:17 -- host/bdevperf.sh@25 -- # tgt_init 00:27:27.297 01:20:17 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:27.297 01:20:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:27.297 01:20:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:27.297 01:20:17 -- common/autotest_common.sh@10 -- # set +x 00:27:27.297 01:20:17 -- nvmf/common.sh@469 -- # nvmfpid=1167739 00:27:27.297 01:20:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:27.297 01:20:17 -- nvmf/common.sh@470 -- # waitforlisten 1167739 00:27:27.297 01:20:17 -- common/autotest_common.sh@829 -- # '[' -z 1167739 ']' 00:27:27.297 01:20:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:27.298 01:20:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:27.298 01:20:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:27.298 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:27.298 01:20:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:27.298 01:20:17 -- common/autotest_common.sh@10 -- # set +x 00:27:27.298 [2024-11-26 01:20:17.747510] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:27.298 [2024-11-26 01:20:17.747606] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:27.298 EAL: No free 2048 kB hugepages reported on node 1 00:27:27.298 [2024-11-26 01:20:17.817178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:27.557 [2024-11-26 01:20:17.927630] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:27.557 [2024-11-26 01:20:17.927816] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:27.557 [2024-11-26 01:20:17.927835] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:27.557 [2024-11-26 01:20:17.927847] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:27.557 [2024-11-26 01:20:17.927934] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:27.557 [2024-11-26 01:20:17.927968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:27.557 [2024-11-26 01:20:17.927970] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:28.495 01:20:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:28.495 01:20:18 -- common/autotest_common.sh@862 -- # return 0 00:27:28.495 01:20:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:28.495 01:20:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:28.495 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:27:28.495 01:20:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:28.495 01:20:18 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:28.495 01:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.495 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:27:28.495 [2024-11-26 01:20:18.776005] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:28.495 01:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.495 01:20:18 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:28.495 01:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.495 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:27:28.495 Malloc0 00:27:28.495 01:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.495 01:20:18 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:28.495 01:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.495 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:27:28.495 01:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.495 01:20:18 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:28.495 01:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.495 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:27:28.495 01:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.495 01:20:18 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:28.495 01:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:28.495 01:20:18 -- common/autotest_common.sh@10 -- # set +x 00:27:28.495 [2024-11-26 01:20:18.835382] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:28.495 01:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:28.495 01:20:18 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:28.495 01:20:18 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:28.495 01:20:18 -- nvmf/common.sh@520 -- # config=() 00:27:28.495 01:20:18 -- nvmf/common.sh@520 -- # local subsystem config 00:27:28.495 01:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:28.495 01:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:28.495 { 00:27:28.495 "params": { 00:27:28.495 "name": "Nvme$subsystem", 00:27:28.495 "trtype": "$TEST_TRANSPORT", 00:27:28.495 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:28.495 "adrfam": "ipv4", 00:27:28.495 "trsvcid": "$NVMF_PORT", 00:27:28.495 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:28.495 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:28.495 "hdgst": ${hdgst:-false}, 00:27:28.495 "ddgst": ${ddgst:-false} 00:27:28.495 }, 00:27:28.495 "method": "bdev_nvme_attach_controller" 00:27:28.495 } 00:27:28.495 EOF 00:27:28.495 )") 00:27:28.495 01:20:18 -- nvmf/common.sh@542 -- # cat 00:27:28.495 01:20:18 -- nvmf/common.sh@544 -- # jq . 00:27:28.495 01:20:18 -- nvmf/common.sh@545 -- # IFS=, 00:27:28.495 01:20:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:28.495 "params": { 00:27:28.495 "name": "Nvme1", 00:27:28.495 "trtype": "tcp", 00:27:28.495 "traddr": "10.0.0.2", 00:27:28.495 "adrfam": "ipv4", 00:27:28.495 "trsvcid": "4420", 00:27:28.495 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:28.495 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:28.495 "hdgst": false, 00:27:28.495 "ddgst": false 00:27:28.495 }, 00:27:28.495 "method": "bdev_nvme_attach_controller" 00:27:28.495 }' 00:27:28.495 [2024-11-26 01:20:18.878911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:28.495 [2024-11-26 01:20:18.878992] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1167899 ] 00:27:28.495 EAL: No free 2048 kB hugepages reported on node 1 00:27:28.495 [2024-11-26 01:20:18.937828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:28.755 [2024-11-26 01:20:19.047939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:29.013 Running I/O for 1 seconds... 00:27:29.949 00:27:29.949 Latency(us) 00:27:29.949 [2024-11-26T00:20:20.484Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:29.949 [2024-11-26T00:20:20.484Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:29.949 Verification LBA range: start 0x0 length 0x4000 00:27:29.949 Nvme1n1 : 1.01 12750.58 49.81 0.00 0.00 9994.23 1419.95 17476.27 00:27:29.949 [2024-11-26T00:20:20.484Z] =================================================================================================================== 00:27:29.949 [2024-11-26T00:20:20.484Z] Total : 12750.58 49.81 0.00 0.00 9994.23 1419.95 17476.27 00:27:30.208 01:20:20 -- host/bdevperf.sh@30 -- # bdevperfpid=1168089 00:27:30.208 01:20:20 -- host/bdevperf.sh@32 -- # sleep 3 00:27:30.208 01:20:20 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:30.208 01:20:20 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:30.208 01:20:20 -- nvmf/common.sh@520 -- # config=() 00:27:30.208 01:20:20 -- nvmf/common.sh@520 -- # local subsystem config 00:27:30.208 01:20:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:30.208 01:20:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:30.208 { 00:27:30.208 "params": { 00:27:30.208 "name": "Nvme$subsystem", 00:27:30.208 "trtype": "$TEST_TRANSPORT", 00:27:30.208 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:30.208 "adrfam": "ipv4", 00:27:30.208 "trsvcid": "$NVMF_PORT", 00:27:30.208 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:30.208 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:30.208 "hdgst": ${hdgst:-false}, 00:27:30.208 "ddgst": ${ddgst:-false} 00:27:30.208 }, 00:27:30.208 "method": "bdev_nvme_attach_controller" 00:27:30.208 } 00:27:30.208 EOF 00:27:30.208 )") 00:27:30.208 01:20:20 -- nvmf/common.sh@542 -- # cat 00:27:30.208 01:20:20 -- nvmf/common.sh@544 -- # jq . 00:27:30.208 01:20:20 -- nvmf/common.sh@545 -- # IFS=, 00:27:30.208 01:20:20 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:30.208 "params": { 00:27:30.208 "name": "Nvme1", 00:27:30.208 "trtype": "tcp", 00:27:30.208 "traddr": "10.0.0.2", 00:27:30.208 "adrfam": "ipv4", 00:27:30.208 "trsvcid": "4420", 00:27:30.208 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:30.208 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:30.208 "hdgst": false, 00:27:30.208 "ddgst": false 00:27:30.208 }, 00:27:30.208 "method": "bdev_nvme_attach_controller" 00:27:30.208 }' 00:27:30.208 [2024-11-26 01:20:20.686285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:30.208 [2024-11-26 01:20:20.686361] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1168089 ] 00:27:30.208 EAL: No free 2048 kB hugepages reported on node 1 00:27:30.468 [2024-11-26 01:20:20.749348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:30.468 [2024-11-26 01:20:20.854868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:30.729 Running I/O for 15 seconds... 00:27:33.274 01:20:23 -- host/bdevperf.sh@33 -- # kill -9 1167739 00:27:33.274 01:20:23 -- host/bdevperf.sh@35 -- # sleep 3 00:27:33.274 [2024-11-26 01:20:23.660205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:130088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:130104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:130120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:130144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:130168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:130176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:130192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:130208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:130240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:129552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:129560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:129592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:129600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:129616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:129624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:129632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:129640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:129648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:129688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.660982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:129696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.660996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:129720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:129760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:129768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:129776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:129792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:130264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:130272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:130288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:130304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.274 [2024-11-26 01:20:23.661301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:130312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.274 [2024-11-26 01:20:23.661334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:130320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:130328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.274 [2024-11-26 01:20:23.661405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:130336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.274 [2024-11-26 01:20:23.661437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:130344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:130352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.274 [2024-11-26 01:20:23.661503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:130360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.274 [2024-11-26 01:20:23.661535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.274 [2024-11-26 01:20:23.661551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:130368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:130376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:130384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:130392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.661666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:130400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.661707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:130408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:130416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.661788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:130424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.661818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:130432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.661849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:130440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:130448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:130456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.661936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:130464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.661964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.661997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:130472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:130480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:130488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:130496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:130504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:130512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:130520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:130528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:130536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:130544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:130552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:130560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:130568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:130576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:130584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:130592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:130600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:130608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:130616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:130624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.275 [2024-11-26 01:20:23.662636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:129800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:129808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:129816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:129832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.275 [2024-11-26 01:20:23.662802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:129840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.275 [2024-11-26 01:20:23.662816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.662832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:129848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.662845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.662861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:129856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.662875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.662890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:129864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.662904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.662920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:129896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.662934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.662949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:129920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.662963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.662993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:129952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:129960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:129992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:130032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:130040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:130048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:130632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:130640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:130648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:130656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:130664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:130672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:130680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:130688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:130696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:130704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:130712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:130720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:130728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:130736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:130744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:130752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:130760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:130768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:130776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:130784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:130792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:130800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.663927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:130808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.663956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.663986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:130816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.664000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.664014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:130824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.664028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.664059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:130832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:33.276 [2024-11-26 01:20:23.664075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.664091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:130840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.664106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.664123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:130080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.276 [2024-11-26 01:20:23.664139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.276 [2024-11-26 01:20:23.664161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:130096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:130112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:130128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:130136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:130152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:130160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:130184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:130200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:130216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:130224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:130232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:130248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:130256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:130280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:33.277 [2024-11-26 01:20:23.664601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664616] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c8740 is same with the state(5) to be set 00:27:33.277 [2024-11-26 01:20:23.664634] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:33.277 [2024-11-26 01:20:23.664647] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:33.277 [2024-11-26 01:20:23.664659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:130296 len:8 PRP1 0x0 PRP2 0x0 00:27:33.277 [2024-11-26 01:20:23.664679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:33.277 [2024-11-26 01:20:23.664770] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18c8740 was disconnected and freed. reset controller. 00:27:33.277 [2024-11-26 01:20:23.667137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.277 [2024-11-26 01:20:23.667220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.277 [2024-11-26 01:20:23.667771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.667920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.667946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.277 [2024-11-26 01:20:23.667963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.277 [2024-11-26 01:20:23.668167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.277 [2024-11-26 01:20:23.668296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.277 [2024-11-26 01:20:23.668319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.277 [2024-11-26 01:20:23.668336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.277 [2024-11-26 01:20:23.670846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.277 [2024-11-26 01:20:23.679894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.277 [2024-11-26 01:20:23.680217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.680326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.680355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.277 [2024-11-26 01:20:23.680374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.277 [2024-11-26 01:20:23.680576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.277 [2024-11-26 01:20:23.680796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.277 [2024-11-26 01:20:23.680821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.277 [2024-11-26 01:20:23.680837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.277 [2024-11-26 01:20:23.683052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.277 [2024-11-26 01:20:23.692439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.277 [2024-11-26 01:20:23.692768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.692926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.692954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.277 [2024-11-26 01:20:23.692971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.277 [2024-11-26 01:20:23.693154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.277 [2024-11-26 01:20:23.693333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.277 [2024-11-26 01:20:23.693357] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.277 [2024-11-26 01:20:23.693373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.277 [2024-11-26 01:20:23.695545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.277 [2024-11-26 01:20:23.705177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.277 [2024-11-26 01:20:23.705487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.705643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.705679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.277 [2024-11-26 01:20:23.705722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.277 [2024-11-26 01:20:23.705894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.277 [2024-11-26 01:20:23.706101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.277 [2024-11-26 01:20:23.706125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.277 [2024-11-26 01:20:23.706141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.277 [2024-11-26 01:20:23.708395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.277 [2024-11-26 01:20:23.717598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.277 [2024-11-26 01:20:23.717916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.718034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.718065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.277 [2024-11-26 01:20:23.718084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.277 [2024-11-26 01:20:23.718267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.277 [2024-11-26 01:20:23.718437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.277 [2024-11-26 01:20:23.718461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.277 [2024-11-26 01:20:23.718476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.277 [2024-11-26 01:20:23.720851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.277 [2024-11-26 01:20:23.730142] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.277 [2024-11-26 01:20:23.730481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.277 [2024-11-26 01:20:23.730602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.730633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.278 [2024-11-26 01:20:23.730652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.278 [2024-11-26 01:20:23.730831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.278 [2024-11-26 01:20:23.730984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.278 [2024-11-26 01:20:23.731008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.278 [2024-11-26 01:20:23.731024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.278 [2024-11-26 01:20:23.733403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.278 [2024-11-26 01:20:23.742871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.278 [2024-11-26 01:20:23.743226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.743369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.743399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.278 [2024-11-26 01:20:23.743424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.278 [2024-11-26 01:20:23.743608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.278 [2024-11-26 01:20:23.743791] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.278 [2024-11-26 01:20:23.743816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.278 [2024-11-26 01:20:23.743832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.278 [2024-11-26 01:20:23.746177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.278 [2024-11-26 01:20:23.755568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.278 [2024-11-26 01:20:23.755903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.756081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.756111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.278 [2024-11-26 01:20:23.756130] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.278 [2024-11-26 01:20:23.756296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.278 [2024-11-26 01:20:23.756466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.278 [2024-11-26 01:20:23.756490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.278 [2024-11-26 01:20:23.756506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.278 [2024-11-26 01:20:23.758733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.278 [2024-11-26 01:20:23.768195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.278 [2024-11-26 01:20:23.768533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.768714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.768759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.278 [2024-11-26 01:20:23.768778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.278 [2024-11-26 01:20:23.768944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.278 [2024-11-26 01:20:23.769097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.278 [2024-11-26 01:20:23.769121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.278 [2024-11-26 01:20:23.769136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.278 [2024-11-26 01:20:23.771388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.278 [2024-11-26 01:20:23.780936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.278 [2024-11-26 01:20:23.781304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.781478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.781509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.278 [2024-11-26 01:20:23.781528] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.278 [2024-11-26 01:20:23.781682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.278 [2024-11-26 01:20:23.781887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.278 [2024-11-26 01:20:23.781912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.278 [2024-11-26 01:20:23.781927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.278 [2024-11-26 01:20:23.784164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.278 [2024-11-26 01:20:23.793543] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.278 [2024-11-26 01:20:23.793937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.794096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.278 [2024-11-26 01:20:23.794123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.278 [2024-11-26 01:20:23.794154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.278 [2024-11-26 01:20:23.794311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.278 [2024-11-26 01:20:23.794509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.278 [2024-11-26 01:20:23.794534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.278 [2024-11-26 01:20:23.794549] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.278 [2024-11-26 01:20:23.796869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.806102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.806432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.806598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.806628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.806646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.806806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.806977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.807001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.807017] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.809410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.818563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.818875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.819020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.819050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.819069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.819198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.819373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.819398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.819414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.821763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.831296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.831693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.831837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.831864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.831880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.832040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.832201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.832226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.832242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.834563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.843992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.844364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.844468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.844497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.844516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.844711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.844918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.844943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.844959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.847387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.856641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.856961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.857219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.857264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.857283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.857485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.857701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.857732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.857749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.860124] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.869241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.869509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.869652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.869683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.869713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.869934] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.870104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.870129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.870145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.872411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.881876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.882239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.882380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.882410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.882428] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.882648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.882830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.882856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.882871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.885194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.894486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.894844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.894983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.895013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.539 [2024-11-26 01:20:23.895032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.539 [2024-11-26 01:20:23.895197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.539 [2024-11-26 01:20:23.895367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.539 [2024-11-26 01:20:23.895392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.539 [2024-11-26 01:20:23.895414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.539 [2024-11-26 01:20:23.897890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.539 [2024-11-26 01:20:23.906977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.539 [2024-11-26 01:20:23.907266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.907411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.539 [2024-11-26 01:20:23.907441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.907459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.907643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.907841] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.907866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.907882] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.910152] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.919591] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.919926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.920105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.920132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.920149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.920336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.920575] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.920600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.920616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.922933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.932069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.932420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.932530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.932557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.932575] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.932739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.932893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.932917] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.932933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.935335] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.944667] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.945003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.945112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.945142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.945161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.945310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.945480] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.945503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.945519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.947855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.957182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.957478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.957646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.957676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.957708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.957894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.958064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.958088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.958104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.960193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.969891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.970261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.970405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.970432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.970448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.970629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.970829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.970854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.970870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.973213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.982487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.982835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.982966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.982996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.983014] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.983145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.983333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.983358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.983374] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.985611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:23.995086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:23.995425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.995574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:23.995606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:23.995625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:23.995794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:23.995944] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:23.995979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:23.995992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:23.998266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:24.007589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:24.007905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:24.008038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:24.008065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:24.008082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:24.008244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:24.008386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:24.008406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.540 [2024-11-26 01:20:24.008419] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.540 [2024-11-26 01:20:24.010737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.540 [2024-11-26 01:20:24.020372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.540 [2024-11-26 01:20:24.020713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:24.020875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.540 [2024-11-26 01:20:24.020901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.540 [2024-11-26 01:20:24.020918] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.540 [2024-11-26 01:20:24.021128] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.540 [2024-11-26 01:20:24.021280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.540 [2024-11-26 01:20:24.021304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.541 [2024-11-26 01:20:24.021321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.541 [2024-11-26 01:20:24.023767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.541 [2024-11-26 01:20:24.032995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.541 [2024-11-26 01:20:24.033363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.541 [2024-11-26 01:20:24.033504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.541 [2024-11-26 01:20:24.033533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.541 [2024-11-26 01:20:24.033552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.541 [2024-11-26 01:20:24.033776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.541 [2024-11-26 01:20:24.033947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.541 [2024-11-26 01:20:24.033985] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.541 [2024-11-26 01:20:24.034002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.541 [2024-11-26 01:20:24.036343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.541 [2024-11-26 01:20:24.045730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.541 [2024-11-26 01:20:24.046183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.541 [2024-11-26 01:20:24.046335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.541 [2024-11-26 01:20:24.046362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.541 [2024-11-26 01:20:24.046379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.541 [2024-11-26 01:20:24.046579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.541 [2024-11-26 01:20:24.046775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.541 [2024-11-26 01:20:24.046799] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.541 [2024-11-26 01:20:24.046813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.541 [2024-11-26 01:20:24.049235] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.541 [2024-11-26 01:20:24.058328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.541 [2024-11-26 01:20:24.058650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.541 [2024-11-26 01:20:24.058772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.541 [2024-11-26 01:20:24.058805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.541 [2024-11-26 01:20:24.058822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.541 [2024-11-26 01:20:24.058906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.541 [2024-11-26 01:20:24.059104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.541 [2024-11-26 01:20:24.059129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.541 [2024-11-26 01:20:24.059145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.541 [2024-11-26 01:20:24.061479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.801 [2024-11-26 01:20:24.070958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.801 [2024-11-26 01:20:24.071286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.801 [2024-11-26 01:20:24.071423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.801 [2024-11-26 01:20:24.071450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.801 [2024-11-26 01:20:24.071467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.801 [2024-11-26 01:20:24.071580] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.801 [2024-11-26 01:20:24.071760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.801 [2024-11-26 01:20:24.071784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.801 [2024-11-26 01:20:24.071799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.801 [2024-11-26 01:20:24.074133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.801 [2024-11-26 01:20:24.083564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.801 [2024-11-26 01:20:24.083882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.801 [2024-11-26 01:20:24.084040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.084070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.084089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.084254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.084424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.084449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.084465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.086838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.096347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.096678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.096820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.096848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.096870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.097020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.097239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.097259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.097288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.099613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.109055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.109316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.109441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.109471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.109490] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.109638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.109829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.109852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.109866] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.112284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.121618] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.121875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.122032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.122062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.122080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.122265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.122489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.122513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.122530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.124840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.134479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.134780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.134894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.134921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.134937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.135121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.135310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.135334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.135351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.137605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.146996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.147311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.147454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.147483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.147501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.147698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.147887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.147912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.147928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.150287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.159601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.159961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.160126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.160173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.160192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.160339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.160473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.160498] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.160514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.162758] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.171864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.172202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.172354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.172381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.172413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.172598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.172805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.172831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.172848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.175044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.184406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.184754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.184921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.184952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.802 [2024-11-26 01:20:24.184970] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.802 [2024-11-26 01:20:24.185173] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.802 [2024-11-26 01:20:24.185361] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.802 [2024-11-26 01:20:24.185384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.802 [2024-11-26 01:20:24.185400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.802 [2024-11-26 01:20:24.187653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.802 [2024-11-26 01:20:24.196777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.802 [2024-11-26 01:20:24.197148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.197294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.802 [2024-11-26 01:20:24.197323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.197341] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.197471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.197641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.197676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.197703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.200104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.209415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.209803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.209966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.210000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.210036] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.210166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.210355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.210384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.210401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.212788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.222080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.222444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.222631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.222661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.222695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.222866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.223052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.223089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.223105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.225521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.234798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.235117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.235270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.235299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.235318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.235484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.235654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.235694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.235712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.238026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.247285] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.247651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.247840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.247869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.247885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.248074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.248279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.248304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.248325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.250397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.259825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.260217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.260430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.260470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.260489] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.260655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.260831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.260852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.260865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.263277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.272185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.272460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.272631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.272661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.272679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.272805] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.272994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.273018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.273034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.275443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.284636] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.285023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.285188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.285236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.285255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.285439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.285663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.285694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.285713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.288006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.297245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.297643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.297859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.297886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.297903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.298098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.298340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.298363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.803 [2024-11-26 01:20:24.298379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.803 [2024-11-26 01:20:24.300901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.803 [2024-11-26 01:20:24.309880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.803 [2024-11-26 01:20:24.310226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.310397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.803 [2024-11-26 01:20:24.310424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.803 [2024-11-26 01:20:24.310440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.803 [2024-11-26 01:20:24.310612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.803 [2024-11-26 01:20:24.310817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.803 [2024-11-26 01:20:24.310842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.804 [2024-11-26 01:20:24.310858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.804 [2024-11-26 01:20:24.313034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:33.804 [2024-11-26 01:20:24.322583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:33.804 [2024-11-26 01:20:24.322835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.804 [2024-11-26 01:20:24.322972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:33.804 [2024-11-26 01:20:24.323002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:33.804 [2024-11-26 01:20:24.323021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:33.804 [2024-11-26 01:20:24.323222] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:33.804 [2024-11-26 01:20:24.323410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:33.804 [2024-11-26 01:20:24.323434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:33.804 [2024-11-26 01:20:24.323450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:33.804 [2024-11-26 01:20:24.325695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.335140] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.335491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.335633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.335663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.335699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.335922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.336092] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.336116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.336131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.338410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.347747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.348119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.348312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.348356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.348375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.348523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.348759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.348783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.348799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.350977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.360306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.360623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.360757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.360788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.360806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.360973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.361142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.361166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.361182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.363649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.372918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.373197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.373427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.373474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.373493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.373641] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.373822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.373847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.373863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.376041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.385676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.386016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.386184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.386236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.386254] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.386456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.386608] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.386631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.386647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.388978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.398317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.398624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.398765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.398796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.398815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.398981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.399187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.399211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.399227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.401458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.411097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.411504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.411711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.411746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.411766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.411932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.412084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.412108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.412124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.414357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.423645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.423983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.424176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.424241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.424260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.424390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.067 [2024-11-26 01:20:24.424524] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.067 [2024-11-26 01:20:24.424559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.067 [2024-11-26 01:20:24.424575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.067 [2024-11-26 01:20:24.426923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.067 [2024-11-26 01:20:24.436320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.067 [2024-11-26 01:20:24.436618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.436781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.067 [2024-11-26 01:20:24.436811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.067 [2024-11-26 01:20:24.436839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.067 [2024-11-26 01:20:24.437041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.437229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.437254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.437269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.439642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.449055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.449375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.449545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.449575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.449599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.449796] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.449931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.449955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.449981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.452285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.461637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.461972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.462168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.462219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.462237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.462421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.462609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.462633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.462649] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.464835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.474210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.474548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.474714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.474752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.474771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.474919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.475072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.475097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.475113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.477473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.486876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.487238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.487382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.487414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.487434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.487625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.487809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.487834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.487850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.490262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.499506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.499840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.499941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.499967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.499983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.500147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.500324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.500350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.500366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.502657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.511982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.512319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.512461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.512490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.512508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.512656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.512836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.512861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.512876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.515183] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.524800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.525134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.525280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.525309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.525327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.525475] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.525633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.525657] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.525673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.528047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.537389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.537730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.537885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.537911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.537928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.538087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.538260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.538284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.538300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.068 [2024-11-26 01:20:24.540724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.068 [2024-11-26 01:20:24.550050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.068 [2024-11-26 01:20:24.550358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.550525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.068 [2024-11-26 01:20:24.550555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.068 [2024-11-26 01:20:24.550574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.068 [2024-11-26 01:20:24.550773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.068 [2024-11-26 01:20:24.550889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.068 [2024-11-26 01:20:24.550912] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.068 [2024-11-26 01:20:24.550928] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.069 [2024-11-26 01:20:24.553269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.069 [2024-11-26 01:20:24.562601] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.069 [2024-11-26 01:20:24.562944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.069 [2024-11-26 01:20:24.563100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.069 [2024-11-26 01:20:24.563153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.069 [2024-11-26 01:20:24.563172] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.069 [2024-11-26 01:20:24.563320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.069 [2024-11-26 01:20:24.563525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.069 [2024-11-26 01:20:24.563556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.069 [2024-11-26 01:20:24.563573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.069 [2024-11-26 01:20:24.565999] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.069 [2024-11-26 01:20:24.575273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.069 [2024-11-26 01:20:24.575602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.069 [2024-11-26 01:20:24.575749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.069 [2024-11-26 01:20:24.575779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.069 [2024-11-26 01:20:24.575797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.069 [2024-11-26 01:20:24.576017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.069 [2024-11-26 01:20:24.576169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.069 [2024-11-26 01:20:24.576194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.069 [2024-11-26 01:20:24.576211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.069 [2024-11-26 01:20:24.578625] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.069 [2024-11-26 01:20:24.587627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.069 [2024-11-26 01:20:24.587922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.069 [2024-11-26 01:20:24.588064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.069 [2024-11-26 01:20:24.588095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.069 [2024-11-26 01:20:24.588114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.069 [2024-11-26 01:20:24.588280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.069 [2024-11-26 01:20:24.588449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.069 [2024-11-26 01:20:24.588474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.069 [2024-11-26 01:20:24.588491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.069 [2024-11-26 01:20:24.590791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.332 [2024-11-26 01:20:24.599955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.332 [2024-11-26 01:20:24.600240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.600386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.600416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.332 [2024-11-26 01:20:24.600435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.332 [2024-11-26 01:20:24.600620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.332 [2024-11-26 01:20:24.600784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.332 [2024-11-26 01:20:24.600810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.332 [2024-11-26 01:20:24.600836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.332 [2024-11-26 01:20:24.603132] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.332 [2024-11-26 01:20:24.612622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.332 [2024-11-26 01:20:24.612974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.613094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.613124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.332 [2024-11-26 01:20:24.613143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.332 [2024-11-26 01:20:24.613328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.332 [2024-11-26 01:20:24.613497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.332 [2024-11-26 01:20:24.613521] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.332 [2024-11-26 01:20:24.613538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.332 [2024-11-26 01:20:24.616073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.332 [2024-11-26 01:20:24.625281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.332 [2024-11-26 01:20:24.625660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.625809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.625839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.332 [2024-11-26 01:20:24.625857] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.332 [2024-11-26 01:20:24.626041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.332 [2024-11-26 01:20:24.626228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.332 [2024-11-26 01:20:24.626253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.332 [2024-11-26 01:20:24.626269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.332 [2024-11-26 01:20:24.628748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.332 [2024-11-26 01:20:24.637851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.332 [2024-11-26 01:20:24.638158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.638323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.332 [2024-11-26 01:20:24.638353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.332 [2024-11-26 01:20:24.638372] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.332 [2024-11-26 01:20:24.638538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.638741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.638767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.638783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.640985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.650441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.650801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.650932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.650957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.650973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.651136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.651342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.651367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.651383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.653697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.663244] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.663647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.663852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.663881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.663899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.664030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.664180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.664203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.664220] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.666599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.675793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.676098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.676285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.676315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.676334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.676482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.676652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.676677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.676708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.679073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.688455] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.688799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.688972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.689003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.689021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.689153] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.689323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.689348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.689365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.691736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.701008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.701342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.701494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.701519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.701535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.701728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.701869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.701889] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.701902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.704194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.713411] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.713705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.713856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.713887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.713906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.714054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.714260] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.714285] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.714301] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.716764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.725994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.726413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.726572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.726600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.726619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.726742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.726929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.726954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.726969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.729365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.738502] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.738902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.739039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.739080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.739098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.739282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.739433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.739457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.739472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.741810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.333 [2024-11-26 01:20:24.751218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.333 [2024-11-26 01:20:24.751577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.751744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.333 [2024-11-26 01:20:24.751772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.333 [2024-11-26 01:20:24.751789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.333 [2024-11-26 01:20:24.751984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.333 [2024-11-26 01:20:24.752120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.333 [2024-11-26 01:20:24.752145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.333 [2024-11-26 01:20:24.752161] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.333 [2024-11-26 01:20:24.754432] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.763992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.764333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.764468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.764501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.764519] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.764715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.764897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.764922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.764937] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.767107] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.776484] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.776885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.777052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.777081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.777099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.777301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.777452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.777477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.777493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.779866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.788985] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.789348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.789499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.789527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.789560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.789736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.789905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.789930] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.789946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.792200] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.801577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.801946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.802128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.802156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.802180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.802330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.802445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.802468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.802483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.804969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.814329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.814766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.814908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.814938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.814956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.815105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.815275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.815299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.815315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.817705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.826921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.827225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.827400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.827428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.827445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.827698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.827872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.827897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.827913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.830143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.839328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.839651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.839809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.839843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.839861] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.840052] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.840222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.840247] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.840264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.842526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.334 [2024-11-26 01:20:24.851898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.334 [2024-11-26 01:20:24.852229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.852378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.334 [2024-11-26 01:20:24.852404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.334 [2024-11-26 01:20:24.852421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.334 [2024-11-26 01:20:24.852620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.334 [2024-11-26 01:20:24.852816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.334 [2024-11-26 01:20:24.852843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.334 [2024-11-26 01:20:24.852859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.334 [2024-11-26 01:20:24.855256] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.864494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.864858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.864973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.865002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.865019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.865186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.865354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.865377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.598 [2024-11-26 01:20:24.865393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.598 [2024-11-26 01:20:24.867808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.877192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.877524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.877666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.877709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.877730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.877862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.878055] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.878080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.598 [2024-11-26 01:20:24.878096] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.598 [2024-11-26 01:20:24.880440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.889682] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.889992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.890135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.890163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.890182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.890331] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.890499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.890524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.598 [2024-11-26 01:20:24.890540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.598 [2024-11-26 01:20:24.892875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.902243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.902582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.902769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.902796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.902813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.902992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.903144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.903167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.598 [2024-11-26 01:20:24.903182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.598 [2024-11-26 01:20:24.905613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.914599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.914925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.915070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.915101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.915120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.915286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.915473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.915503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.598 [2024-11-26 01:20:24.915520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.598 [2024-11-26 01:20:24.917803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.927152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.927475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.927621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.927654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.927673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.927835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.928006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.928031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.598 [2024-11-26 01:20:24.928048] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.598 [2024-11-26 01:20:24.930325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.598 [2024-11-26 01:20:24.939964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.598 [2024-11-26 01:20:24.940256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.940439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.598 [2024-11-26 01:20:24.940467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.598 [2024-11-26 01:20:24.940501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.598 [2024-11-26 01:20:24.940649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.598 [2024-11-26 01:20:24.940833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.598 [2024-11-26 01:20:24.940859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:24.940875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:24.943182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:24.952415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:24.952738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.952881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.952913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:24.952931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:24.953116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:24.953232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:24.953256] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:24.953278] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:24.955705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:24.965101] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:24.965456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.965601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.965630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:24.965648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:24.965878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:24.966032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:24.966060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:24.966077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:24.968455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:24.977936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:24.978268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.978484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.978538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:24.978557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:24.978701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:24.978872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:24.978895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:24.978911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:24.981346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:24.990457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:24.990751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.990931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:24.990958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:24.990991] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:24.991157] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:24.991362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:24.991386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:24.991403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:24.993815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:25.003205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:25.003528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.003669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.003708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:25.003728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:25.003893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:25.004027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:25.004051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:25.004069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:25.006340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:25.016005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:25.016388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.016517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.016543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:25.016560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:25.016710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:25.016910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:25.016934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:25.016949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:25.019385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:25.028649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:25.028901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.029049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.029078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:25.029097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:25.029263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:25.029468] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:25.029492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:25.029508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:25.031932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:25.041217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:25.041462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.041602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.041634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:25.041652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:25.041819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:25.041986] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:25.042006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:25.042019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:25.044427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:25.053825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:25.054091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.054234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.599 [2024-11-26 01:20:25.054263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.599 [2024-11-26 01:20:25.054280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.599 [2024-11-26 01:20:25.054446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.599 [2024-11-26 01:20:25.054597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.599 [2024-11-26 01:20:25.054620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.599 [2024-11-26 01:20:25.054636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.599 [2024-11-26 01:20:25.057000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.599 [2024-11-26 01:20:25.066466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.599 [2024-11-26 01:20:25.066818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.066960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.066989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.600 [2024-11-26 01:20:25.067007] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.600 [2024-11-26 01:20:25.067155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.600 [2024-11-26 01:20:25.067324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.600 [2024-11-26 01:20:25.067348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.600 [2024-11-26 01:20:25.067363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.600 [2024-11-26 01:20:25.069653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.600 [2024-11-26 01:20:25.078889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.600 [2024-11-26 01:20:25.079188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.079369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.079395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.600 [2024-11-26 01:20:25.079411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.600 [2024-11-26 01:20:25.079607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.600 [2024-11-26 01:20:25.079787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.600 [2024-11-26 01:20:25.079821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.600 [2024-11-26 01:20:25.079836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.600 [2024-11-26 01:20:25.082396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.600 [2024-11-26 01:20:25.091406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.600 [2024-11-26 01:20:25.091771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.091913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.091942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.600 [2024-11-26 01:20:25.091960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.600 [2024-11-26 01:20:25.092161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.600 [2024-11-26 01:20:25.092367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.600 [2024-11-26 01:20:25.092390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.600 [2024-11-26 01:20:25.092405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.600 [2024-11-26 01:20:25.094793] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.600 [2024-11-26 01:20:25.103958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.600 [2024-11-26 01:20:25.104269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.104375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.104404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.600 [2024-11-26 01:20:25.104422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.600 [2024-11-26 01:20:25.104605] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.600 [2024-11-26 01:20:25.104786] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.600 [2024-11-26 01:20:25.104811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.600 [2024-11-26 01:20:25.104826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.600 [2024-11-26 01:20:25.107109] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.600 [2024-11-26 01:20:25.116462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.600 [2024-11-26 01:20:25.116789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.116907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.600 [2024-11-26 01:20:25.116941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.600 [2024-11-26 01:20:25.116960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.600 [2024-11-26 01:20:25.117144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.600 [2024-11-26 01:20:25.117350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.600 [2024-11-26 01:20:25.117373] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.600 [2024-11-26 01:20:25.117388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.600 [2024-11-26 01:20:25.119790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.128895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.129203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.129372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.129401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.129419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.129585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.129785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.129810] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.129825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.132187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.141626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.141957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.142095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.142124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.142142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.142308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.142495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.142529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.142544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.144778] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.154247] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.154533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.154647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.154676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.154710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.154940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.155107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.155132] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.155149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.157616] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.166676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.167045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.167196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.167225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.167242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.167443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.167612] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.167635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.167651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.169934] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.179204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.179613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.179760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.179788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.179804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.179921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.180103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.180127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.180142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.182377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.191968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.192284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.192427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.192458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.192476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.192698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.192904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.192928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.192942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.195271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.204573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.204939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.205174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.205203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.861 [2024-11-26 01:20:25.205221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.861 [2024-11-26 01:20:25.205405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.861 [2024-11-26 01:20:25.205593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.861 [2024-11-26 01:20:25.205616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.861 [2024-11-26 01:20:25.205632] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.861 [2024-11-26 01:20:25.207796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.861 [2024-11-26 01:20:25.217178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.861 [2024-11-26 01:20:25.217543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.861 [2024-11-26 01:20:25.217673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.217708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.217726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.217912] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.218081] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.218104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.218119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.220537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.229895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.230184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.230312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.230341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.230358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.230524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.230681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.230714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.230730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.232803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.242460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.242784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.242954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.242983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.243000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.243111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.243244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.243267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.243283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.245707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.255070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.255387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.255554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.255582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.255600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.255756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.255937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.255957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.255971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.258248] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.267850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.268166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.268342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.268371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.268388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.268553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.268781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.268809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.268824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.271131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.280454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.280788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.280919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.280945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.280961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.281174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.281380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.281403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.281418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.283986] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.292835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.293128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.293271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.293300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.293318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.293483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.293671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.293705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.293722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.296122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.305590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.305951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.306085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.306114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.306131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.306314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.306483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.306506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.306527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.308673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.317988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.318318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.318474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.318500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.318516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.318649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.862 [2024-11-26 01:20:25.318810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.862 [2024-11-26 01:20:25.318832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.862 [2024-11-26 01:20:25.318846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.862 [2024-11-26 01:20:25.320817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.862 [2024-11-26 01:20:25.330292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.862 [2024-11-26 01:20:25.330650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.330792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.862 [2024-11-26 01:20:25.330821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.862 [2024-11-26 01:20:25.330837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.862 [2024-11-26 01:20:25.331032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.863 [2024-11-26 01:20:25.331217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.863 [2024-11-26 01:20:25.331237] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.863 [2024-11-26 01:20:25.331249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.863 [2024-11-26 01:20:25.333501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.863 [2024-11-26 01:20:25.342863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.863 [2024-11-26 01:20:25.343223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.343378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.343405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.863 [2024-11-26 01:20:25.343421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.863 [2024-11-26 01:20:25.343600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.863 [2024-11-26 01:20:25.343797] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.863 [2024-11-26 01:20:25.343831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.863 [2024-11-26 01:20:25.343847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.863 [2024-11-26 01:20:25.346085] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.863 [2024-11-26 01:20:25.355587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.863 [2024-11-26 01:20:25.355924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.356073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.356103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.863 [2024-11-26 01:20:25.356120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.863 [2024-11-26 01:20:25.356267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.863 [2024-11-26 01:20:25.356437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.863 [2024-11-26 01:20:25.356460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.863 [2024-11-26 01:20:25.356475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.863 [2024-11-26 01:20:25.358810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.863 [2024-11-26 01:20:25.368220] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.863 [2024-11-26 01:20:25.368544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.368671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.368711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.863 [2024-11-26 01:20:25.368730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.863 [2024-11-26 01:20:25.368877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.863 [2024-11-26 01:20:25.369065] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.863 [2024-11-26 01:20:25.369089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.863 [2024-11-26 01:20:25.369104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.863 [2024-11-26 01:20:25.371372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:34.863 [2024-11-26 01:20:25.380675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:34.863 [2024-11-26 01:20:25.381027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.381164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:34.863 [2024-11-26 01:20:25.381193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:34.863 [2024-11-26 01:20:25.381211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:34.863 [2024-11-26 01:20:25.381448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:34.863 [2024-11-26 01:20:25.381617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:34.863 [2024-11-26 01:20:25.381640] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:34.863 [2024-11-26 01:20:25.381655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:34.863 [2024-11-26 01:20:25.384071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.123 [2024-11-26 01:20:25.393012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.123 [2024-11-26 01:20:25.393252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.123 [2024-11-26 01:20:25.393430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.123 [2024-11-26 01:20:25.393457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.123 [2024-11-26 01:20:25.393474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.393617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.393817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.393838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.393852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.395940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.405613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.406002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.406138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.406180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.406196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.406358] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.406513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.406536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.406552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.408840] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.418184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.418503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.418671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.418710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.418730] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.418931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.419100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.419123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.419138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.421533] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.430760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.431074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.431214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.431243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.431261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.431408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.431561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.431584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.431599] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.433951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.443406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.443788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.443952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.443991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.444009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.444175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.444328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.444351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.444367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.446736] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.455952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.456354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.456499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.456528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.456546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.456674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.456818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.456842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.456858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.459267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.468490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.468765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.468904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.468938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.468957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.469121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.469272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.469296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.469311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.471480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.481121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.481482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.481603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.481634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.481653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.481839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.482012] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.482036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.482052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.484504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.493929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.494220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.494373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.494399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.494416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.124 [2024-11-26 01:20:25.494598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.124 [2024-11-26 01:20:25.494839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.124 [2024-11-26 01:20:25.494864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.124 [2024-11-26 01:20:25.494879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.124 [2024-11-26 01:20:25.497218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.124 [2024-11-26 01:20:25.506384] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.124 [2024-11-26 01:20:25.506729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.506872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.124 [2024-11-26 01:20:25.506901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.124 [2024-11-26 01:20:25.506925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.507109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.507295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.507319] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.507334] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.509567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.519079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.519347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.519521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.519550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.519568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.519782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.519934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.519957] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.519973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.522134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.531700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.532039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.532215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.532241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.532257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.532447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.532635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.532658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.532673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.534924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.544242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.544607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.544775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.544805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.544823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.545012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.545199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.545222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.545237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.547490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.556584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.556936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.557102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.557131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.557148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.557277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.557464] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.557487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.557502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.559855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.569257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.569601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.569752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.569782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.569800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.569911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.570116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.570139] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.570155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.572404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.582092] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.582407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.582551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.582580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.582597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.582791] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.582950] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.582973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.582989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.585451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.594473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.594783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.594905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.594934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.594951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.595117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.595322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.595345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.595361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.597597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.607049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.607419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.607540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.607566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.607582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.607751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.607957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.607980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.607996] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.125 [2024-11-26 01:20:25.610296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.125 [2024-11-26 01:20:25.619607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.125 [2024-11-26 01:20:25.619963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.620117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.125 [2024-11-26 01:20:25.620146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.125 [2024-11-26 01:20:25.620164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.125 [2024-11-26 01:20:25.620293] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.125 [2024-11-26 01:20:25.620497] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.125 [2024-11-26 01:20:25.620526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.125 [2024-11-26 01:20:25.620543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.126 [2024-11-26 01:20:25.622748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.126 [2024-11-26 01:20:25.632348] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.126 [2024-11-26 01:20:25.632691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.126 [2024-11-26 01:20:25.632866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.126 [2024-11-26 01:20:25.632895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.126 [2024-11-26 01:20:25.632913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.126 [2024-11-26 01:20:25.633096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.126 [2024-11-26 01:20:25.633266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.126 [2024-11-26 01:20:25.633289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.126 [2024-11-26 01:20:25.633304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.126 [2024-11-26 01:20:25.635519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.126 [2024-11-26 01:20:25.644970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.126 [2024-11-26 01:20:25.645323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.126 [2024-11-26 01:20:25.645463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.126 [2024-11-26 01:20:25.645492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.126 [2024-11-26 01:20:25.645510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.126 [2024-11-26 01:20:25.645703] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.126 [2024-11-26 01:20:25.645856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.126 [2024-11-26 01:20:25.645879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.126 [2024-11-26 01:20:25.645894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.126 [2024-11-26 01:20:25.648283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.657761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.658010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.658191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.658217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.658233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.658392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.658613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.658636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.658657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.660941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.670610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.670965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.671137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.671167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.671185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.671368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.671537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.671560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.671576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.673781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.683175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.683567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.683708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.683752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.683771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.683900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.684051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.684075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.684090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.686375] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.695792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.696102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.696246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.696272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.696288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.696446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.696610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.696634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.696648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.698873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.708437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.708715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.708858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.708887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.708905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.709089] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.709257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.709281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.709296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.711508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.721131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.721459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.721635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.721664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.721682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.721828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.722071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.722094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.722109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.724322] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.733715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.734032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.734173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.734202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.734219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.734403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.734572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.734595] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.734610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.736881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.746139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.746434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.746553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.746582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.746599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.746758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.746946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.387 [2024-11-26 01:20:25.746969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.387 [2024-11-26 01:20:25.746984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.387 [2024-11-26 01:20:25.749195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.387 [2024-11-26 01:20:25.758760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.387 [2024-11-26 01:20:25.759093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.759230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.387 [2024-11-26 01:20:25.759259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.387 [2024-11-26 01:20:25.759276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.387 [2024-11-26 01:20:25.759441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.387 [2024-11-26 01:20:25.759573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.759596] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.759611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.762019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.771423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.771775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.771911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.771940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.771957] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.772140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.772310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.772333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.772348] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.774842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.784218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.784537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.784670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.784708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.784727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.784929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.785098] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.785121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.785136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.787403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.796853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.797290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.797319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.797338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.797467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.797654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.797677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.797703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.800057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.809511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.809879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.810018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.810048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.810066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.810178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.810347] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.810370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.810385] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.812719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.821984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.822297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.822416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.822451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.822470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.822654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.822850] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.822871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.822884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.825190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.834615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.834945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.835113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.835139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.835155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.835329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.835547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.835570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.835585] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.837951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.847329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.847649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.847815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.847842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.847858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.848021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.848182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.848206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.848221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.850454] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.859999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.860336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.860475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.860504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.860527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.860723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.860856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.860879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.860894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.863268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.872552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.872868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.873036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.388 [2024-11-26 01:20:25.873064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.388 [2024-11-26 01:20:25.873082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.388 [2024-11-26 01:20:25.873265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.388 [2024-11-26 01:20:25.873398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.388 [2024-11-26 01:20:25.873421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.388 [2024-11-26 01:20:25.873436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.388 [2024-11-26 01:20:25.875731] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.388 [2024-11-26 01:20:25.885222] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.388 [2024-11-26 01:20:25.885493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.389 [2024-11-26 01:20:25.885638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.389 [2024-11-26 01:20:25.885667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.389 [2024-11-26 01:20:25.885693] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.389 [2024-11-26 01:20:25.885882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.389 [2024-11-26 01:20:25.886084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.389 [2024-11-26 01:20:25.886108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.389 [2024-11-26 01:20:25.886123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.389 [2024-11-26 01:20:25.888427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.389 [2024-11-26 01:20:25.897988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.389 [2024-11-26 01:20:25.898347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.389 [2024-11-26 01:20:25.898491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.389 [2024-11-26 01:20:25.898520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.389 [2024-11-26 01:20:25.898538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.389 [2024-11-26 01:20:25.898753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.389 [2024-11-26 01:20:25.898977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.389 [2024-11-26 01:20:25.899000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.389 [2024-11-26 01:20:25.899016] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.389 [2024-11-26 01:20:25.901356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.389 [2024-11-26 01:20:25.910719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.389 [2024-11-26 01:20:25.911058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.389 [2024-11-26 01:20:25.911200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.389 [2024-11-26 01:20:25.911228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.389 [2024-11-26 01:20:25.911245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.389 [2024-11-26 01:20:25.911392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.389 [2024-11-26 01:20:25.911598] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.389 [2024-11-26 01:20:25.911621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.389 [2024-11-26 01:20:25.911636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.389 [2024-11-26 01:20:25.914058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.923294] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.923715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.923831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.923859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.923877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.924060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.924265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.924288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.924304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:25.926661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.936082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.936459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.936604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.936633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.936650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.936802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.936999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.937024] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.937040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:25.939358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.948655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.949025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.949179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.949209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.949228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.949428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.949597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.949620] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.949635] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:25.951971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.961480] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.961797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.961937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.961966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.961984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.962149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.962301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.962325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.962340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:25.964711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.974038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.974354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.974520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.974549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.974567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.974678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.974857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.974886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.974902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:25.977547] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.986460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.986784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.986927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.986956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.986973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.987120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.987290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.987313] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.987328] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:25.989782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:25.999045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:25.999360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.999490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:25.999515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:25.999530] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:25.999643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:25.999851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:25.999871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:25.999884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:26.002421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.650 [2024-11-26 01:20:26.011563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.650 [2024-11-26 01:20:26.011958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:26.012082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.650 [2024-11-26 01:20:26.012110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.650 [2024-11-26 01:20:26.012127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.650 [2024-11-26 01:20:26.012275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.650 [2024-11-26 01:20:26.012482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.650 [2024-11-26 01:20:26.012505] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.650 [2024-11-26 01:20:26.012527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.650 [2024-11-26 01:20:26.014768] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.024165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.024443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.024621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.024650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.024667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.024876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.025050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.025073] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.025088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.027465] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.036856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.037199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.037312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.037341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.037358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.037523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.037675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.037710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.037740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.039989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.049598] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.049980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.050111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.050136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.050152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.050347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.050488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.050507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.050520] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.052970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.062174] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.062599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.062771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.062799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.062815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.062995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.063167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.063186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.063198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.065377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.074775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.075153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.075293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.075318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.075333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.075528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.075705] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.075725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.075753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.078078] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.087311] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.087633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.087767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.087794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.087811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.088036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.088158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.088176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.088188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.090436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.099952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.100287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.100439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.100465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.100481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.100626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.100799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.100821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.100834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.103211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.112627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.112988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.113173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.113199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.113215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.113374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.113541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.113559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.113571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.115742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.125056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.651 [2024-11-26 01:20:26.125481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.125612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.651 [2024-11-26 01:20:26.125638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.651 [2024-11-26 01:20:26.125654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.651 [2024-11-26 01:20:26.125828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.651 [2024-11-26 01:20:26.126007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.651 [2024-11-26 01:20:26.126026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.651 [2024-11-26 01:20:26.126053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.651 [2024-11-26 01:20:26.128106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.651 [2024-11-26 01:20:26.137715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.652 [2024-11-26 01:20:26.138074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.138214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.138240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.652 [2024-11-26 01:20:26.138255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.652 [2024-11-26 01:20:26.138456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.652 [2024-11-26 01:20:26.138591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.652 [2024-11-26 01:20:26.138609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.652 [2024-11-26 01:20:26.138621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.652 [2024-11-26 01:20:26.140931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.652 [2024-11-26 01:20:26.150334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.652 [2024-11-26 01:20:26.150692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.150830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.150856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.652 [2024-11-26 01:20:26.150872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.652 [2024-11-26 01:20:26.150955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.652 [2024-11-26 01:20:26.151105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.652 [2024-11-26 01:20:26.151125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.652 [2024-11-26 01:20:26.151152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.652 [2024-11-26 01:20:26.153349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.652 [2024-11-26 01:20:26.162789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.652 [2024-11-26 01:20:26.163153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.163283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.163308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.652 [2024-11-26 01:20:26.163324] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.652 [2024-11-26 01:20:26.163440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.652 [2024-11-26 01:20:26.163645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.652 [2024-11-26 01:20:26.163663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.652 [2024-11-26 01:20:26.163700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.652 [2024-11-26 01:20:26.165974] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.652 [2024-11-26 01:20:26.175209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.652 [2024-11-26 01:20:26.175545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.175681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.652 [2024-11-26 01:20:26.175719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.652 [2024-11-26 01:20:26.175737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.652 [2024-11-26 01:20:26.175869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.652 [2024-11-26 01:20:26.176051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.652 [2024-11-26 01:20:26.176070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.652 [2024-11-26 01:20:26.176082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.652 [2024-11-26 01:20:26.178512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.913 [2024-11-26 01:20:26.187775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.913 [2024-11-26 01:20:26.188121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.913 [2024-11-26 01:20:26.188252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.913 [2024-11-26 01:20:26.188278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.913 [2024-11-26 01:20:26.188294] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.913 [2024-11-26 01:20:26.188458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.913 [2024-11-26 01:20:26.188617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.913 [2024-11-26 01:20:26.188650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.913 [2024-11-26 01:20:26.188663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.913 [2024-11-26 01:20:26.191058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.913 [2024-11-26 01:20:26.200397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.913 [2024-11-26 01:20:26.200714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.913 [2024-11-26 01:20:26.200822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.913 [2024-11-26 01:20:26.200848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.913 [2024-11-26 01:20:26.200863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.913 [2024-11-26 01:20:26.201011] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.913 [2024-11-26 01:20:26.201182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.913 [2024-11-26 01:20:26.201201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.913 [2024-11-26 01:20:26.201213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.913 [2024-11-26 01:20:26.203407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.913 [2024-11-26 01:20:26.213019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.913 [2024-11-26 01:20:26.213417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.913 [2024-11-26 01:20:26.213606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.213632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.213653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.213766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.213943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.213964] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.213992] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.216507] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.225709] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.226030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.226165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.226192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.226208] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.226401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.226580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.226599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.226611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.228903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.238300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.238656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.238789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.238816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.238832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.238981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.239153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.239173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.239184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.241563] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.250852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.251231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.251414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.251441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.251457] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.251648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.251801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.251822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.251835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.254223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.263395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.263791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.263964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.263990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.264006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.264151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.264321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.264339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.264351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.266721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.276012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.276394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.276550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.276576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.276607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.276812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.276989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.277023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.277036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.279356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.288489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.288794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.288900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.288926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.288942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.289106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.289298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.289317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.289329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.291534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.301163] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.301542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.301671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.301705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.301723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.301823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.302064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.302083] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.302094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.304455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.313691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.314004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.314103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.314129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.914 [2024-11-26 01:20:26.314144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.914 [2024-11-26 01:20:26.314334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.914 [2024-11-26 01:20:26.314543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.914 [2024-11-26 01:20:26.314566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.914 [2024-11-26 01:20:26.314582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.914 [2024-11-26 01:20:26.316826] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.914 [2024-11-26 01:20:26.326259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.914 [2024-11-26 01:20:26.326612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.326755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.914 [2024-11-26 01:20:26.326783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.326799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.326996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.327148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.327172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.327185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.329704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.338813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.339218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.339387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.339413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.339429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.339589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.339772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.339793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.339807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.341960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.351347] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.351667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.351823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.351849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.351865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.351997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.352203] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.352222] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.352234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.354447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.363941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.364304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.364411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.364437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.364453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.364617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.364785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.364805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.364825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.367084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.376274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.376623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.376792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.376819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.376835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.376951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.377126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.377145] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.377157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.379460] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.388967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.389316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.389499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.389525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.389541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.389712] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.389854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.389874] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.389887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.392260] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.401457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.401754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.401888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.401914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.401930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.402156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.402282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.402301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.402313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.404542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.413880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.414245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.414378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.414404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.414420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.414610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.414814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.414837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.414851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.417230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.426374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.426760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.426903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.426929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.426945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.427179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.915 [2024-11-26 01:20:26.427314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.915 [2024-11-26 01:20:26.427333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.915 [2024-11-26 01:20:26.427345] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.915 [2024-11-26 01:20:26.429447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:35.915 [2024-11-26 01:20:26.439072] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:35.915 [2024-11-26 01:20:26.439383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.439607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:35.915 [2024-11-26 01:20:26.439634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:35.915 [2024-11-26 01:20:26.439649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:35.915 [2024-11-26 01:20:26.439810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:35.916 [2024-11-26 01:20:26.439988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:35.916 [2024-11-26 01:20:26.440008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:35.916 [2024-11-26 01:20:26.440021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:35.916 [2024-11-26 01:20:26.442308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.451490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.451817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.451997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.452023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.452039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.452227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.177 [2024-11-26 01:20:26.452377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.177 [2024-11-26 01:20:26.452396] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.177 [2024-11-26 01:20:26.452408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.177 [2024-11-26 01:20:26.454761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.464039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.464466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.464659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.464692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.464710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.464935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.177 [2024-11-26 01:20:26.465151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.177 [2024-11-26 01:20:26.465169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.177 [2024-11-26 01:20:26.465181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.177 [2024-11-26 01:20:26.467490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.476629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.477012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.477171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.477197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.477213] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.477390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.177 [2024-11-26 01:20:26.477573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.177 [2024-11-26 01:20:26.477592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.177 [2024-11-26 01:20:26.477604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.177 [2024-11-26 01:20:26.479979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.489182] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.489616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.489781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.489808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.489824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.490004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.177 [2024-11-26 01:20:26.490201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.177 [2024-11-26 01:20:26.490220] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.177 [2024-11-26 01:20:26.490232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.177 [2024-11-26 01:20:26.492392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.501803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.502198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.502390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.502416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.502432] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.502638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.177 [2024-11-26 01:20:26.502858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.177 [2024-11-26 01:20:26.502878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.177 [2024-11-26 01:20:26.502892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.177 [2024-11-26 01:20:26.504956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.514464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.514786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.514917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.514943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.514959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.515138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.177 [2024-11-26 01:20:26.515360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.177 [2024-11-26 01:20:26.515380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.177 [2024-11-26 01:20:26.515392] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.177 [2024-11-26 01:20:26.517501] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.177 [2024-11-26 01:20:26.527165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.177 [2024-11-26 01:20:26.527573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.527771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.177 [2024-11-26 01:20:26.527798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.177 [2024-11-26 01:20:26.527815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.177 [2024-11-26 01:20:26.527974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.528141] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.528161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.528173] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.530496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.539640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.540115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.540283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.540309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.540325] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.540530] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.540727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.540748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.540760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.543181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.552292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.552677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.552865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.552891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.552907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.553038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.553192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.553211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.553223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.555331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.564893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.565341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.565513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.565541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.565563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.565779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.565934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.565953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.565966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.568105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.577587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.577952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.578115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.578141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.578158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.578303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.578459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.578478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.578489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.580841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.590133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.590481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.590645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.590671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.590695] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.590894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.591062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.591081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.591093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.593380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.602809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.603174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.603314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.603340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.603356] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.603570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.603731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.603757] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.603769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.606225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.178 [2024-11-26 01:20:26.615386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.178 [2024-11-26 01:20:26.615714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.615860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.178 [2024-11-26 01:20:26.615885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.178 [2024-11-26 01:20:26.615900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.178 [2024-11-26 01:20:26.616103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.178 [2024-11-26 01:20:26.616241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.178 [2024-11-26 01:20:26.616259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.178 [2024-11-26 01:20:26.616271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.178 [2024-11-26 01:20:26.618558] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 [2024-11-26 01:20:26.627912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.179 [2024-11-26 01:20:26.628264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.628406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.628432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.179 [2024-11-26 01:20:26.628448] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.179 [2024-11-26 01:20:26.628631] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.179 [2024-11-26 01:20:26.628816] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.179 [2024-11-26 01:20:26.628837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.179 [2024-11-26 01:20:26.628850] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.179 [2024-11-26 01:20:26.631296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 [2024-11-26 01:20:26.640450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.179 [2024-11-26 01:20:26.640857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.640999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.641024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.179 [2024-11-26 01:20:26.641040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.179 [2024-11-26 01:20:26.641226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.179 [2024-11-26 01:20:26.641382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.179 [2024-11-26 01:20:26.641401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.179 [2024-11-26 01:20:26.641413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.179 [2024-11-26 01:20:26.643734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 [2024-11-26 01:20:26.652927] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.179 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1167739 Killed "${NVMF_APP[@]}" "$@" 00:27:36.179 [2024-11-26 01:20:26.653325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 01:20:26 -- host/bdevperf.sh@36 -- # tgt_init 00:27:36.179 [2024-11-26 01:20:26.653517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.653543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.179 [2024-11-26 01:20:26.653559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.179 01:20:26 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:36.179 [2024-11-26 01:20:26.653718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.179 01:20:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:36.179 [2024-11-26 01:20:26.653855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.179 [2024-11-26 01:20:26.653877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.179 01:20:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:36.179 [2024-11-26 01:20:26.653890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.179 01:20:26 -- common/autotest_common.sh@10 -- # set +x 00:27:36.179 [2024-11-26 01:20:26.656149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 01:20:26 -- nvmf/common.sh@469 -- # nvmfpid=1168858 00:27:36.179 01:20:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:36.179 01:20:26 -- nvmf/common.sh@470 -- # waitforlisten 1168858 00:27:36.179 01:20:26 -- common/autotest_common.sh@829 -- # '[' -z 1168858 ']' 00:27:36.179 01:20:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:36.179 01:20:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:36.179 01:20:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:36.179 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:36.179 01:20:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:36.179 01:20:26 -- common/autotest_common.sh@10 -- # set +x 00:27:36.179 [2024-11-26 01:20:26.665176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.179 [2024-11-26 01:20:26.665441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.665624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.665650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.179 [2024-11-26 01:20:26.665666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.179 [2024-11-26 01:20:26.665790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.179 [2024-11-26 01:20:26.665927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.179 [2024-11-26 01:20:26.665953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.179 [2024-11-26 01:20:26.665967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.179 [2024-11-26 01:20:26.668194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 [2024-11-26 01:20:26.677453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.179 [2024-11-26 01:20:26.677803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.677912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.677938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.179 [2024-11-26 01:20:26.677955] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.179 [2024-11-26 01:20:26.678101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.179 [2024-11-26 01:20:26.678272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.179 [2024-11-26 01:20:26.678291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.179 [2024-11-26 01:20:26.678303] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.179 [2024-11-26 01:20:26.680280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 [2024-11-26 01:20:26.689770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.179 [2024-11-26 01:20:26.690160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.690319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.179 [2024-11-26 01:20:26.690345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.179 [2024-11-26 01:20:26.690362] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.179 [2024-11-26 01:20:26.690479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.179 [2024-11-26 01:20:26.690656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.179 [2024-11-26 01:20:26.690701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.179 [2024-11-26 01:20:26.690716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.179 [2024-11-26 01:20:26.693000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.179 [2024-11-26 01:20:26.696999] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:36.179 [2024-11-26 01:20:26.697073] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:36.180 [2024-11-26 01:20:26.702161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.180 [2024-11-26 01:20:26.702524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.180 [2024-11-26 01:20:26.702626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.180 [2024-11-26 01:20:26.702653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.180 [2024-11-26 01:20:26.702669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.180 [2024-11-26 01:20:26.702812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.180 [2024-11-26 01:20:26.703032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.180 [2024-11-26 01:20:26.703052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.180 [2024-11-26 01:20:26.703065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.180 [2024-11-26 01:20:26.705086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.441 [2024-11-26 01:20:26.714405] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.441 [2024-11-26 01:20:26.714751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.441 [2024-11-26 01:20:26.714854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.441 [2024-11-26 01:20:26.714881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.714896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.715026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.715170] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.715189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.715202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.717195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 [2024-11-26 01:20:26.726535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.726901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.727055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.727080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.727096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.727226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.727385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.727405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.727417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.729478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.442 [2024-11-26 01:20:26.738934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.739249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.739351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.739391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.739410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.739595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.739820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.739842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.739855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.742190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 [2024-11-26 01:20:26.751378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.751742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.751877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.751905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.751921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.752099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.752254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.752274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.752287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.754915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 [2024-11-26 01:20:26.763947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.764335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.764509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.764536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.764552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.764760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.764917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.764937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.764950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.767191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 [2024-11-26 01:20:26.768524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:36.442 [2024-11-26 01:20:26.776441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.776799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.776943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.776969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.776988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.777160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.777337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.777366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.777381] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.779578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 [2024-11-26 01:20:26.789111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.789526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.789695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.789723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.789741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.442 [2024-11-26 01:20:26.789894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.442 [2024-11-26 01:20:26.790084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.442 [2024-11-26 01:20:26.790103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.442 [2024-11-26 01:20:26.790118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.442 [2024-11-26 01:20:26.792365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.442 [2024-11-26 01:20:26.801890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.442 [2024-11-26 01:20:26.802213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.802355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.442 [2024-11-26 01:20:26.802381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.442 [2024-11-26 01:20:26.802398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.802546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.802796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.802818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.802832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.805069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.814506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.443 [2024-11-26 01:20:26.814902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.815044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.815071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.443 [2024-11-26 01:20:26.815087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.815205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.815425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.815445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.815469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.817845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.827023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.443 [2024-11-26 01:20:26.827329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.827442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.827468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.443 [2024-11-26 01:20:26.827484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.827617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.827775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.827797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.827811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.830111] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.839426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.443 [2024-11-26 01:20:26.839920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.840085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.840112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.443 [2024-11-26 01:20:26.840131] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.840289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.840436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.840456] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.840472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.842849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.851959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.443 [2024-11-26 01:20:26.852275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.852440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.852467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.443 [2024-11-26 01:20:26.852483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.852617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.852776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.852798] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.852811] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.855189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.864556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.443 [2024-11-26 01:20:26.864956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.865134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.865161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.443 [2024-11-26 01:20:26.865177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.865383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.865586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.865610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.865626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.868150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.877047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.443 [2024-11-26 01:20:26.877400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.877539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.443 [2024-11-26 01:20:26.877566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.443 [2024-11-26 01:20:26.877582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.443 [2024-11-26 01:20:26.877742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.443 [2024-11-26 01:20:26.877909] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.443 [2024-11-26 01:20:26.877929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.443 [2024-11-26 01:20:26.877942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.443 [2024-11-26 01:20:26.880090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.443 [2024-11-26 01:20:26.883851] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:36.443 [2024-11-26 01:20:26.883960] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:36.443 [2024-11-26 01:20:26.883977] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:36.443 [2024-11-26 01:20:26.883989] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:36.443 [2024-11-26 01:20:26.884104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:36.443 [2024-11-26 01:20:26.884153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:36.444 [2024-11-26 01:20:26.884156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:36.444 [2024-11-26 01:20:26.889310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.889626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.889803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.889831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.889858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.890028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.890228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.890250] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.890265] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.892303] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.444 [2024-11-26 01:20:26.901788] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.902294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.902494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.902522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.902542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.902711] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.902849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.902871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.902887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.904947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.444 [2024-11-26 01:20:26.914113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.914554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.914674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.914711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.914732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.914922] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.915138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.915160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.915176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.917356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.444 [2024-11-26 01:20:26.926473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.926895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.927054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.927081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.927100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.927258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.927428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.927450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.927466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.929520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.444 [2024-11-26 01:20:26.938955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.939309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.939480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.939507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.939525] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.939680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.939893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.939915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.939931] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.941923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.444 [2024-11-26 01:20:26.951385] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.951898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.952056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.952085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.952105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.952254] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.952345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.952366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.952382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.954651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.444 [2024-11-26 01:20:26.963890] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.444 [2024-11-26 01:20:26.964312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.964427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.444 [2024-11-26 01:20:26.964453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.444 [2024-11-26 01:20:26.964471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.444 [2024-11-26 01:20:26.964675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.444 [2024-11-26 01:20:26.964870] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.444 [2024-11-26 01:20:26.964892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.444 [2024-11-26 01:20:26.964909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.444 [2024-11-26 01:20:26.967135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:26.976475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:26.976864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:26.976978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:26.977003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:26.977019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:26.977185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.708 [2024-11-26 01:20:26.977334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.708 [2024-11-26 01:20:26.977355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.708 [2024-11-26 01:20:26.977384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.708 [2024-11-26 01:20:26.979559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:26.988739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:26.989065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:26.989226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:26.989252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:26.989268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:26.989465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.708 [2024-11-26 01:20:26.989616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.708 [2024-11-26 01:20:26.989637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.708 [2024-11-26 01:20:26.989650] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.708 [2024-11-26 01:20:26.991657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:27.000809] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:27.001155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.001261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.001288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:27.001305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:27.001471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.708 [2024-11-26 01:20:27.001650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.708 [2024-11-26 01:20:27.001700] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.708 [2024-11-26 01:20:27.001717] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.708 [2024-11-26 01:20:27.003790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:27.013119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:27.013398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.013536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.013562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:27.013579] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:27.013738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.708 [2024-11-26 01:20:27.013892] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.708 [2024-11-26 01:20:27.013913] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.708 [2024-11-26 01:20:27.013927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.708 [2024-11-26 01:20:27.016094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:27.025389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:27.025679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.025799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.025826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:27.025842] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:27.025959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.708 [2024-11-26 01:20:27.026172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.708 [2024-11-26 01:20:27.026193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.708 [2024-11-26 01:20:27.026207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.708 [2024-11-26 01:20:27.028356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:27.037703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:27.037973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.038136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.038163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:27.038179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:27.038344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.708 [2024-11-26 01:20:27.038495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.708 [2024-11-26 01:20:27.038516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.708 [2024-11-26 01:20:27.038535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.708 [2024-11-26 01:20:27.040542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.708 [2024-11-26 01:20:27.050022] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.708 [2024-11-26 01:20:27.050372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.050499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.708 [2024-11-26 01:20:27.050525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.708 [2024-11-26 01:20:27.050541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.708 [2024-11-26 01:20:27.050658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.050819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.050841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.050855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.053079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.062312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.062616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.062746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.062773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.062790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.062939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.063088] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.063108] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.063122] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.065133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.074613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.074963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.075096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.075124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.075140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.075322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.075517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.075537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.075550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.077654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.086925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.087269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.087397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.087423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.087439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.087588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.087796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.087819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.087833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.089911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.099169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.099491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.099645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.099671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.099694] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.099813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.100027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.100049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.100062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.102143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.111605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.111906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.112008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.112036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.112051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.112184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.112333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.112354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.112367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.114404] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.123912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.124280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.124416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.124442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.124458] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.124607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.124752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.124774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.124788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.126929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.136268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.136561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.136670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.136704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.136722] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.136855] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.136991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.137026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.137039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.139003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.148513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.148784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.148913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.148940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.148956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.149072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.149223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.149243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.149256] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.151305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.709 [2024-11-26 01:20:27.160828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.709 [2024-11-26 01:20:27.161153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.161291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.709 [2024-11-26 01:20:27.161318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.709 [2024-11-26 01:20:27.161334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.709 [2024-11-26 01:20:27.161434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.709 [2024-11-26 01:20:27.161617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.709 [2024-11-26 01:20:27.161638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.709 [2024-11-26 01:20:27.161651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.709 [2024-11-26 01:20:27.163659] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.710 [2024-11-26 01:20:27.173121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.710 [2024-11-26 01:20:27.173438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.173551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.173577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.710 [2024-11-26 01:20:27.173593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.710 [2024-11-26 01:20:27.173733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.710 [2024-11-26 01:20:27.173855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.710 [2024-11-26 01:20:27.173876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.710 [2024-11-26 01:20:27.173889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.710 [2024-11-26 01:20:27.176062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.710 [2024-11-26 01:20:27.185438] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.710 [2024-11-26 01:20:27.185699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.185833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.185859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.710 [2024-11-26 01:20:27.185874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.710 [2024-11-26 01:20:27.186056] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.710 [2024-11-26 01:20:27.186205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.710 [2024-11-26 01:20:27.186226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.710 [2024-11-26 01:20:27.186239] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.710 [2024-11-26 01:20:27.188181] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.710 [2024-11-26 01:20:27.197614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.710 [2024-11-26 01:20:27.197928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.198061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.198093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.710 [2024-11-26 01:20:27.198109] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.710 [2024-11-26 01:20:27.198209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.710 [2024-11-26 01:20:27.198313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.710 [2024-11-26 01:20:27.198350] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.710 [2024-11-26 01:20:27.198363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.710 [2024-11-26 01:20:27.200504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.710 [2024-11-26 01:20:27.209925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.710 [2024-11-26 01:20:27.210224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.210334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.210359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.710 [2024-11-26 01:20:27.210375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.710 [2024-11-26 01:20:27.210525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.710 [2024-11-26 01:20:27.210716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.710 [2024-11-26 01:20:27.210739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.710 [2024-11-26 01:20:27.210754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.710 [2024-11-26 01:20:27.213047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.710 [2024-11-26 01:20:27.222167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.710 [2024-11-26 01:20:27.222442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.222566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.222593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.710 [2024-11-26 01:20:27.222609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.710 [2024-11-26 01:20:27.222766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.710 [2024-11-26 01:20:27.222888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.710 [2024-11-26 01:20:27.222908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.710 [2024-11-26 01:20:27.222922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.710 [2024-11-26 01:20:27.225084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.710 [2024-11-26 01:20:27.234313] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.710 [2024-11-26 01:20:27.234586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.234721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.710 [2024-11-26 01:20:27.234748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.710 [2024-11-26 01:20:27.234769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.710 [2024-11-26 01:20:27.234935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.710 [2024-11-26 01:20:27.235105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.710 [2024-11-26 01:20:27.235140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.710 [2024-11-26 01:20:27.235153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.710 [2024-11-26 01:20:27.237150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.246789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.247059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.247191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.247216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.970 [2024-11-26 01:20:27.247232] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.970 [2024-11-26 01:20:27.247348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.970 [2024-11-26 01:20:27.247500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.970 [2024-11-26 01:20:27.247520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.970 [2024-11-26 01:20:27.247534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.970 [2024-11-26 01:20:27.249405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.259141] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.259413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.259532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.259558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.970 [2024-11-26 01:20:27.259574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.970 [2024-11-26 01:20:27.259748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.970 [2024-11-26 01:20:27.259917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.970 [2024-11-26 01:20:27.259938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.970 [2024-11-26 01:20:27.259952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.970 [2024-11-26 01:20:27.261957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.271419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.271721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.271864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.271891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.970 [2024-11-26 01:20:27.271907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.970 [2024-11-26 01:20:27.272061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.970 [2024-11-26 01:20:27.272211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.970 [2024-11-26 01:20:27.272231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.970 [2024-11-26 01:20:27.272244] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.970 [2024-11-26 01:20:27.274396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.283632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.283995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.284126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.284152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.970 [2024-11-26 01:20:27.284168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.970 [2024-11-26 01:20:27.284300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.970 [2024-11-26 01:20:27.284498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.970 [2024-11-26 01:20:27.284518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.970 [2024-11-26 01:20:27.284531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.970 [2024-11-26 01:20:27.286612] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.295916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.296221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.296353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.296379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.970 [2024-11-26 01:20:27.296395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.970 [2024-11-26 01:20:27.296544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.970 [2024-11-26 01:20:27.296754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.970 [2024-11-26 01:20:27.296776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.970 [2024-11-26 01:20:27.296790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.970 [2024-11-26 01:20:27.298831] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.308168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.308415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.308512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.308538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.970 [2024-11-26 01:20:27.308554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.970 [2024-11-26 01:20:27.308727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.970 [2024-11-26 01:20:27.308886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.970 [2024-11-26 01:20:27.308907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.970 [2024-11-26 01:20:27.308920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.970 [2024-11-26 01:20:27.311034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.970 [2024-11-26 01:20:27.320439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.970 [2024-11-26 01:20:27.320791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.970 [2024-11-26 01:20:27.320896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.320922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.320938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.321054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.321236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.321257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.321271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.323310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.332664] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.333016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.333169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.333195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.333211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.333360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.333541] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.333562] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.333575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.335587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.344945] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.345293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.345394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.345420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.345435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.345567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.345807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.345833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.345848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.347792] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.357271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.357582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.357733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.357761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.357777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.357911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.358091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.358112] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.358125] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.360237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.369394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.369692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.369799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.369825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.369841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.370006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.370171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.370192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.370205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.372306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.381600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.381904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.382041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.382068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.382084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.382248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.382382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.382403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.382421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.384568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.393833] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.394166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.394298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.394324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.394339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.394488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.394707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.394729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.394743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.396850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.406302] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.406640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.406792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.406819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.406835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.406968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.407149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.407170] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.407184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.409242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.418344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.418632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.418737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.418763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.418779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.418928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.971 [2024-11-26 01:20:27.419109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.971 [2024-11-26 01:20:27.419130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.971 [2024-11-26 01:20:27.419143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.971 [2024-11-26 01:20:27.421268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.971 [2024-11-26 01:20:27.430786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.971 [2024-11-26 01:20:27.431074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.431203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.971 [2024-11-26 01:20:27.431230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.971 [2024-11-26 01:20:27.431246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.971 [2024-11-26 01:20:27.431395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.972 [2024-11-26 01:20:27.431545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.972 [2024-11-26 01:20:27.431565] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.972 [2024-11-26 01:20:27.431578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.972 [2024-11-26 01:20:27.433574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.972 [2024-11-26 01:20:27.443257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.972 [2024-11-26 01:20:27.443570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.443703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.443730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.972 [2024-11-26 01:20:27.443747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.972 [2024-11-26 01:20:27.443896] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.972 [2024-11-26 01:20:27.444017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.972 [2024-11-26 01:20:27.444052] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.972 [2024-11-26 01:20:27.444065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.972 [2024-11-26 01:20:27.446173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.972 [2024-11-26 01:20:27.455720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.972 [2024-11-26 01:20:27.455989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.456153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.456180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.972 [2024-11-26 01:20:27.456197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.972 [2024-11-26 01:20:27.456362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.972 [2024-11-26 01:20:27.456496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.972 [2024-11-26 01:20:27.456517] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.972 [2024-11-26 01:20:27.456530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.972 [2024-11-26 01:20:27.458564] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.972 [2024-11-26 01:20:27.468296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.972 [2024-11-26 01:20:27.468605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.468740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.468768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.972 [2024-11-26 01:20:27.468785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.972 [2024-11-26 01:20:27.468935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.972 [2024-11-26 01:20:27.469101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.972 [2024-11-26 01:20:27.469122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.972 [2024-11-26 01:20:27.469136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.972 [2024-11-26 01:20:27.471339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.972 [2024-11-26 01:20:27.480728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.972 [2024-11-26 01:20:27.481014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.481130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.481160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.972 [2024-11-26 01:20:27.481177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.972 [2024-11-26 01:20:27.481310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.972 [2024-11-26 01:20:27.481461] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.972 [2024-11-26 01:20:27.481482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.972 [2024-11-26 01:20:27.481496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.972 [2024-11-26 01:20:27.483737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:36.972 [2024-11-26 01:20:27.493010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:36.972 [2024-11-26 01:20:27.493367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.493463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:36.972 [2024-11-26 01:20:27.493490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:36.972 [2024-11-26 01:20:27.493506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:36.972 [2024-11-26 01:20:27.493655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:36.972 [2024-11-26 01:20:27.493833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:36.972 [2024-11-26 01:20:27.493855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:36.972 [2024-11-26 01:20:27.493868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:36.972 [2024-11-26 01:20:27.495906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.232 [2024-11-26 01:20:27.505407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.232 [2024-11-26 01:20:27.505770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.232 [2024-11-26 01:20:27.505879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.232 [2024-11-26 01:20:27.505905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.232 [2024-11-26 01:20:27.505921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.232 [2024-11-26 01:20:27.506071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.232 [2024-11-26 01:20:27.506268] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.506301] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.506314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.508296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.517666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.517981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.518120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.518146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.518162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.518344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.518494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.518514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.518527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.520487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.530064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.530378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.530510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.530537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.530554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.530655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.530800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.530822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.530836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.532940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.542310] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.542578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.542746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.542778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.542795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.542911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.543078] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.543100] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.543113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.545215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.554456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.554798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.554906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.554932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.554947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.555096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.555277] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.555299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.555312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.557333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.566748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.566986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.567117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.567143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.567159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.567291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.567473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.567494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.567508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.569511] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.578992] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.579338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.579475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.579502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.579523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.579656] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.579792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.579814] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.579828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.581931] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.591361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.591614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.591737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.591764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.591780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.591897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.592110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.592131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.592146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.594242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.603515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.603815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.603944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.603970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.603987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.604119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.604254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.604275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.604289] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.606325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.615766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.616068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.616161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.616187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.616203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.616357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.616537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.616558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.616572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.618510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.628048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.628406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.628511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.233 [2024-11-26 01:20:27.628537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.233 [2024-11-26 01:20:27.628553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.233 [2024-11-26 01:20:27.628727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.233 [2024-11-26 01:20:27.628915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.233 [2024-11-26 01:20:27.628938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.233 [2024-11-26 01:20:27.628952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.233 [2024-11-26 01:20:27.631000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.233 [2024-11-26 01:20:27.640336] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.233 [2024-11-26 01:20:27.640652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.640815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.640842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.640858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.640991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.641142] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.641164] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.641178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.643355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.652650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.652965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.653103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.653129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.653145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.653311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.653482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.653503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.653517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.655703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.665006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.665305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.665409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.665436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.665453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.665569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.665714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.665751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.665766] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.667756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.677303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.677592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.677757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.677784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.677800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.677933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.678067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.678088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.678102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.680046] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.689526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.689870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.689983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.690009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.690025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.690190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.690354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.690380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.690395] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.692520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.701649] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.701939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.702061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.702087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.702102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.702267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.702450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.702470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.702483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.704361] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.714054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.714334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.714457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.714483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.714499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.714637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.714817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.714839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.714853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.717019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 01:20:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:37.234 01:20:27 -- common/autotest_common.sh@862 -- # return 0 00:27:37.234 01:20:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:37.234 01:20:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:37.234 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.234 [2024-11-26 01:20:27.726562] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.726867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.726979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.727006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.727022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.727171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.727311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.727332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.727346] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 [2024-11-26 01:20:27.729336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.234 [2024-11-26 01:20:27.738831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.234 [2024-11-26 01:20:27.739195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.739328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.234 [2024-11-26 01:20:27.739354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.234 [2024-11-26 01:20:27.739370] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.234 [2024-11-26 01:20:27.739535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.234 [2024-11-26 01:20:27.739713] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.234 [2024-11-26 01:20:27.739735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.234 [2024-11-26 01:20:27.739749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.234 01:20:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:37.234 01:20:27 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:37.234 01:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:37.234 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.234 [2024-11-26 01:20:27.741749] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.235 [2024-11-26 01:20:27.746089] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:37.235 [2024-11-26 01:20:27.751350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.235 [2024-11-26 01:20:27.751599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.235 01:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:37.235 [2024-11-26 01:20:27.751739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.235 [2024-11-26 01:20:27.751766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.235 [2024-11-26 01:20:27.751782] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.235 01:20:27 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:37.235 [2024-11-26 01:20:27.751931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.235 01:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:37.235 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.235 [2024-11-26 01:20:27.752071] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.235 [2024-11-26 01:20:27.752091] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.235 [2024-11-26 01:20:27.752105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.235 [2024-11-26 01:20:27.754268] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.493 [2024-11-26 01:20:27.763746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.493 [2024-11-26 01:20:27.764039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.764171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.764199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.493 [2024-11-26 01:20:27.764215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.493 [2024-11-26 01:20:27.764332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.493 [2024-11-26 01:20:27.764529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.493 [2024-11-26 01:20:27.764550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.493 [2024-11-26 01:20:27.764564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.493 [2024-11-26 01:20:27.766645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.493 [2024-11-26 01:20:27.776111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.493 [2024-11-26 01:20:27.776534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.776693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.776721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.493 [2024-11-26 01:20:27.776741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.493 [2024-11-26 01:20:27.776898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.493 [2024-11-26 01:20:27.777038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.493 [2024-11-26 01:20:27.777060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.493 [2024-11-26 01:20:27.777076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.493 [2024-11-26 01:20:27.779171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.493 Malloc0 00:27:37.493 01:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:37.493 01:20:27 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:37.493 01:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:37.493 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.493 [2024-11-26 01:20:27.788519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.493 [2024-11-26 01:20:27.788875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.789013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.789039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.493 [2024-11-26 01:20:27.789055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.493 [2024-11-26 01:20:27.789188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.493 [2024-11-26 01:20:27.789355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.493 [2024-11-26 01:20:27.789375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.493 [2024-11-26 01:20:27.789389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.493 01:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:37.493 01:20:27 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:37.493 01:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:37.493 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.493 [2024-11-26 01:20:27.791555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.493 01:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:37.493 01:20:27 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:37.493 01:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:37.493 01:20:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.493 [2024-11-26 01:20:27.800872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.493 [2024-11-26 01:20:27.801165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.801298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:37.493 [2024-11-26 01:20:27.801324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18a9160 with addr=10.0.0.2, port=4420 00:27:37.493 [2024-11-26 01:20:27.801340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18a9160 is same with the state(5) to be set 00:27:37.493 [2024-11-26 01:20:27.801506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18a9160 (9): Bad file descriptor 00:27:37.493 [2024-11-26 01:20:27.801729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:37.493 [2024-11-26 01:20:27.801751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:37.493 [2024-11-26 01:20:27.801765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:37.493 [2024-11-26 01:20:27.802078] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:37.493 [2024-11-26 01:20:27.804002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:37.493 01:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:37.493 01:20:27 -- host/bdevperf.sh@38 -- # wait 1168089 00:27:37.493 [2024-11-26 01:20:27.813109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:37.493 [2024-11-26 01:20:27.847869] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:45.721 00:27:45.721 Latency(us) 00:27:45.721 [2024-11-26T00:20:36.256Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:45.721 [2024-11-26T00:20:36.256Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:45.721 Verification LBA range: start 0x0 length 0x4000 00:27:45.721 Nvme1n1 : 15.01 9208.02 35.97 16030.36 0.00 5056.78 855.61 20194.80 00:27:45.721 [2024-11-26T00:20:36.256Z] =================================================================================================================== 00:27:45.721 [2024-11-26T00:20:36.256Z] Total : 9208.02 35.97 16030.36 0.00 5056.78 855.61 20194.80 00:27:45.980 01:20:36 -- host/bdevperf.sh@39 -- # sync 00:27:45.980 01:20:36 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:45.980 01:20:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.980 01:20:36 -- common/autotest_common.sh@10 -- # set +x 00:27:45.980 01:20:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.980 01:20:36 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:45.980 01:20:36 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:45.980 01:20:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:45.980 01:20:36 -- nvmf/common.sh@116 -- # sync 00:27:45.980 01:20:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:45.980 01:20:36 -- nvmf/common.sh@119 -- # set +e 00:27:45.980 01:20:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:45.980 01:20:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:45.980 rmmod nvme_tcp 00:27:45.980 rmmod nvme_fabrics 00:27:45.980 rmmod nvme_keyring 00:27:45.980 01:20:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:45.980 01:20:36 -- nvmf/common.sh@123 -- # set -e 00:27:45.980 01:20:36 -- nvmf/common.sh@124 -- # return 0 00:27:45.980 01:20:36 -- nvmf/common.sh@477 -- # '[' -n 1168858 ']' 00:27:45.980 01:20:36 -- nvmf/common.sh@478 -- # killprocess 1168858 00:27:45.980 01:20:36 -- common/autotest_common.sh@936 -- # '[' -z 1168858 ']' 00:27:45.980 01:20:36 -- common/autotest_common.sh@940 -- # kill -0 1168858 00:27:45.980 01:20:36 -- common/autotest_common.sh@941 -- # uname 00:27:45.981 01:20:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:45.981 01:20:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1168858 00:27:46.238 01:20:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:46.238 01:20:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:46.238 01:20:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1168858' 00:27:46.238 killing process with pid 1168858 00:27:46.238 01:20:36 -- common/autotest_common.sh@955 -- # kill 1168858 00:27:46.238 01:20:36 -- common/autotest_common.sh@960 -- # wait 1168858 00:27:46.497 01:20:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:46.497 01:20:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:46.497 01:20:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:46.497 01:20:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:46.497 01:20:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:46.497 01:20:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:46.497 01:20:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:46.497 01:20:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:48.403 01:20:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:48.403 00:27:48.403 real 0m23.486s 00:27:48.403 user 1m3.792s 00:27:48.403 sys 0m4.136s 00:27:48.403 01:20:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:48.403 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:27:48.403 ************************************ 00:27:48.403 END TEST nvmf_bdevperf 00:27:48.403 ************************************ 00:27:48.403 01:20:38 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:48.403 01:20:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:48.403 01:20:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:48.403 01:20:38 -- common/autotest_common.sh@10 -- # set +x 00:27:48.403 ************************************ 00:27:48.403 START TEST nvmf_target_disconnect 00:27:48.403 ************************************ 00:27:48.403 01:20:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:48.403 * Looking for test storage... 00:27:48.662 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:48.662 01:20:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:48.662 01:20:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:48.662 01:20:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:48.662 01:20:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:48.662 01:20:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:48.662 01:20:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:48.662 01:20:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:48.662 01:20:39 -- scripts/common.sh@335 -- # IFS=.-: 00:27:48.662 01:20:39 -- scripts/common.sh@335 -- # read -ra ver1 00:27:48.662 01:20:39 -- scripts/common.sh@336 -- # IFS=.-: 00:27:48.662 01:20:39 -- scripts/common.sh@336 -- # read -ra ver2 00:27:48.662 01:20:39 -- scripts/common.sh@337 -- # local 'op=<' 00:27:48.662 01:20:39 -- scripts/common.sh@339 -- # ver1_l=2 00:27:48.662 01:20:39 -- scripts/common.sh@340 -- # ver2_l=1 00:27:48.662 01:20:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:48.662 01:20:39 -- scripts/common.sh@343 -- # case "$op" in 00:27:48.662 01:20:39 -- scripts/common.sh@344 -- # : 1 00:27:48.662 01:20:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:48.662 01:20:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:48.662 01:20:39 -- scripts/common.sh@364 -- # decimal 1 00:27:48.662 01:20:39 -- scripts/common.sh@352 -- # local d=1 00:27:48.662 01:20:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:48.662 01:20:39 -- scripts/common.sh@354 -- # echo 1 00:27:48.662 01:20:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:48.662 01:20:39 -- scripts/common.sh@365 -- # decimal 2 00:27:48.662 01:20:39 -- scripts/common.sh@352 -- # local d=2 00:27:48.662 01:20:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:48.662 01:20:39 -- scripts/common.sh@354 -- # echo 2 00:27:48.662 01:20:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:48.662 01:20:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:48.662 01:20:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:48.662 01:20:39 -- scripts/common.sh@367 -- # return 0 00:27:48.662 01:20:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:48.662 01:20:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:48.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.662 --rc genhtml_branch_coverage=1 00:27:48.662 --rc genhtml_function_coverage=1 00:27:48.662 --rc genhtml_legend=1 00:27:48.662 --rc geninfo_all_blocks=1 00:27:48.662 --rc geninfo_unexecuted_blocks=1 00:27:48.662 00:27:48.662 ' 00:27:48.662 01:20:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:48.662 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.663 --rc genhtml_branch_coverage=1 00:27:48.663 --rc genhtml_function_coverage=1 00:27:48.663 --rc genhtml_legend=1 00:27:48.663 --rc geninfo_all_blocks=1 00:27:48.663 --rc geninfo_unexecuted_blocks=1 00:27:48.663 00:27:48.663 ' 00:27:48.663 01:20:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:48.663 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.663 --rc genhtml_branch_coverage=1 00:27:48.663 --rc genhtml_function_coverage=1 00:27:48.663 --rc genhtml_legend=1 00:27:48.663 --rc geninfo_all_blocks=1 00:27:48.663 --rc geninfo_unexecuted_blocks=1 00:27:48.663 00:27:48.663 ' 00:27:48.663 01:20:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:48.663 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:48.663 --rc genhtml_branch_coverage=1 00:27:48.663 --rc genhtml_function_coverage=1 00:27:48.663 --rc genhtml_legend=1 00:27:48.663 --rc geninfo_all_blocks=1 00:27:48.663 --rc geninfo_unexecuted_blocks=1 00:27:48.663 00:27:48.663 ' 00:27:48.663 01:20:39 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:48.663 01:20:39 -- nvmf/common.sh@7 -- # uname -s 00:27:48.663 01:20:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:48.663 01:20:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:48.663 01:20:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:48.663 01:20:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:48.663 01:20:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:48.663 01:20:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:48.663 01:20:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:48.663 01:20:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:48.663 01:20:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:48.663 01:20:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:48.663 01:20:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.663 01:20:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:48.663 01:20:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:48.663 01:20:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:48.663 01:20:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:48.663 01:20:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:48.663 01:20:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:48.663 01:20:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:48.663 01:20:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:48.663 01:20:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.663 01:20:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.663 01:20:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.663 01:20:39 -- paths/export.sh@5 -- # export PATH 00:27:48.663 01:20:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:48.663 01:20:39 -- nvmf/common.sh@46 -- # : 0 00:27:48.663 01:20:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:48.663 01:20:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:48.663 01:20:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:48.663 01:20:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:48.663 01:20:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:48.663 01:20:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:48.663 01:20:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:48.663 01:20:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:48.663 01:20:39 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:48.663 01:20:39 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:48.663 01:20:39 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:48.663 01:20:39 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:48.663 01:20:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:48.663 01:20:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:48.663 01:20:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:48.663 01:20:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:48.663 01:20:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:48.663 01:20:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:48.663 01:20:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:48.663 01:20:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:48.663 01:20:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:48.663 01:20:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:48.663 01:20:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:48.663 01:20:39 -- common/autotest_common.sh@10 -- # set +x 00:27:50.563 01:20:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:50.563 01:20:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:50.563 01:20:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:50.563 01:20:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:50.563 01:20:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:50.563 01:20:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:50.563 01:20:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:50.563 01:20:40 -- nvmf/common.sh@294 -- # net_devs=() 00:27:50.563 01:20:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:50.563 01:20:40 -- nvmf/common.sh@295 -- # e810=() 00:27:50.563 01:20:40 -- nvmf/common.sh@295 -- # local -ga e810 00:27:50.563 01:20:40 -- nvmf/common.sh@296 -- # x722=() 00:27:50.563 01:20:40 -- nvmf/common.sh@296 -- # local -ga x722 00:27:50.563 01:20:40 -- nvmf/common.sh@297 -- # mlx=() 00:27:50.563 01:20:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:50.563 01:20:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:50.563 01:20:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:50.563 01:20:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:50.563 01:20:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:50.563 01:20:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.563 01:20:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:50.563 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:50.563 01:20:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:50.563 01:20:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:50.563 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:50.563 01:20:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:50.563 01:20:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.563 01:20:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.563 01:20:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.563 01:20:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.563 01:20:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:50.563 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:50.563 01:20:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.563 01:20:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:50.563 01:20:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:50.563 01:20:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:50.563 01:20:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:50.563 01:20:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:50.563 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:50.563 01:20:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:50.563 01:20:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:50.563 01:20:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:50.563 01:20:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:50.563 01:20:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:50.563 01:20:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:50.563 01:20:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:50.563 01:20:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:50.563 01:20:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:50.563 01:20:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:50.563 01:20:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:50.563 01:20:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:50.563 01:20:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:50.563 01:20:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:50.563 01:20:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:50.563 01:20:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:50.563 01:20:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:50.563 01:20:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:50.563 01:20:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:50.564 01:20:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:50.564 01:20:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:50.564 01:20:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:50.822 01:20:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:50.822 01:20:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:50.822 01:20:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:50.822 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:50.822 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.242 ms 00:27:50.822 00:27:50.822 --- 10.0.0.2 ping statistics --- 00:27:50.822 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.822 rtt min/avg/max/mdev = 0.242/0.242/0.242/0.000 ms 00:27:50.822 01:20:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:50.822 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:50.822 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:27:50.822 00:27:50.822 --- 10.0.0.1 ping statistics --- 00:27:50.822 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:50.822 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:27:50.822 01:20:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:50.822 01:20:41 -- nvmf/common.sh@410 -- # return 0 00:27:50.823 01:20:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:50.823 01:20:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:50.823 01:20:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:50.823 01:20:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:50.823 01:20:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:50.823 01:20:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:50.823 01:20:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:50.823 01:20:41 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:50.823 01:20:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:50.823 01:20:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:50.823 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:27:50.823 ************************************ 00:27:50.823 START TEST nvmf_target_disconnect_tc1 00:27:50.823 ************************************ 00:27:50.823 01:20:41 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:50.823 01:20:41 -- host/target_disconnect.sh@32 -- # set +e 00:27:50.823 01:20:41 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:50.823 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.823 [2024-11-26 01:20:41.243794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.823 [2024-11-26 01:20:41.243945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:50.823 [2024-11-26 01:20:41.243992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x975b40 with addr=10.0.0.2, port=4420 00:27:50.823 [2024-11-26 01:20:41.244028] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:50.823 [2024-11-26 01:20:41.244049] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:50.823 [2024-11-26 01:20:41.244063] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:50.823 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:50.823 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:50.823 Initializing NVMe Controllers 00:27:50.823 01:20:41 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:50.823 01:20:41 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:50.823 01:20:41 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:50.823 01:20:41 -- common/autotest_common.sh@1142 -- # return 0 00:27:50.823 01:20:41 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:50.823 01:20:41 -- host/target_disconnect.sh@41 -- # set -e 00:27:50.823 00:27:50.823 real 0m0.091s 00:27:50.823 user 0m0.036s 00:27:50.823 sys 0m0.054s 00:27:50.823 01:20:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:50.823 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:27:50.823 ************************************ 00:27:50.823 END TEST nvmf_target_disconnect_tc1 00:27:50.823 ************************************ 00:27:50.823 01:20:41 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:50.823 01:20:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:50.823 01:20:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:50.823 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:27:50.823 ************************************ 00:27:50.823 START TEST nvmf_target_disconnect_tc2 00:27:50.823 ************************************ 00:27:50.823 01:20:41 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:50.823 01:20:41 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:50.823 01:20:41 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:50.823 01:20:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:50.823 01:20:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:50.823 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:27:50.823 01:20:41 -- nvmf/common.sh@469 -- # nvmfpid=1172058 00:27:50.823 01:20:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:50.823 01:20:41 -- nvmf/common.sh@470 -- # waitforlisten 1172058 00:27:50.823 01:20:41 -- common/autotest_common.sh@829 -- # '[' -z 1172058 ']' 00:27:50.823 01:20:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:50.823 01:20:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:50.823 01:20:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:50.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:50.823 01:20:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:50.823 01:20:41 -- common/autotest_common.sh@10 -- # set +x 00:27:50.823 [2024-11-26 01:20:41.321592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:50.823 [2024-11-26 01:20:41.321698] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:51.081 EAL: No free 2048 kB hugepages reported on node 1 00:27:51.081 [2024-11-26 01:20:41.390693] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:51.081 [2024-11-26 01:20:41.498609] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:51.081 [2024-11-26 01:20:41.498776] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:51.082 [2024-11-26 01:20:41.498795] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:51.082 [2024-11-26 01:20:41.498808] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:51.082 [2024-11-26 01:20:41.499038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:51.082 [2024-11-26 01:20:41.499090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:51.082 [2024-11-26 01:20:41.499157] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:51.082 [2024-11-26 01:20:41.499160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:52.014 01:20:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:52.014 01:20:42 -- common/autotest_common.sh@862 -- # return 0 00:27:52.014 01:20:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:52.014 01:20:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:52.014 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.014 01:20:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:52.014 01:20:42 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:52.014 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.014 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.014 Malloc0 00:27:52.014 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.014 01:20:42 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:52.014 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.014 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.014 [2024-11-26 01:20:42.392754] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:52.014 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.014 01:20:42 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:52.015 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.015 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.015 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.015 01:20:42 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:52.015 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.015 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.015 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.015 01:20:42 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:52.015 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.015 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.015 [2024-11-26 01:20:42.421078] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:52.015 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.015 01:20:42 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:52.015 01:20:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:52.015 01:20:42 -- common/autotest_common.sh@10 -- # set +x 00:27:52.015 01:20:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:52.015 01:20:42 -- host/target_disconnect.sh@50 -- # reconnectpid=1172213 00:27:52.015 01:20:42 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:52.015 01:20:42 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:52.015 EAL: No free 2048 kB hugepages reported on node 1 00:27:53.916 01:20:44 -- host/target_disconnect.sh@53 -- # kill -9 1172058 00:27:53.916 01:20:44 -- host/target_disconnect.sh@55 -- # sleep 2 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Write completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.916 starting I/O failed 00:27:53.916 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 [2024-11-26 01:20:44.446491] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 [2024-11-26 01:20:44.446847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Write completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 [2024-11-26 01:20:44.447158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.917 Read completed with error (sct=0, sc=8) 00:27:53.917 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Write completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 Read completed with error (sct=0, sc=8) 00:27:53.918 starting I/O failed 00:27:53.918 [2024-11-26 01:20:44.447453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:27:54.194 [2024-11-26 01:20:44.447628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.447774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.447804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.194 qpair failed and we were unable to recover it. 00:27:54.194 [2024-11-26 01:20:44.447917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.194 qpair failed and we were unable to recover it. 00:27:54.194 [2024-11-26 01:20:44.448195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.194 qpair failed and we were unable to recover it. 00:27:54.194 [2024-11-26 01:20:44.448434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.194 qpair failed and we were unable to recover it. 00:27:54.194 [2024-11-26 01:20:44.448766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.194 [2024-11-26 01:20:44.448867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.448892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.448992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.449253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.449561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.449848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.449999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.450104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.450257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.450282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.450411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.450509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.450534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.450659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.450760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.450785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.450891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.451177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.451502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.451813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.451926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.452040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.452278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.452545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.452798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.452945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.453050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.453180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.453208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.453354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.453491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.453518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.453666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.453770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.453795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.453896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.454195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.454544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.454825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.454955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.455100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.455216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.455256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.455485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.455610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.455635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.455738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.455865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.455890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.456021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.456151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.456175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.456309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.456445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.456472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.456600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.456722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.195 [2024-11-26 01:20:44.456747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.195 qpair failed and we were unable to recover it. 00:27:54.195 [2024-11-26 01:20:44.456847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.456940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.456964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.457104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.457231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.457256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.457405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.457547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.457573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.457710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.457798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.457823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.457918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.458155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.458472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.458744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.458867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.458963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.459223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.459472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.459785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.459932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.460030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.460146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.460172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.460317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.460454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.460489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.460632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.460777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.460804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.460911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.461213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.461467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.461697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.461825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.461949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.462237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.462467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.462754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.462887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.463013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.463278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.463575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.463856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.463980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.464005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.464168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.464287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.464313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.196 [2024-11-26 01:20:44.464518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.464651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.196 [2024-11-26 01:20:44.464676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.196 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.464788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.464922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.464947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.465045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.465318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.465563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.465814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.465930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.466092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.466241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.466270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.466393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.466540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.466566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.466660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.466767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.466793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.466915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.467195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.467438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.467700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.467835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.467963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.468234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.468455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.468728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.468873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.468962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.469256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.469602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.469840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.469955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.470087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.470372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.470619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.470848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.470974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.471149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.471273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.471299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.471427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.471511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.471541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.471665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.471790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.471816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.471935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.472070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.472095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.197 qpair failed and we were unable to recover it. 00:27:54.197 [2024-11-26 01:20:44.472265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.197 [2024-11-26 01:20:44.472365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.472390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.472533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.472628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.472654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.472796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.472922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.472947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.473070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.473230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.473255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.473350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.473440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.473464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.473619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.473723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.473749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.473901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.474154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.474444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.474713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.474842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.474965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.475223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.475466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.475795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.475933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.476070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.476175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.476211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.476332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.476448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.476473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.476630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.476806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.476832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.476937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.477229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.477500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.477826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.477977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.478103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.478392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.478631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.478877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.478991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.479110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.479387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.479628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.479793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.198 qpair failed and we were unable to recover it. 00:27:54.198 [2024-11-26 01:20:44.479914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.480015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.198 [2024-11-26 01:20:44.480040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.480168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.480290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.480321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.480416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.480542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.480569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.480702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.480800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.480825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.480975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.481246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.481520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.481803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.481946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.482075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.482204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.482229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.482353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.482479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.482505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.482637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.482749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.482774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.482924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.483260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.483575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.483851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.483967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.484055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.484305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.484604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.484850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.484997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.485145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.485241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.485265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.485359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.485485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.485511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.485658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.485805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.485831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.485935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.486070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.486095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.486224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.486347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.486373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.199 qpair failed and we were unable to recover it. 00:27:54.199 [2024-11-26 01:20:44.486513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.199 [2024-11-26 01:20:44.486672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.486703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.486801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.486893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.486918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.487043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.487198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.487222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.487386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.487506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.487531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.487665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.487796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.487822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.487926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.488170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.488413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.488714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.488866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.488957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.489271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.489597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.489867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.489986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.490133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.490271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.490297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.490424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.490512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.490537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.490665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.490801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.490827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.490925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.491241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.491478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.491763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.491985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.492009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.492179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.492339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.492366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.492522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.492666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.492721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.492854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.492999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.493122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.493420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.493740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.493887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.493983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.494093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.494118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.494275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.494455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.494480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.200 [2024-11-26 01:20:44.494605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.494782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.200 [2024-11-26 01:20:44.494808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.200 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.494912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.495180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.495425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.495714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.495862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.495969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.496092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.496116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.496238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.496453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.496479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.496632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.496765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.496791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.496913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.497199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.497468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.497817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.497966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.498087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.498319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.498551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.498874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.498991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.499114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.499237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.499262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.499432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.499549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.499574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.499679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.499812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.499838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.499963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.500218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.500533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.500832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.500981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.501090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.501250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.501279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.501390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.501493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.501535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.501692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.501832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.501857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.501981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.502189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.502215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.502343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.502446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.502474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.502646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.502802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.502828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.201 qpair failed and we were unable to recover it. 00:27:54.201 [2024-11-26 01:20:44.502949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.503096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.201 [2024-11-26 01:20:44.503121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.503272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.503398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.503423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.503624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.503732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.503758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.503886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.504226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.504555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.504863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.504992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.505218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.505512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.505779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.505922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.506025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.506278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.506613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.506870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.506997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.507147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.507434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.507745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.507890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.508047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.508144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.508180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.508350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.508486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.508514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.508713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.508846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.508873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.508969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.509261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.509521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.509812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.509948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.510077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.510323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.510538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.510800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.510918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.511017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.511130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.511154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.202 qpair failed and we were unable to recover it. 00:27:54.202 [2024-11-26 01:20:44.511287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.202 [2024-11-26 01:20:44.511461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.511487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.511580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.511713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.511740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.511828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.511944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.511969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.512085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.512184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.512213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.512370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.512518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.512544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.512751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.512879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.512904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.512996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.513259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.513512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.513791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.513943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.514079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.514303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.514565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.514835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.514986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.515111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.515364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.515609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.515843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.515955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.516083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.516202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.516228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.516398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.516527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.516552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.516675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.516833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.516864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.516991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.517313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.517604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.517877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.517991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.518115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.518243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.518268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.203 qpair failed and we were unable to recover it. 00:27:54.203 [2024-11-26 01:20:44.518425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.518522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.203 [2024-11-26 01:20:44.518547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.518676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.518803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.518828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.518927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.519192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.519429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.519710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.519833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.519934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.520219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.520523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.520775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.520953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.521054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.521187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.521212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.521310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.521428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.521454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.521590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.521726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.521752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.521903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.522175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.522450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.522699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.522843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.522957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.523274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.523518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.523774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.523890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.523984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.524239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.524502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.524870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.524992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.525164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.525438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.525683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.525829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.204 qpair failed and we were unable to recover it. 00:27:54.204 [2024-11-26 01:20:44.525932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.204 [2024-11-26 01:20:44.526062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.526233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.526531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.526776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.526897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.527021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.527301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.527548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.527820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.527946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.528069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.528345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.528573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.528828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.528981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.529077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.529174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.529200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.529333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.529458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.529485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.529597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.529755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.529782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.529906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.530210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.530505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.530784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.530906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.531045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.531306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.531558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.531816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.531967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.532108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.532357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.532622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.532837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.532983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.533096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.533229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.533256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.205 [2024-11-26 01:20:44.533382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.533475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.205 [2024-11-26 01:20:44.533502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.205 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.533613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.533769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.533795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.533889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.534017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.534042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.534203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.534339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.534366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.534491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.534707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.534732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.534886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.535190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.535520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.535749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.535875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.535981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.536234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.536485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.536764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.536920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.537030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.537162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.537186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.537332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.537462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.537487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.537622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.537836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.537862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.537987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.538222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.538468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.538802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.538934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.539064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.539157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.539182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.539275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.539407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.539433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.539558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.539715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.539741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.539858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.540178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.540388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.540673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.540895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.540986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.541010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.541115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.541268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.541293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.206 qpair failed and we were unable to recover it. 00:27:54.206 [2024-11-26 01:20:44.541427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.541576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.206 [2024-11-26 01:20:44.541612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.541714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.541801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.541827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.541943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.542198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.542507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.542790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.542940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.543070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.543246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.543272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.543371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.543521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.543546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.543746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.543871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.543896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.544025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.544145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.544170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.544311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.544510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.544558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.544658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.544806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.544833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.544936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.545226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.545499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.545797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.545946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.546119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.546227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.546252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.546464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.546593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.546619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.546725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.546847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.546872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.546972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.547306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.547529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.547839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.547967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.548074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.548308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.548575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.548850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.548975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.549096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.549246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.549270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.549472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.549571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.549595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.207 qpair failed and we were unable to recover it. 00:27:54.207 [2024-11-26 01:20:44.549743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.207 [2024-11-26 01:20:44.549858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.549884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.550008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.550138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.550165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.550318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.550417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.550442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.550644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.550813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.550840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.550995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.551109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.551137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.551258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.551428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.551454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.551554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.551643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.551670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.551834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.552037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.552078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.552255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.552371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.552397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.552528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.552744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.552773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.552937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.553100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.553142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.553282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.553454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.553480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.553631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.553796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.553822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.553935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.554070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.554095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.554218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.554339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.554365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.554487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.554694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.554722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.554869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.555014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.555040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.555182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.555300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.555324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.555426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.555577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.555603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.555808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.556162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.556434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.556760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.556909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.557065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.557157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.557182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.557307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.557402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.557427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.557547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.557696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.208 [2024-11-26 01:20:44.557721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.208 qpair failed and we were unable to recover it. 00:27:54.208 [2024-11-26 01:20:44.557834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.557993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.558159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.558462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.558706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.558869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.559009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.559183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.559208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.559355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.559472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.559497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.559622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.559776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.559802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.559976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.560141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.560183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.560338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.560429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.560454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.560550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.560668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.560703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.560877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.561066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.561109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.561259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.561400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.561427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.561550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.561640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.561665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.561872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.562210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.562441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.562691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.562820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.562937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.563235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.563471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.563770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.563889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.564024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.564108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.564134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.564234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.564387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.564412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.564529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.564747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.564775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.564942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.565214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.565516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.565773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.565927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.209 qpair failed and we were unable to recover it. 00:27:54.209 [2024-11-26 01:20:44.566092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.566283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.209 [2024-11-26 01:20:44.566324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.566421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.566511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.566536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.566665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.566797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.566823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.567025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.567162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.567204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.567326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.567453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.567479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.567601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.567731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.567757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.567930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.568260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.568534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.568828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.568994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.569182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.569325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.569350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.569443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.569559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.569583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.569690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.569813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.569837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.569929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.570209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.570444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.570695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.570912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.571046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.571217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.571242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.571377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.571460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.571485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.571603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.571756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.571784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.571921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.572192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.572462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.572726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.572883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.572993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.573106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.573132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.573280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.573429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.573454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.573570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.573745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.573774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.573962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.574149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.574192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.574320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.574418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.574444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.210 qpair failed and we were unable to recover it. 00:27:54.210 [2024-11-26 01:20:44.574568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.210 [2024-11-26 01:20:44.574712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.574739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.574839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.574963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.574990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.575119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.575250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.575275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.575476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.575627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.575652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.575776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.575963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.576148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.576474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.576758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.576883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.577059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.577211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.577253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.577359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.577506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.577531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.577622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.577766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.577808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.577959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.578252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.578478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.578728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.578848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.579002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.579270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.579533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.579766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.579925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.580056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.580264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.580513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.580791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.580940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.581068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.581191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.581216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.581311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.581427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.581453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.581547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.581749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.581775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.581877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.582023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.582048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.582193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.582311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.582336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.582430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.582555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.211 [2024-11-26 01:20:44.582580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.211 qpair failed and we were unable to recover it. 00:27:54.211 [2024-11-26 01:20:44.582741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.582869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.582895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.583038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.583218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.583243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.583368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.583520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.583545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.583696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.583825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.583850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.583968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.584186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.584458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.584767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.584889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.585011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.585313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.585562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.585857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.585981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.586098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.586452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.586724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.586847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.586970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.587257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.587527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.587801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.587959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.588123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.588217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.588242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.588448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.588570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.588596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.588728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.588903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.588945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.589091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.589257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.589282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.589404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.589603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.589629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.589779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.590190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.590538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.590824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.590971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.212 qpair failed and we were unable to recover it. 00:27:54.212 [2024-11-26 01:20:44.591094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.591186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.212 [2024-11-26 01:20:44.591211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.591298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.591431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.591456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.591619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.591752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.591782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.591907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.592173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.592531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.592808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.592980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.593121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.593251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.593278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.593416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.593578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.593605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.593765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.593884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.593910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.594048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.594154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.594182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.594321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.594445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.594472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.594603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.594761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.594787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.594919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.595217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.595511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.595855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.595978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.596123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.596258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.596286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.596420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.596552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.596580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.596697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.596827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.596852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.596987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.597275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.597558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.597859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.597984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.598009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.598136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.598228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.598255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.598390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.598554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.213 [2024-11-26 01:20:44.598581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.213 qpair failed and we were unable to recover it. 00:27:54.213 [2024-11-26 01:20:44.598761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.598889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.598914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.599070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.599204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.599232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.599369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.599516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.599560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.599716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.599810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.599834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.599943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.600263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.600532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.600841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.600980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.601080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.601222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.601250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.601368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.601522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.601549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.601684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.601844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.601869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.602001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.602163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.602191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.602356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.602501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.602528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.602658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.602788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.602814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.602938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.603233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.603517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.603755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.603886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.604032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.604133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.604159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.604254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.604380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.604408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.604539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.604673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.604710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.604867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.605227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.605464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.605712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.605824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.605912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.606077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.606104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.606275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.606396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.606426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.606579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.606709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.606750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.214 [2024-11-26 01:20:44.606890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.607018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.214 [2024-11-26 01:20:44.607045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.214 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.607155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.607320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.607347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.607484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.607619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.607643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.607762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.607937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.607965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.608100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.608224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.608252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.608424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.608554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.608578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.608733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.608831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.608855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.608979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.609115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.609144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.609289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.609410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.609440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.609614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.609737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.609762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.609917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.610212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.610529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.610801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.610950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.611086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.611181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.611205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.611322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.611482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.611509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.611672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.611818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.611843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.612005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.612343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.612615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.612842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.612990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.613107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.613246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.613273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.613406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.613566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.613593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.613732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.613824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.613849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.613989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.614119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.614146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.614280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.614425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.614451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.614572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.614708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.614734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.614883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.615021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.615048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.615212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.615345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.615377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.215 qpair failed and we were unable to recover it. 00:27:54.215 [2024-11-26 01:20:44.615496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.215 [2024-11-26 01:20:44.615619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.615644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.615799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.615905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.615933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.616066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.616221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.616249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.616401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.616525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.616550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.616712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.616845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.616873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.616999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.617139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.617166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.617310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.617439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.617465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.617636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.617765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.617793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.617929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.618232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.618460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.618740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.618867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.618984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.619132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.619156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.619286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.619433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.619457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.619607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.619744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.619772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.619894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.620183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.620466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.620740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.620869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.621019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.621162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.621190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.621331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.621490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.621518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.621659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.621763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.621789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.621903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.622135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.622455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.622806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.622934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.623076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.623227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.623251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.623367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.623455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.623479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.623622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.623727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.216 [2024-11-26 01:20:44.623755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.216 qpair failed and we were unable to recover it. 00:27:54.216 [2024-11-26 01:20:44.623917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.624179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.624455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.624783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.624952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.625061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.625188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.625212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.625330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.625474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.625501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.625634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.625766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.625793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.625898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.626240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.626501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.626832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.626977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.627143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.627413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.627654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.627829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.627959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.628227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.628537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.628797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.628966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.629082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.629168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.629192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.629312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.629442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.629483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.629636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.629766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.629808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.629978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.630274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.630586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.630849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.630970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.217 [2024-11-26 01:20:44.631101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.631245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.217 [2024-11-26 01:20:44.631270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.217 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.631398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.631538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.631565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.631673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.631822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.631851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.631972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.632218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.632487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.632837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.632973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.633143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.633446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.633746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.633909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.634012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.634136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.634163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.634266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.634355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.634380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.634491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0d600 is same with the state(5) to be set 00:27:54.218 [2024-11-26 01:20:44.634671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.634819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.634849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.634944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.635212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.635467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.635717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.635847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.635935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.636206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.636506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.636781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.636931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.637055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.637264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.637532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.637779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.637895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.638017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.638235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.638481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.638754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.218 [2024-11-26 01:20:44.638879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.218 qpair failed and we were unable to recover it. 00:27:54.218 [2024-11-26 01:20:44.638998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.639144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.639169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.639371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.639495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.639521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.639673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.639800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.639825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.639927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.640171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.640442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.640710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.640829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.640939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.641207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.641504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.641810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.641933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.642025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.642292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.642564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.642846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.642999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.643129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.643254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.643279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.643379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.643479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.643506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.643637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.643763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.643790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.643910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.644212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.644465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.644705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.644881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.645013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.645136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.645161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.645362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.645513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.645538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.645629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.645753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.645779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.645906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.646229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.646507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.646813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.219 [2024-11-26 01:20:44.646932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.219 qpair failed and we were unable to recover it. 00:27:54.219 [2024-11-26 01:20:44.647046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.647343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.647550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.647821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.647972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.648096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.648300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.648325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.648456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.648579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.648603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.648695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.648827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.648852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.648973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.649276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.649518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.649794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.649943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.650097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.650222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.650249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.650400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.650522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.650547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.650671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.650815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.650842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.650940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.651324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.651620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.651891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.651992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.652122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.652387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.652681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.652829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.652954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.653233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.653535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.653751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.653867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.653968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.654302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.654541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.220 qpair failed and we were unable to recover it. 00:27:54.220 [2024-11-26 01:20:44.654775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.654982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.220 [2024-11-26 01:20:44.655007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.655158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.655283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.655308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.655426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.655549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.655574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.655660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.655765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.655791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.655918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.656193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.656433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.656758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.656884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.657005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.657265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.657567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.657842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.657987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.658131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.658424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.658716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.658841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.658965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.659270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.659520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.659801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.659933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.660035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.660156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.660200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.660341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.660536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.660580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.660707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.660805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.660830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.660943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.661276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.661532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.661835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.661991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.662183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.662349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.662374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.662468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.662581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.662607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.221 qpair failed and we were unable to recover it. 00:27:54.221 [2024-11-26 01:20:44.662708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.221 [2024-11-26 01:20:44.662802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.662827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.662974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.663243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.663515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.663801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.663941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.664068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.664369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.664611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.664865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.664988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.665110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.665236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.665261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.665383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.665474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.665499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.665590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.665681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.665712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.665858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.666242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.666516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.666758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.666973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.667135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.667269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.667295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.667421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.667521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.667546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.667633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.667735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.667762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.667886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.668261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.668507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.668767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.668930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.669049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.669201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.669226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.669348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.669505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.669531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.222 qpair failed and we were unable to recover it. 00:27:54.222 [2024-11-26 01:20:44.669651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.669752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.222 [2024-11-26 01:20:44.669777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.669905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.670225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.670468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.670787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.670949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.671111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.671236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.671260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.671387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.671487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.671513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.671636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.671771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.671805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.671948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.672249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.672628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.672864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.672992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.673131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.673395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.673664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.673796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.673948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.674222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.674443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.674748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.674897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.675033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.675148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.675174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.675312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.675432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.675457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.675609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.675707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.675733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.675845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.676258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.676542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.676787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.676973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.677148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.677314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.677339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.677450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.677568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.677594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.677752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.677881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.677906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.223 qpair failed and we were unable to recover it. 00:27:54.223 [2024-11-26 01:20:44.678005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.223 [2024-11-26 01:20:44.678102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.678218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.678430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.678668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.678796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.678919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.679195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.679459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.679706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.679893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.679984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.680185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.680209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.680412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.680559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.680584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.680708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.680866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.680909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.681019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.681229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.681255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.681407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.681527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.681552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.681653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.681807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.681833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.681946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.682105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.682130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.682284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.682374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.682399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.682549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.682670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.682703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.682880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.683179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.683443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.683801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.683958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.684149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.684443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.684710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.684861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.684984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.685106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.685131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.685258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.685405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.685429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.685629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.685764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.685792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.685978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.686169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.686212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.686358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.686481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.224 [2024-11-26 01:20:44.686506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.224 qpair failed and we were unable to recover it. 00:27:54.224 [2024-11-26 01:20:44.686634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.686806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.686834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.686961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.687260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.687505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.687822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.687978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.688105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.688227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.688252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.688374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.688469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.688494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.688698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.688847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.688872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.688997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.689123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.689149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.689246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.689344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.689371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.689507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.689636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.689661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.689874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.690068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.690110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.690281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.690400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.690427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.690554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.690652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.690677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.690887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.691237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.691554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.691823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.691985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.692166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.692481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.692734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.692864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.692993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.693150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.693193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.693317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.693444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.693469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.693622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.693731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.693759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.693883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.694236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.694517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.694822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.694977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.695023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.225 [2024-11-26 01:20:44.695164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.695302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.225 [2024-11-26 01:20:44.695327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.225 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.695421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.695506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.695531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.695658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.695797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.695823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.695950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.696069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.696113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.696283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.696436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.696461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.696589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.696680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.696714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.696833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.697236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.697483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.697723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.697903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.698039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.698167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.698192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.698313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.698459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.698486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.698609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.698703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.698728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.698868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.699249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.699550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.699856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.699998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.700170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.700416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.700695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.700809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.700905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.701200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.701473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.701693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.701844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.701943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.702034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.702060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.702181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.702328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.702353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.226 qpair failed and we were unable to recover it. 00:27:54.226 [2024-11-26 01:20:44.702446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.702574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.226 [2024-11-26 01:20:44.702599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.702728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.702855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.702881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.702968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.703087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.703113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.703232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.703432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.703457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.703580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.703698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.703724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.703928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.704119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.704161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.704291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.704390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.704415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.704548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.704705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.704730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.704936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.705207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.705458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.705710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.705831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.705928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.706155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.706400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.706698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.706823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.706922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.707267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.707486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.227 qpair failed and we were unable to recover it. 00:27:54.227 [2024-11-26 01:20:44.707758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.227 [2024-11-26 01:20:44.707881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.707907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.507 qpair failed and we were unable to recover it. 00:27:54.507 [2024-11-26 01:20:44.708002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.708205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.708232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.507 qpair failed and we were unable to recover it. 00:27:54.507 [2024-11-26 01:20:44.708339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.708464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.708490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.507 qpair failed and we were unable to recover it. 00:27:54.507 [2024-11-26 01:20:44.708629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.708753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.708782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.507 qpair failed and we were unable to recover it. 00:27:54.507 [2024-11-26 01:20:44.708945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.709108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.709152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.507 qpair failed and we were unable to recover it. 00:27:54.507 [2024-11-26 01:20:44.709252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.709364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.709390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.507 qpair failed and we were unable to recover it. 00:27:54.507 [2024-11-26 01:20:44.709520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.507 [2024-11-26 01:20:44.709737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.709765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.709902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.710136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.710379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.710591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.710751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.710888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.711188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.711446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.711704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.711889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.712006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.712277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.712518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.712779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.712903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.713025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.713139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.713165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.713288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.713383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.713409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.713611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.713736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.713764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.713886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.714177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.714446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.714733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.714942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.715039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.715194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.715220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.715319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.715440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.715470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.715591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.715769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.715823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.715944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.716179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.716403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.716647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.716905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.716997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.508 [2024-11-26 01:20:44.717024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.508 qpair failed and we were unable to recover it. 00:27:54.508 [2024-11-26 01:20:44.717127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.717342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.717619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.717880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.717999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.718148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.718388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.718632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.718861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.718979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.719103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.719236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.719262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.719382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.719513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.719539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.719663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.719838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.719882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.720043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.720166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.720193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.720317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.720409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.720436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.720558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.720649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.720674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.720828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.721145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.721372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.721629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.721779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.721872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.722166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.722443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.722702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.722831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.722966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.723255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.723534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.723855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.723982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.724091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.724190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.724215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.724313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.724415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.724441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.509 qpair failed and we were unable to recover it. 00:27:54.509 [2024-11-26 01:20:44.724588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.724696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.509 [2024-11-26 01:20:44.724722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.724846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.724964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.724990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.725139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.725264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.725289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.725429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.725556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.725581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.725677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.725816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.725841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.725934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.726228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.726507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.726814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.726975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.727122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.727399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.727706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.727929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.728070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.728271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.728313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.728427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.728522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.728547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.728697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.728815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.728842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.729043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.729151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.729178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.729288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.729376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.729402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.729520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.729672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.729703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.729845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.730194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.730487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.730779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.730970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.731133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.731237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.731262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.731414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.731541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.731566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.731681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.731839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.731882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.732003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.732247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.732530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.732841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.732960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.510 qpair failed and we were unable to recover it. 00:27:54.510 [2024-11-26 01:20:44.733054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.510 [2024-11-26 01:20:44.733166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.733317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.733564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.733783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.733927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.734046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.734320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.734588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.734868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.734985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.735105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.735353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.735596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.735855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.735973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.736100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.736216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.736242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.736343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.736436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.736462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.736607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.736734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.736760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.736919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.737164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.737395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.737659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.737801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.737924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.738168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.738433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.738652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.738813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.738932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.739166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.739424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.739638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.739785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.739928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.740072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.740101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.511 qpair failed and we were unable to recover it. 00:27:54.511 [2024-11-26 01:20:44.740230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.511 [2024-11-26 01:20:44.740322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.740348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.740473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.740603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.740629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.740757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.740876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.740915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.741029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.741162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.741191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.741299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.741439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.741466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.741673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.741779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.741804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.741899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.742154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.742498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.742864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.742976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.743143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.743512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.743820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.743946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.744067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.744215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.744242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.744343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.744481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.744508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.744613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.744755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.744780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.744886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.745021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.745050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.745258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.745420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.745448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.745547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.745679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.745742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.745896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.746161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.746469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.746726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.746852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.746965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.747100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.747125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.512 qpair failed and we were unable to recover it. 00:27:54.512 [2024-11-26 01:20:44.747243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.747473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.512 [2024-11-26 01:20:44.747501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.747602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.747745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.747772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.747972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.748115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.748143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.748280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.749061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.749096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.749281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.749399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.749428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.749548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.749713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.749757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.749883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.750163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.750450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.750852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.750989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.751016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.751161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.751337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.751365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.751595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.751711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.751752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.751847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.751987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.752016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.752183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.752319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.752347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.752459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.752681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.752729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.752857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.753173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.753432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.753752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.753904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.754087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.754178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.754203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.754325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.754431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.754459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.754598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.754779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.754805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.754929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.755084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.755112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.755271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.755377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.755405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.755537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.755673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.755715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.755855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.756210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.756483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.513 qpair failed and we were unable to recover it. 00:27:54.513 [2024-11-26 01:20:44.756829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.513 [2024-11-26 01:20:44.756943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.756972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.757112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.757253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.757279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.757459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.757578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.757602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.757722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.757873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.757898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.758029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.758324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.758564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.758890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.758990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.759180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.759448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.759730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.759902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.760081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.760216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.760244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.760383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.760515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.760544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.760656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.760772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.760798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.760925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.761198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.761449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.761718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.761856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.761988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.762299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.762523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.762779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.762927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.763068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.763166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.763190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.763360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.763494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.763521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.763696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.763820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.763845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.763944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.764068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.764099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.764196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.764318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.764360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.764510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.764649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.514 [2024-11-26 01:20:44.764694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.514 qpair failed and we were unable to recover it. 00:27:54.514 [2024-11-26 01:20:44.764847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.764969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.765130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.765409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.765699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.765818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.765916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.766233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.766530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.766770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.766923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.767102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.767327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.767566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.767826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.767950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.768055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.768202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.768227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.768401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.768519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.768552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.768709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.768830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.768857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.769040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.769166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.769206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.769339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.769478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.769505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.769615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.769781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.769809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.769936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.770218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.770458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.770788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.770931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.771049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.771332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.771587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.771814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.771938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.772061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.772195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.772223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.772360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.772457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.515 [2024-11-26 01:20:44.772482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.515 qpair failed and we were unable to recover it. 00:27:54.515 [2024-11-26 01:20:44.772609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.772732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.772759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.772882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.772979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.773123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.773339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.773642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.773841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.773961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.774229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.774509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.774791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.774968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.775146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.775413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.775657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.775824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.775981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.776244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.776471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.776750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.776894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.777009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.777117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.777145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.777299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.777387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.777411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.777554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.777712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.777740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.777891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.778253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.778524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.778810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.778926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.779073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.779171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.779195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.779351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.779456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.779483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.779601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.779708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.779737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.779889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.780017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.780042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.780189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.780350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.780378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.516 qpair failed and we were unable to recover it. 00:27:54.516 [2024-11-26 01:20:44.780485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.516 [2024-11-26 01:20:44.780634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.780659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.780815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.780940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.780964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.781115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.781280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.781307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.781425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.781565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.781590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.781740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.781840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.781864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.781969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.782233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.782548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.782863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.782992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.783130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.783403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.783645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.783844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.783940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.784263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.784512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.784777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.784921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.785078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.785200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.785225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.785321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.785430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.785473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.785608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.785724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.785767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.785861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.786161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.786399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.786674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.786800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.786914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.787192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.787450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.787681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.787809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.787952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.788080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.788107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.788226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.788385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.788410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.788575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.788694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.788723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.788860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.789139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.789408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.789647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.789790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.517 qpair failed and we were unable to recover it. 00:27:54.517 [2024-11-26 01:20:44.789912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.790035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.517 [2024-11-26 01:20:44.790060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.790157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.790294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.790322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.790466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.790601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.790628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.790753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.790841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.790867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.790960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.791212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.791513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.791835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.791982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.792154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.792262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.792289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.792472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.792593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.792617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.792773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.792906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.792933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.793055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.793311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.793540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.793819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.793947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.794070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.794194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.794219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.794335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.794444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.794471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.794587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.794720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.794747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.794896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.795185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.795487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.795801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.795922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.796053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.796332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.796602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.796846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.796981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.797109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.797352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.797609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.797794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.797935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.798239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.798470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.798794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.798962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.799082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.799196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.799221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.799335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.799478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.799506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.799641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.799790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.799815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.799936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.800168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.800448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.800759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.800916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.518 [2024-11-26 01:20:44.801009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.801122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.518 [2024-11-26 01:20:44.801150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.518 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.801278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.801392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.801419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.801559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.801657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.801692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.801839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.801941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.801968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.802076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.802357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.802625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.802890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.802995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.803140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.803436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.803668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.803938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.804074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.804205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.804230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.804372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.804499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.804531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.804655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.804821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.804849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.805018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.805114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.805138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.805287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.805449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.805477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.805644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.805755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.805783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.805930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.806225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.806497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.806788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.806914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.807039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.807182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.807209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.807314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.807418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.807445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.807570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.807727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.807779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.807909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.808192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.808468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.808808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.808959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.809090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.809200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.809228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.809384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.809536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.809560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.809696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.809832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.809857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.809995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.810270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.810538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.810801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.810938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.811065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.811159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.811186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.811318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.811448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.811475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.811609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.811743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.811771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.811884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.812149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.812479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.519 [2024-11-26 01:20:44.812782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.519 [2024-11-26 01:20:44.812927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.519 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.813033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.813187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.813230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.813375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.813507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.813550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.813677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.813785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.813812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.813920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.814226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.814491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.814760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.814884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.814998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.815264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.815527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.815849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.815981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.816114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.816225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.816253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.816349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.816486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.816510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.816636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.816796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.816822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.816941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.817220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.817525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.817863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.817996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.818100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.818234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.818262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.818370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.818542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.818570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.818722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.818848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.818873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.818994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.819289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.819530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.819836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.819959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.820078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.820346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.820599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.820883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.820982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.821121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.821457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.821742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.821892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.821999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.822237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.822518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.520 [2024-11-26 01:20:44.822746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.520 [2024-11-26 01:20:44.822902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.520 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.822991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.823213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.823452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.823695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.823851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.823978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.824239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.824472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.824727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.824904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.825050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.825330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.825582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.825805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.825926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.826018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.826221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.826474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.826756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.826877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.826982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.827196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.827450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.827704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.827831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.827943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.828187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.828463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.828747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.828896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.829055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.829334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.829582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.829840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.829963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.830089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.830309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.830579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.830849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.830965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.831069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.831306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.831552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.831833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.831952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.832053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.832301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.832549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.832832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.832994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.521 qpair failed and we were unable to recover it. 00:27:54.521 [2024-11-26 01:20:44.833094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.833199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.521 [2024-11-26 01:20:44.833224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.833324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.833449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.833474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.833570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.833665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.833713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.833840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.833939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.833964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.834054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.834258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.834560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.834820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.834967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.835075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.835317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.835579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.835858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.835992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.836121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.836237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.836261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.836358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.836452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.836478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.836629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.836782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.836808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.836944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.837250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.837508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.837790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.837936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.838073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.838311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.838586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.838857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.838979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.839096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.839312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.839578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.839838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.839985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.840143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.840393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.840667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.840838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.840932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.841193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.841413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.841635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.841745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.841888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.842162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.842376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.842681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.842801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.842918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.843194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.843459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.522 qpair failed and we were unable to recover it. 00:27:54.522 [2024-11-26 01:20:44.843718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.522 [2024-11-26 01:20:44.843844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.843932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.844236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.844481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.844758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.844911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.845029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.845311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.845526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.845777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.845947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.846069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.846312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.846608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.846864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.846986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.847159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.847457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.847721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.847839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.847995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.848274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.848517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.848827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.848972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.849079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.849355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.849572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.849795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.849946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.850043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.850289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.850540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.850838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.850961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.851111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.851326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.851553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.851798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.851961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.852082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.852331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.852567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.852830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.852953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.853073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.853201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.853225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.523 [2024-11-26 01:20:44.853355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.853474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.523 [2024-11-26 01:20:44.853499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.523 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.853625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.853747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.853773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.853869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.854171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.854422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.854731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.854852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.854947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.855167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.855391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.855655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.855785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.855939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.856214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.856473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.856728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.856860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.857019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.857268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.857523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.857761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.857885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.857981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.858193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.858445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.858673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.858795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.858922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.859242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.859511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.859758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.859988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.860119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.860355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.860605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.860847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.860966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.861169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.861324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.861349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.861441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.861561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.861586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.861723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.861815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.861840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.861964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.862211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.862466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.862733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.862881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.862974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.863223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.863527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.863799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.863916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.524 qpair failed and we were unable to recover it. 00:27:54.524 [2024-11-26 01:20:44.864018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.524 [2024-11-26 01:20:44.864193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.864303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.864565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.864841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.864987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.865116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.865326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.865600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.865851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.865977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.866129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.866375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.866657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.866814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.866907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.867213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.867470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.867695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.867826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.867931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.868181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.868420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.868672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.868815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.868945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.869261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.869486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.869787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.869933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.870063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.870289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.870586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.870862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.870997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.871126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.871369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.871578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.871851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.871966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.872072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.872190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.872214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.872315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.872442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.872466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.872624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.872712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.872738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.872889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.873166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.873408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.873649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.873796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.873892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.874017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.874043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.874165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.874272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.874303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.874463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.874588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.525 [2024-11-26 01:20:44.874613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.525 qpair failed and we were unable to recover it. 00:27:54.525 [2024-11-26 01:20:44.874722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.874852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.874879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.875012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.875135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.875160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.875293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.875423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.875449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.875611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.875752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.875780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.875888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.876144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.876414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.876719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.876836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.876959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.877263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.877507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.877767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.877994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.878118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.878248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.878273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.878420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.878543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.878568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.878705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.878855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.878880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.879034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.879162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.879187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.879393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.879515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.879540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.879629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.879758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.879785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.879879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.880177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.880441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.880803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.880950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.881046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.881174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.881198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.881331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.881458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.881483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.881683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.881834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.881859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.881948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.882198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.882467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.882813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.882932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.883032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.883334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.883658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.883886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.883978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.884153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.884525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.884809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.884960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.885068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.885187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.526 [2024-11-26 01:20:44.885212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.526 qpair failed and we were unable to recover it. 00:27:54.526 [2024-11-26 01:20:44.885335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.885454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.885478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.885573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.885669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.885699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.885824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.885915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.885940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.886059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.886308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.886582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.886872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.886976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.887101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.887354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.887579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.887877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.887984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.888132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.888232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.888258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.888358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.888476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.888501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.888652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.888809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.888835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.888937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.889147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.889427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.889706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.889857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.889957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.890059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.890085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.890204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.890371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.890397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.891478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.891669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.891708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.891853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.891964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.891994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.892122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.892253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.892279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.892394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.892504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.892529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.892676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.892796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.892822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.892947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.893226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.893469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.893754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.893927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.894058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.894319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.894567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.894870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.894972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.895097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.895369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.895635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.895795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.895919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.896200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.896459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.527 qpair failed and we were unable to recover it. 00:27:54.527 [2024-11-26 01:20:44.896714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.527 [2024-11-26 01:20:44.896825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.896852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.896951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.897194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.897476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.897708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.897844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.897936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.898178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.898453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.898697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.898851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.899013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.899291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.899566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.899813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.899935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.900084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.900261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.900308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.900462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.900606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.900632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.900747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.900846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.900872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.900988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.901151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.901193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.901311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.901463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.901491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.901611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.901740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.901767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.901919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.902273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.902537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.902868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.902998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.903221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.903448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.903719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.903885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.904008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.904315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.904568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.904874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.904995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.905145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.905272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.905299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.905434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.905564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.905590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.905693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.905790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.905816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.905938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.906069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.528 [2024-11-26 01:20:44.906096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.528 qpair failed and we were unable to recover it. 00:27:54.528 [2024-11-26 01:20:44.906220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.906390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.906415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.906539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.906658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.906706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.906846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.906975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.907153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.907475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.907783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.907933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.908049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.908294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.908505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.908766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.908887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.908986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.909242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.909478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.909697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.909818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.909921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.910152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.910399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.910638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.910890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.910989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.911148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.911395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.911670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.911801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.911961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.912240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.912544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.912844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.912976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.913164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.913479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.529 [2024-11-26 01:20:44.913742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.529 [2024-11-26 01:20:44.913908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.529 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.914068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.914210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.914240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.914337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.914467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.914493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.914614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.914749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.914778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.914908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.915175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.915400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.915730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.915857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.915957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.916204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.916447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.916736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.916866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.916988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.917299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.917580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.917811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.917960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.918097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.918373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.918670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.918897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.918992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.919147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.919436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.919721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.919942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.920090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.920202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.920228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.920379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.920510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.920536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.920634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.920782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.530 [2024-11-26 01:20:44.920826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.530 qpair failed and we were unable to recover it. 00:27:54.530 [2024-11-26 01:20:44.920935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.921238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.921522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.921824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.921980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.922184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.922305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.922330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.922455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.922576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.922602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.922702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.922863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.922890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.923045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.923370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.923577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.923851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.923987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.924122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.924366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.924603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.924847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.924973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.925067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.925217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.925243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.925373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.925502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.925528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.925647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.925768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.925798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.925916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.926040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.926065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.926183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.926336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.926362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.926499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.926649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.926674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.926857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.927177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.927462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.927746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.927864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.927965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.928263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.928543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.531 qpair failed and we were unable to recover it. 00:27:54.531 [2024-11-26 01:20:44.928837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.531 [2024-11-26 01:20:44.928975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.929093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.929218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.929243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.929379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.929469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.929494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.929628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.929779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.929823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.929966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.930154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.930198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.930320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.930446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.930472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.930607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.930700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.930728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.930862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.931143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.931406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.931672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.931889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.932014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.932287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.932530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.932759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.932941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.933067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.933315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.933563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.933871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.933984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.934113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.934378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.934600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.934852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.934998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.935113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.935388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.935638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.935908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.935997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.936023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.936172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.936266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.936291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.936393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.936539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.532 [2024-11-26 01:20:44.936565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.532 qpair failed and we were unable to recover it. 00:27:54.532 [2024-11-26 01:20:44.936713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.936813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.936838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.936930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.937080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.937106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.937233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.937385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.937411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.937542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.937639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.937667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.937830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.938179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.938450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.938770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.938958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.939073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.939385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.939623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.939869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.939994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.940147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.940420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.940695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.940890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.941021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.941289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.941577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.941853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.941980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.942107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.942374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.942619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.942767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.942930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.943216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.943511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.943830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.943991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.944148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.944321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.944346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.944465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.944590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.944616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.533 [2024-11-26 01:20:44.944754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.944910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.533 [2024-11-26 01:20:44.944953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.533 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.945135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.945284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.945310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.945437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.945559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.945586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.945691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.945840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.945883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.946025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.946162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.946189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.946305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.946427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.946453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.946577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.946676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.946711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.946851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.947215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.947441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.947692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.947858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.948035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.948202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.948247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.948371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.948501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.948526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.948643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.948777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.948821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.948994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.949278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.949555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.949848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.949961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.950088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.950212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.950239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.950363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.950513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.950539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.950665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.950812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.950840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.950968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.951270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.951492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.951770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.951919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.952077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.952320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.952583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.952826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.952954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.534 qpair failed and we were unable to recover it. 00:27:54.534 [2024-11-26 01:20:44.953081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.534 [2024-11-26 01:20:44.953180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.953327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.953614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.953866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.953991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.954091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.954215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.954242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.954392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.954484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.954509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.954643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.954763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.954791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.954932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.955242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.955505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.955751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.955871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.955996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.956149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.956174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.956299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.956394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.956425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.956575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.956700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.956726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.956873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.957180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.957398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.957673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.957862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.957982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.958200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.958426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.958659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.958815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.958934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.959150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.959366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.535 qpair failed and we were unable to recover it. 00:27:54.535 [2024-11-26 01:20:44.959578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.535 [2024-11-26 01:20:44.959698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.959733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.959851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.959972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.959999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.960124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.960248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.960273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.960396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.960522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.960548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.960699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.960823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.960866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.960991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.961255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.961515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.961817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.961973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.962082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.962179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.962203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.962325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.962476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.962501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.962653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.962800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.962842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.962968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.963255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.963533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.963804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.963967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.964085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.964182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.964208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.964316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.964440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.964470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.964625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.964749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.964793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.964919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.965219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.965489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.965816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.965975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.966184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.966465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.966732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.966883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.966974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.967188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.967464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.536 qpair failed and we were unable to recover it. 00:27:54.536 [2024-11-26 01:20:44.967678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.536 [2024-11-26 01:20:44.967833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.967858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.967981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.968245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.968516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.968779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.968928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.969033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.969271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.969518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.969825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.969973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.970112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.970362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.970621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.970851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.970965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.971088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.971204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.971229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.971380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.971533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.971558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.971657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.971777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.971821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.971965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.972153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.972196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.972289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.972405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.972430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.972526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.972678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.972708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.972862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.973214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.973496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.973785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.973976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.974100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.974241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.974266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.974373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.974493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.974518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.974633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.974775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.974801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.974900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.975002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.975028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.975128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.975218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.975243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.537 [2024-11-26 01:20:44.975374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.975469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.537 [2024-11-26 01:20:44.975494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.537 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.975596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.975716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.975747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.975870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.976187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.976426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.976708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.976866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.977004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.977301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.977533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.977791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.977976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.978094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.978230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.978257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.978364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.978457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.978482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.978599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.978739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.978769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.978932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.979256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.979549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.979816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.979998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.980132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.980432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.980779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.980921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.981084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.981202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.981228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.981361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.981457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.981484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.981579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.981720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.981747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.981899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.982156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.982426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.982730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.982851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.983004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.983097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.983124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.538 [2024-11-26 01:20:44.983245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.983364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.538 [2024-11-26 01:20:44.983389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.538 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.983513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.983640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.983666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.983765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.983879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.983904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.984026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.984294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.984573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.984848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.984997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.985139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.985268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.985296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.985400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.985539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.985564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.985691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.985870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.985898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.986113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.986209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.986237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.986362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.986520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.986548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.986680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.986813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.986838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.986981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.987114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.987146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.987318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.987445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.987473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.987641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.987775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.987803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.987931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.988179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.988464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.988703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.988870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.988969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.989224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.989550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.989837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.989986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.990132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.990225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.990253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.990351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.990486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.990513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.539 qpair failed and we were unable to recover it. 00:27:54.539 [2024-11-26 01:20:44.990652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.539 [2024-11-26 01:20:44.990781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.990808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.990930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.991269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.991547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.991862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.991985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.992159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.992424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.992724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.992839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.992966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.993210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.993504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.993777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.993919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.994028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.994190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.994218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.994352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.994526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.994553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.994657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.994807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.994833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.994951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.995269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.995600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.995877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.995999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.996128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.996277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.996302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.996457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.996581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.996605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.996709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.996799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.996824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.996923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.997157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.997424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.997695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.997811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.997964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.998102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.998130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.998234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.998369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.998398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.540 [2024-11-26 01:20:44.998560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.998723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.540 [2024-11-26 01:20:44.998767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.540 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:44.998924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:44.999213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:44.999504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:44.999808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:44.999972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.000131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.000462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.000727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.000861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.000986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.001282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.001510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.001787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.001940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.002067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.002287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.002536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.002794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.002935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.003087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.003329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.003604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.003849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.003966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.004064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.004388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.004592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.004839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.004989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.005089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.005214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.005238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.005364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.005458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.005485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.005637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.005759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.005785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.005915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.006005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.006032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.006154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.006303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.006328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.541 qpair failed and we were unable to recover it. 00:27:54.541 [2024-11-26 01:20:45.006455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.006552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.541 [2024-11-26 01:20:45.006582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.006705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.006825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.006850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.006973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.007300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.007591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.007835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.007986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.008110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.008235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.008260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.008412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.008506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.008531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.008633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.008733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.008759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.008858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.009136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.009431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.009696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.009824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.009920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.010199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.010417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.010663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.010814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.010914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.011157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.011454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.011757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.011934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.012092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.012338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.012583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.012852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.012966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.013084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.013361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.013606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.013849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.013997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.542 qpair failed and we were unable to recover it. 00:27:54.542 [2024-11-26 01:20:45.014106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.542 [2024-11-26 01:20:45.014193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.014217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.014311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.014435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.014462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.014628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.014731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.014759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.014884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.015212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.015491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.015762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.015935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.016065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.016190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.016215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.016323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.016455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.016485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.016623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.016774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.016802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.016931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.017063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.543 [2024-11-26 01:20:45.017089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.543 qpair failed and we were unable to recover it. 00:27:54.543 [2024-11-26 01:20:45.017244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.017361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.017389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.017544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.017664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.017694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.017818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.017967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.017992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.018110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.018248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.018276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.018417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.018553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.018580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.018720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.018836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.018863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.018990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.019084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.019125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.019287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.019395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.019422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.019557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.019743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.019769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.019892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.020018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.020043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.812 qpair failed and we were unable to recover it. 00:27:54.812 [2024-11-26 01:20:45.020191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.812 [2024-11-26 01:20:45.020284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.020309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.020435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.020554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.020579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.020730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.020848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.020873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.021027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.021285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.021547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.021840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.021988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.022087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.022192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.022217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.022340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.022475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.022502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.022665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.022816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.022841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.022962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.023232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.023501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.023818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.023971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.024072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.024322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.024570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.024875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.024978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.025100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.025390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.025690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.025837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.025964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.026195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.026458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.026736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.026862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.027016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.027299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.027568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.027804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.813 [2024-11-26 01:20:45.027957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.813 qpair failed and we were unable to recover it. 00:27:54.813 [2024-11-26 01:20:45.028051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.028300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.028559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.028853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.028981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.029099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.029364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.029610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.029830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.029987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.030120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.030237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.030263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.030384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.030535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.030562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.030692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.030798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.030826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.030970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.031067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.031092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.031220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.031371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.031396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.031518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.031663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.031715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.031894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.032212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.032442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.032694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.032843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.032973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.033220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.033487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.033790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.033943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.034068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.034189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.034215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.034335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.034481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.034507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.034600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.034754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.034780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.034910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.035178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.035437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.814 [2024-11-26 01:20:45.035706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.814 [2024-11-26 01:20:45.035858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.814 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.036044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.036184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.036209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.036335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.036425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.036450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.036570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.036705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.036731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.036847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.037190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.037420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.037659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.037816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.037908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.038158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.038491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.038764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.038926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.039020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.039299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.039590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.039841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.039983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.040100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.040363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.040584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.040851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.040968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.041061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.041185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.041210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.041359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.041478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.041503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.041605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.041705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.041730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.041878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.042200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.042463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.042703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.042855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.042976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.043125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.043150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.043248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.043337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.043363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.815 qpair failed and we were unable to recover it. 00:27:54.815 [2024-11-26 01:20:45.043450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.815 [2024-11-26 01:20:45.043549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.043574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.043675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.043810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.043836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.043958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.044230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.044477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.044745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.044874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.044976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.045240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.045535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.045810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.045997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.046142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.046273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.046316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.046467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.046562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.046587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.046693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.046795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.046823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.046988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.047281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.047551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.047839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.047980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.048165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.048482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.048737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.048965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.049106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.049241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.049266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.049415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.049538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.049563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.049743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.049907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.049951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.050075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.050228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.050253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.050348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.050500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.050525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.050674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.050817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.050864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.051006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.051134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.051164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.051310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.051408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.051434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.051556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.051656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.816 [2024-11-26 01:20:45.051682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.816 qpair failed and we were unable to recover it. 00:27:54.816 [2024-11-26 01:20:45.051831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.051946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.051972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.052120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.052375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.052616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.052899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.052998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.053148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.053417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.053696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.053909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.054058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.054271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.054512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.054775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.054923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.055023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.055121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.055146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.055299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.055426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.055451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.055571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.055702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.055729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.055871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.056212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.056458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.056751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.056918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.057071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.057337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.057580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.057857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.057979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.058005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.058092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.058210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.058236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.817 qpair failed and we were unable to recover it. 00:27:54.817 [2024-11-26 01:20:45.058383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.817 [2024-11-26 01:20:45.058536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.058561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.058660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.058756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.058784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.058903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.059241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.059476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.059727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.059899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.059993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.060224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.060437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.060744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.060891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.060984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.061266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.061564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.061828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.061973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.062121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.062247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.062272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.062423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.062544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.062570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.062668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.062772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.062797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.062921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.063167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.063473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.063764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.063931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.064059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.064301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.064553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.064860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.064989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.065102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.065389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.065647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.065799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.818 qpair failed and we were unable to recover it. 00:27:54.818 [2024-11-26 01:20:45.065969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.818 [2024-11-26 01:20:45.066127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.066169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.066294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.066440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.066465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.066591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.066693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.066719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.067224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.067475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.067741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.067914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.068062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.068187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.068212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.068333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.068433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.068459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.068613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.068749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.068792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.068946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.069252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.069498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.069798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.069997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.070139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.070284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.070309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.070465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.070594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.070619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.070719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.070827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.070857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.071010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.071306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.071563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.071816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.071956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.072050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.072316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.072610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.072833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.072978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.073022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.073214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.073394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.073447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.073582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.073721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.073750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.073882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.073978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.074005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.819 [2024-11-26 01:20:45.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.074245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.819 [2024-11-26 01:20:45.074273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.819 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.074430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.074562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.074589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.074801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.074903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.074928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.075118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.075278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.075306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.075469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.075576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.075605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.075740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.075866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.075894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.076010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.076313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.076611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.076842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.076970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.077094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.077248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.077277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.077428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.077574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.077601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.077742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.077942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.077983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.078116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.078248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.078275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.078413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.078544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.078572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.078697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.078830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.078855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.078949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.079097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.079121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.079276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.079406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.079435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.079632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.079757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.079783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.079903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.080022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.080047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.080212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.080370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.080397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.080561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.080697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.080739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.080892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.081031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.081058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.081220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.081377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.081404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.081583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.081692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.081743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.081868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.082176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.082520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.082834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.082983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.820 qpair failed and we were unable to recover it. 00:27:54.820 [2024-11-26 01:20:45.083074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.820 [2024-11-26 01:20:45.083162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.083187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.083361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.083495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.083523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.083657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.083804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.083829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.083972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.084314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.084599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.084882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.084977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.085147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.085470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.085765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.085910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.086005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.086183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.086210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.086339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.086504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.086531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.086664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.086807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.086832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.086950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.087257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.087532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.087797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.087952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.088062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.088179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.088207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.088344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.088467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.088498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.088622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.088742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.088768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.088896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.089233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.089460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.089677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.089804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.089926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.090075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.090099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.821 qpair failed and we were unable to recover it. 00:27:54.821 [2024-11-26 01:20:45.090255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.821 [2024-11-26 01:20:45.090378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.090403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.090554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.090705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.090730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.090902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.091247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.091548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.091867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.091976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.092133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.092400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.092745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.092886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.093022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.093123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.093150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.093295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.093433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.093458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.093566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.093701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.093727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.093866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.094190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.094467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.094747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.094865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.095008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.095154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.095182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.095320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.095456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.095483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.095597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.095745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.095770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.095895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.096026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.096050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.096165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.096327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.096355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.096542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.096670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.096707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.096844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.097151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.097499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.097801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.097923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.098049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.098194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.098221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.098342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.098486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.098515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.098617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.098768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.822 [2024-11-26 01:20:45.098793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.822 qpair failed and we were unable to recover it. 00:27:54.822 [2024-11-26 01:20:45.098883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.099237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.099531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.099835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.099986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.100123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.100389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.100664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.100833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.101002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.101249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.101511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.101813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.101964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.102106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.102265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.102293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.102428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.102539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.102569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.102744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.102871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.102896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.103041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.103161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.103188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.103326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.103464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.103491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.103660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.103758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.103782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.103875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.104202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.104466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.104753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.104929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.105063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.105203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.105228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.105437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.105573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.105602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.105777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.105874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.105898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.106035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.106198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.106225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.106341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.106481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.106509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.106608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.106752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.106778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.106885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.107033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.107057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.823 [2024-11-26 01:20:45.107198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.107298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.823 [2024-11-26 01:20:45.107326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.823 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.107426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.107585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.107613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.107758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.107888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.107912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.108005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.108270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.108538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.108838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.108985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.109170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.109333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.109360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.111831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.111981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.112141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.112449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.112801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.112987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.113102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.113225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.113250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.113392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.113518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.113543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.113662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.113777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.113804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.113980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.114102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.114126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.114289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.114386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.114410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.114566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.114713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.114742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.114886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.115199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.115436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.115650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.115832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.115975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.116242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.116497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.116746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.116921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.117038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.117176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.117203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.117333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.117456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.117481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.117636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.117831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.117861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.824 qpair failed and we were unable to recover it. 00:27:54.824 [2024-11-26 01:20:45.118000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.118139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.824 [2024-11-26 01:20:45.118168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.118286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.118405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.118430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.118543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.118676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.118713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.118858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.118957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.118998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.119141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.119265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.119290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.119436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.119532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.119559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.119778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.119877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.119903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.119995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.120113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.120138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.120249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.120416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.120444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.120583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.120726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.120755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.120911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.121195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.121467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.121761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.121909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.122028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.122205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.122233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.122371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.122502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.122529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.122682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.122773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.122798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.122924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.123258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.123570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.123893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.123992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.124168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.124509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.124783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.124916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.125070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.125310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.125527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.125868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.125992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.126136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.126230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.126261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.825 [2024-11-26 01:20:45.126379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.126482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.825 [2024-11-26 01:20:45.126509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.825 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.126654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.126784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.126810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.126908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.126995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.127106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.127351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.127643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.127799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.127897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.128213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.128464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.128764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.128888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.129063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.129199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.129227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.129369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.129515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.129540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.129698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.129826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.129854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.129995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.130121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.130149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.130292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.130415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.130441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.130577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.130732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.130760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.130896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.131150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.131462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.131736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.131934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.132076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.132222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.132247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.132354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.132496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.132521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.132645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.132753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.132797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.132973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.133279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.133577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.826 qpair failed and we were unable to recover it. 00:27:54.826 [2024-11-26 01:20:45.133871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.826 [2024-11-26 01:20:45.133995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.134146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.134430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.134713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.134872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.135029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.135160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.135188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.135333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.135483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.135508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.135628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.135749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.135775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.135897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.136226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.136537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.136831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.136986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.137152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.137441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.137733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.137855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.137989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.138300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.138550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.138821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.138970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.139090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.139209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.139235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.139349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.139464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.139504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.139709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.139902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.139926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.140075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.140190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.140215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.140391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.140491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.140520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.140650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.140791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.140821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.140938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.141197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.141482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.141795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.141945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.142091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.142225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.142253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.827 qpair failed and we were unable to recover it. 00:27:54.827 [2024-11-26 01:20:45.142391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.827 [2024-11-26 01:20:45.142514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.142542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.142706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.142849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.142874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.143011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.143144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.143172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.143319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.143452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.143481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.143631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.143758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.143784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.143897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.144152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.144429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.144661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.144817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.144915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.145259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.145590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.145832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.145981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.146072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.146189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.146214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.146354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.146487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.146515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.146637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.146788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.146814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.146942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.147198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.147455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.147734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.147888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.147999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.148163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.148191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.148317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.148429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.148457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.148624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.148755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.148781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.148941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.149163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.149506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.149838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.149997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.150025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.150157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.150293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.150320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.828 [2024-11-26 01:20:45.150450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.150568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.828 [2024-11-26 01:20:45.150593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.828 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.150717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.150839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.150864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.151013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.151128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.151153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.151275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.151398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.151424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.151577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.151759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.151795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.151920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.152225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.152474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.152765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.152918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.153068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.153184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.153209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.153361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.153511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.153536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.153654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.153781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.153806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.153904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.154144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.154454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.154735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.154879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.154984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.155255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.155562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.155883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.155991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.156119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.156396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.156694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.156931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.157074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.157320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.157567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.157836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.157999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.158176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.158469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.829 [2024-11-26 01:20:45.158786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.829 [2024-11-26 01:20:45.158916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.829 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.159063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.159279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.159566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.159863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.159987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.160071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.160220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.160262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.160387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.160511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.160536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.160676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.160807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.160832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.160946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.161224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.161513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.161794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.161998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.162152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.162485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.162779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.162925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.163072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.163206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.163234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.163401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.163524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.163549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.163723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.163853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.163881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.164005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.164205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.164245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.164449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.164571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.164612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.164743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.164870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.164895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.164980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.165081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.165108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.165260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.165352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.165377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.165520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.165643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.165670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.165824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.166025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.166052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.166198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.166294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.166319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.830 qpair failed and we were unable to recover it. 00:27:54.830 [2024-11-26 01:20:45.166435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.830 [2024-11-26 01:20:45.166557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.166582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.166671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.166776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.166801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.166893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.166984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.167180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.167447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.167719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.167870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.167992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.168229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.168507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.168760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.168936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.169060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.169174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.169202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.169371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.169516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.169556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.169736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.169886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.169911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.170018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.170194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.170219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.170339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.170432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.170457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.170661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.170804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.170832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.170937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.171067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.171094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.171238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.171355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.171380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.171529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.171670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.171705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.171913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.172217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.172463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.172776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.172910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.173024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.173224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.173248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.173348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.173514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.173547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.173699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.173818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.173843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.173945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.174231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.174533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.831 qpair failed and we were unable to recover it. 00:27:54.831 [2024-11-26 01:20:45.174877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.831 [2024-11-26 01:20:45.174978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.175149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.175458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.175756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.175881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.176027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.176134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.176162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.176293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.176445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.176473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.176618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.176769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.176794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.176917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.177048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.177076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.177242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.177359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.177384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.177503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.177627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.177652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.177867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.178148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.178423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.178717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.178890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.179019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.179164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.179190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.179314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.179434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.179459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.179576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.179784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.179813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.180017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.180197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.180222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.180373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.180540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.180568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.180727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.180863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.180891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.180994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.181127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.181155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.181358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.181478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.181503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.181629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.181772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.181800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.181933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.182240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.182545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.182891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.182979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.183005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.183128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.183253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.183278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.183423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.183591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.832 [2024-11-26 01:20:45.183616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.832 qpair failed and we were unable to recover it. 00:27:54.832 [2024-11-26 01:20:45.183741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.183862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.183904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.184024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.184116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.184140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.184263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.184450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.184475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.184589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.184743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.184768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.184919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.185272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.185546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.185885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.185980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.186142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.186415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.186695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.186843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.187002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.187147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.187171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.187306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.187441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.187469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.187617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.187740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.187765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.187877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.188175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.188437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.188666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.188830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.188938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.189211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.189534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.189848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.189983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.190117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.190231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.190256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.190397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.190530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.190557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.190658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.190767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.190796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.190962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.191117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.191159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.191285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.191379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.191407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.191543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.191681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.191712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.191862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.192019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.833 [2024-11-26 01:20:45.192061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.833 qpair failed and we were unable to recover it. 00:27:54.833 [2024-11-26 01:20:45.192194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.192299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.192327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.192425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.192589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.192616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.192733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.192863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.192888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.193067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.193197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.193224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.193356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.193491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.193518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.193658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.193799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.193825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.193985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.194314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.194629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.194877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.194980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.195148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.195459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.195755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.195901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.195995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.196340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.196589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.196799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.196948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.197043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.197155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.197180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.197317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.197450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.197478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.197618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.197767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.197793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.197917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.198205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.198523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.198821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.198975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.199108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.199200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.199243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.199355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.199518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.199546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.199642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.199830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.199856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.199970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.200083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.200108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.200228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.200373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.834 [2024-11-26 01:20:45.200398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.834 qpair failed and we were unable to recover it. 00:27:54.834 [2024-11-26 01:20:45.200522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.200653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.200679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.200834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.200933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.200961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.201165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.201297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.201322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.201446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.201536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.201561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.201698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.201858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.201885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.201987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.202276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.202551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.202844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.202995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.203136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.203440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.203716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.203867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.203967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.204256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.204502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.204812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.204936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.205029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.205168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.205196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.205338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.205469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.205497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.205623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.205718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.205749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.205856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.206150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.206454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.206729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.206881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.207019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.207127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.207156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.207292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.207413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.207438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.835 qpair failed and we were unable to recover it. 00:27:54.835 [2024-11-26 01:20:45.207578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.207751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.835 [2024-11-26 01:20:45.207776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.207885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.208221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.208528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.208813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.208930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.209061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.209291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.209522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.209816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.209958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.210056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.210211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.210239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.210408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.210499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.210525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.210648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.210756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.210793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.210926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.211222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.211554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.211828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.211959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.212081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.212180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.212206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.212332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.212513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.212538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.212697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.212860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.212885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.213040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.213339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.213577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.213844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.213965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.214101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.214336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.214595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.214849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.214986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.215165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.215510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.836 qpair failed and we were unable to recover it. 00:27:54.836 [2024-11-26 01:20:45.215816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.836 [2024-11-26 01:20:45.215992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.216114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.216249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.216275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.216427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.216518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.216544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.216698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.216858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.216891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.217019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.217153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.217181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.217306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.217459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.217485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.217632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.217757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.217803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.218005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.218158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.218190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.218377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.218542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.218592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.218741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.218867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.218894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.219082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.219196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.219224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.219366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.219526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.219552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.219675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.219781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.219806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.219958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.220267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.220537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.220799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.220936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.221065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.221178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.221206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.221339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.221454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.221484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.221662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.221825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.221851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.221990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.222135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.222176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.222338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.222467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.222495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.222660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.222799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.222825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.222926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.223239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.223551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.223851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.223990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.224018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.224141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.224298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.224324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.224539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.224674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.224709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.837 qpair failed and we were unable to recover it. 00:27:54.837 [2024-11-26 01:20:45.224851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.837 [2024-11-26 01:20:45.224980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.225168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.225474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.225801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.225927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.226076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.226184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.226210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.226336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.226466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.226492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.226631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.226756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.226784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.226914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.227228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.227494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.227739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.227870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.227980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.228197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.228421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.228753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.228876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.228991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.229121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.229147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.229262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.229389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.229424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.229563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.229684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.229724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.229877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.230229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.230478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.230711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.230902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.231041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.231178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.231205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.231379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.231487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.231511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.231659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.231760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.231789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.231920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.232208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.232499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.838 qpair failed and we were unable to recover it. 00:27:54.838 [2024-11-26 01:20:45.232819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.838 [2024-11-26 01:20:45.232965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.233133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.233233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.233258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.233378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.233515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.233543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.233690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.233815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.233840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.233993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.234266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.234568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.234902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.234992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.235173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.235447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.235717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.235884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.236033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.236327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.236578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.236824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.236977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.237126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.237268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.237293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.237439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.237558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.237582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.237676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.237821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.237849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.238000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.238294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.238581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.238843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.238982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.239170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.239454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.239771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.239940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.240066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.240192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.240219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.240312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.240458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.240486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.839 qpair failed and we were unable to recover it. 00:27:54.839 [2024-11-26 01:20:45.240626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.240770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.839 [2024-11-26 01:20:45.240796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.240932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.241057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.241081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.241208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.241381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.241409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.241542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.241703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.241742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.241879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.242189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.242522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.242887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.242980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.243119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.243421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.243697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.243852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.244030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.244176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.244204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.244357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.244490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.244516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.244608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.244730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.244756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.244921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.245224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.245557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.245816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.245981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.246137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.246245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.246274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.246398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.246563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.246588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.246675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.246808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.246833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.246982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.247262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.247497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.247770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.247941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.248062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.248188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.248213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.248330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.248444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.248472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.840 qpair failed and we were unable to recover it. 00:27:54.840 [2024-11-26 01:20:45.248621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.840 [2024-11-26 01:20:45.248732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.248762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.248878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.248998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.249167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.249458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.249768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.249897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.250051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.250296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.250618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.250841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.250987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.251154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.251323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.251351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.251504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.251631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.251657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.251805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.251958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.251990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.252124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.252264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.252293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.252439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.252567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.252593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.252781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.252889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.252919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.253086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.253228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.253256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.253377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.253499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.253524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.253668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.253825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.253850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.253976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.254230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.254476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.254782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.254899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.254993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.255110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.255135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.255289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.255428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.255457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.255571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.255703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.255732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.255887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.256183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.256454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.256714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.256844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.841 qpair failed and we were unable to recover it. 00:27:54.841 [2024-11-26 01:20:45.256976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.841 [2024-11-26 01:20:45.257155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.257325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.257610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.257843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.257969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.258093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.258309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.258563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.258816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.258974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.259104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.259212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.259239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.259348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.259439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.259465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.259592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.259709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.259736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.259883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.260167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.260415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.260663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.260821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.260917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.261199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.261476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.261717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.261848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.261964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.262227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.262522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.262793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.262921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.263015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.263241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.263506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.263805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.263924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.264054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.264208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.264233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.264352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.264451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.264476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.842 qpair failed and we were unable to recover it. 00:27:54.842 [2024-11-26 01:20:45.264580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.842 [2024-11-26 01:20:45.264729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.264755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.264878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.265209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.265455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.265713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.265872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.266002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.266336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.266578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.266823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.266972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.267086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.267209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.267234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.267379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.267527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.267553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.267681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.267789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.267814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.267904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.268114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.268333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.268623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.268767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.268892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.269210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.269513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.269770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.269917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.270086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.270206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.270231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.270345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.270468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.270494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.270600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.270714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.270746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.271030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.271311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.271602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.271866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.271992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.272017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.272118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.272212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.272238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.272366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.272458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.272482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.843 qpair failed and we were unable to recover it. 00:27:54.843 [2024-11-26 01:20:45.272581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.843 [2024-11-26 01:20:45.272663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.272693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.272803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.272928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.272953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.273048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.273269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.273512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.273764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.273894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.273998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.274298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.274541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.274786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.274906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.275012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.275130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.275155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.275306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.275447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.275479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.275598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.275717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.275752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.275902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.276187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.276450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.276702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.276843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.276949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.277242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.277534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.277769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.277891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.278006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.278315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.278562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.844 [2024-11-26 01:20:45.278836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.844 [2024-11-26 01:20:45.278976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.844 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.279129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.279395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.279611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.279880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.279971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.280144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.280422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.280741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.280867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.281030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.281297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.281618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.281861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.281973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.282097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.282250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.282277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.282398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.282523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.282548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.282692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.282849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.282874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.283014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.283137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.283165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.283307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.283475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.283517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.283668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.283805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.283830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.283934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.284228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.284512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.284794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.284923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.285021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.285285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.285595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.285863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.285989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.286138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.286367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.286653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.286793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.845 [2024-11-26 01:20:45.286950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.287044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.845 [2024-11-26 01:20:45.287069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.845 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.287196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.287326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.287354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.287528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.287643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.287668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.287776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.287923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.287948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.288091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.288220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.288248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.288370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.288462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.288486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.288607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.288708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.288763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.288882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.289198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.289489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.289761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.289889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.290078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.290202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.290243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.290385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.290491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.290518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.290683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.290817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.290845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.290987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.291231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.291526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.291846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.291966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.292104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.292268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.292295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.292395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.292486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.292518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.292671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.292807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.292832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.293018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.293140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.293166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.293255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.293355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.293380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.293544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.293696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.293738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.293897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.294172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.294492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.294774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.294920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.295012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.295161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.295186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.846 [2024-11-26 01:20:45.295281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.295400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.846 [2024-11-26 01:20:45.295426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.846 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.295548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.295679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.295729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.295861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.295962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.295987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.296117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.296211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.296237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.296371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.296504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.296531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.296634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.296759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.296803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.296907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.297191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.297438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.297777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.297901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.298024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.298289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.298511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.298759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.298873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.299036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.299349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.299593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.299818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.299959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.300092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.300221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.300246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.300374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.300471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.300497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.300643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.300784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.300813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.300934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.301235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.301566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.301850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.301975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.302064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.302219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.302247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.302383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.302542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.302570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.302705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.302835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.302859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.302974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.303106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.303134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.847 [2024-11-26 01:20:45.303272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.303394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.847 [2024-11-26 01:20:45.303419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.847 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.303517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.303610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.303636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.303757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.303910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.303934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.304053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.304366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.304631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.304878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.304994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.305197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.305526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.305839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.305994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.306107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.306233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.306257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.306379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.306543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.306571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.306673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.306821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.306854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.306993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.307290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.307590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.307901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.307983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.308128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.308413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.308750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.308917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.309063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.309332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.309576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.309839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.309995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.310111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.310414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.310639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.310806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.310971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.311105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.311133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.311304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.311424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.848 [2024-11-26 01:20:45.311448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.848 qpair failed and we were unable to recover it. 00:27:54.848 [2024-11-26 01:20:45.311604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.311698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.311725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.311812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.311942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.311982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.312088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.312241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.312266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.312380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.312556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.312580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.312696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.312821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.312846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.312967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.313095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.313120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.313262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.313440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.313466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.313563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.313729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.313759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.313884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.314172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.314413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.314724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.314899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.315014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.315284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.315590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.315866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.315991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.316186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.316482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.316733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.316911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.317077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.317173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.317200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.317353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.317471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.317496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.317637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.317794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.317823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.317977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.318100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.318125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.318246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.318366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.318390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.318537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.318676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.318714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.849 qpair failed and we were unable to recover it. 00:27:54.849 [2024-11-26 01:20:45.318851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.319012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.849 [2024-11-26 01:20:45.319041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.319169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.319285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.319310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.319398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.319514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.319539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.319666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.319773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.319798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.319923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.320191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.320546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.320798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.320918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.321003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.321125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.321150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.321268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.321425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.321458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.321629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.321723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.321749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.321897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.322220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.322533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.322819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.322992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.323138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.323262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.323287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.323438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.323523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.323547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.323669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.323813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.323838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.323960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.324214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.324464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.324698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.324866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.325023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.325269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.325606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.325865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.325994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.326164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.326460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.326702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.326853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.850 qpair failed and we were unable to recover it. 00:27:54.850 [2024-11-26 01:20:45.326997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.327126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.850 [2024-11-26 01:20:45.327154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.327303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.327425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.327450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.327554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.327652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.327679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.327832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.327958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.327985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.328156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.328265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.328292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.328419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.328510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.328535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.328633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.328769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.328797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.328938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.329204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.329472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.329760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.329930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.330051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.330288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.330579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.330832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.330946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.331054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.331217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.331244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.331402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.331524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.331549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:54.851 qpair failed and we were unable to recover it. 00:27:54.851 [2024-11-26 01:20:45.331641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.331767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:54.851 [2024-11-26 01:20:45.331792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.331917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.332150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.332472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.332730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.332870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.332989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.333273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.333542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.333839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.333977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.334129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.334448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.334729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.334865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.334989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.335244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.335506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.335822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.335987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.336105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.336383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.336668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.336902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.336995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.337192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.337497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.337758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.337903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.131 [2024-11-26 01:20:45.338028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.338177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.131 [2024-11-26 01:20:45.338202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.131 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.338327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.338477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.338522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.338701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.338864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.338892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.339055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.339155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.339182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.339353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.339501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.339544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.339680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.339841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.339866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.339994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.340129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.340171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.340319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.340469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.340494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.340644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.340750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.340778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.340880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.341214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.341458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.341760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.341925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.342076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.342196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.342221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.342367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.342481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.342508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.342619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.342780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.342809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.342980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.343212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.343512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.343818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.343951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.344050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.344203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.344228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.344349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.344447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.344475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.344607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.344753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.344779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.344953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.345185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.345508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.345823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.345955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.346113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.346247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.346275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.346367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.346528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.346553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.132 qpair failed and we were unable to recover it. 00:27:55.132 [2024-11-26 01:20:45.346652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.346776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.132 [2024-11-26 01:20:45.346806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.346937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.347248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.347465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.347743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.347906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.348053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.348212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.348236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.348405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.348565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.348592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.348741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.348830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.348855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.348981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.349235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.349538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.349823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.349950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.350063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.350184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.350228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.350383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.350539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.350564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.350722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.350811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.350836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.350983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.351115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.351144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.351288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.351411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.351435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.351553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.351700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.351727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.351885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.352203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.352477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.352733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.352888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.353055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.353335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.353602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.353839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.353966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.354088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.354234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.354260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.354435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.354565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.354593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.354699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.354845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.354869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.133 qpair failed and we were unable to recover it. 00:27:55.133 [2024-11-26 01:20:45.354997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.133 [2024-11-26 01:20:45.355148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.355189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.355315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.355438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.355465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.355644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.355786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.355813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.356003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.356123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.356164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.356326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.356450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.356478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.356647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.356764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.356793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.356967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.357262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.357549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.357807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.357985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.358123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.358220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.358248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.358382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.358543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.358571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.358691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.358816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.358841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.358958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.359092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.359121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.359282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.359418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.359446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.359564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.359725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.359761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.359937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.360236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.360540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.360822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.360968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.361110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.361248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.361276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.361428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.361552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.361577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.361725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.361815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.361841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.361941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.362192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.362446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.362720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.362838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.362940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.363060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.363085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.363260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.363406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.363432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.134 qpair failed and we were unable to recover it. 00:27:55.134 [2024-11-26 01:20:45.363528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.134 [2024-11-26 01:20:45.363652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.363676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.363838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.363971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.364155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.364484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.364803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.364924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.365049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.365201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.365228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.365340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.365479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.365507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.365647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.365773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.365798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.365974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.366254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.366535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.366833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.366975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.367135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.367440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.367717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.367883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.368023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.368173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.368198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.368347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.368462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.368492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.368635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.368783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.368809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.368929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.369164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.369451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.369763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.369909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.370030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.370151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.370176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.370345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.370450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.370478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.135 [2024-11-26 01:20:45.370588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.370718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.135 [2024-11-26 01:20:45.370762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.135 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.370883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.371184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.371421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.371683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.371883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.372004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.372149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.372193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.372315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.372471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.372514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.372609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.372730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.372757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.372885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.373132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.373390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.373692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.373889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.374004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.374278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.374608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.374830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.374990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.375128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.375258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.375285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.375447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.375582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.375610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.375734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.375854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.375879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.376011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.376308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.376602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.376861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.376987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.377125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.377245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.377273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.377409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.377543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.377571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.377758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.377887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.377912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.378017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.378132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.378157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.378305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.378470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.378498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.378601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.378750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.378776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.136 qpair failed and we were unable to recover it. 00:27:55.136 [2024-11-26 01:20:45.378938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.136 [2024-11-26 01:20:45.379026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.379204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.379494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.379827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.379947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.380082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.380211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.380238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.380376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.380553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.380580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.380700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.380799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.380824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.380970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.381115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.381144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.381270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.381407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.381435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.381602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.381724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.381750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.381883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.382159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.382490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.382795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.382945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.383092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.383223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.383252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.383395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.383545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.383570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.383666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.383772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.383798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.383920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.384258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.384515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.384794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.384940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.385074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.385248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.385296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.385411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.385585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.385611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.385743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.385870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.385896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.386100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.386324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.386378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.386522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.386693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.386737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.386863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.386967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.386994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.387152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.387356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.387386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.387519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.387661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.387706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.137 qpair failed and we were unable to recover it. 00:27:55.137 [2024-11-26 01:20:45.387827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.137 [2024-11-26 01:20:45.387998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.388184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.388541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.388792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.388922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.389057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.389192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.389220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.389322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.389491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.389520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.389629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.389783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.389811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.389914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.390107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.390154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.390301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.390462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.390505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.390629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.390762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.390789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.390935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.391262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.391575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.391832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.391982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.392162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.392443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.392762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.392905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.393019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.393264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.393489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.393747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.393874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.393977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.394285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.394596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.394842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.394975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.395113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.395242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.395275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.395430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.395578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.395607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.395758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.395882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.395907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.138 qpair failed and we were unable to recover it. 00:27:55.138 [2024-11-26 01:20:45.396014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.396121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.138 [2024-11-26 01:20:45.396149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.396252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.396354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.396382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.396514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.396624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.396652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.396773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.396926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.396952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.397068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.397227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.397254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.397358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.397489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.397517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.397663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.397799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.397825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.397919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.398074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.398102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.398269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.398434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.398463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.398606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.398751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.398778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.398893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.399002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.399032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.399181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.399324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.399352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.399584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.399717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.399759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.399863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.400168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.400490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.400813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.400935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.401109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.401212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.401241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.401412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.401550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.401578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.401695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.401838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.401863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.401972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.402110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.402139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.402300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.402425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.402450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.402605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.402759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.402786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.402880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.403213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.403478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.403800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.403940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.404076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.404191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.404217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.404370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.404492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.404517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.139 qpair failed and we were unable to recover it. 00:27:55.139 [2024-11-26 01:20:45.404630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.139 [2024-11-26 01:20:45.404767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.404796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.404913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.405182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.405473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.405785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.405937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.406070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.406340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.406640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.406889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.406986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.407110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.407381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.407650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.407850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.407963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.408107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.408135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.408314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.408431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.408474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.408575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.408705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.408734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.408880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.409185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.409486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.409775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.409907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.410042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.410134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.410163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.410336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.410428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.410456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.410554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.410718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.410747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.410918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.411011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.411036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.411182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.411311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.411340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.140 [2024-11-26 01:20:45.411476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.411572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.140 [2024-11-26 01:20:45.411600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.140 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.411754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.411884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.411909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.412028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.412199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.412224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.412320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.412468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.412493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.412614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.412741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.412767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.412878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.413215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.413517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.413775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.413974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.414102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.414205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.414233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.414400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.414514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.414539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.414716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.414850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.414878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.415012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.415144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.415171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.415314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.415434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.415459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.415574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.415714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.415743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.415916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.416157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.416395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.416702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.416894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.417040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.417324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.417575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.417862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.417979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.418151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.418459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.418720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.418865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.419017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.419147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.419175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.419289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.419381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.419409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.419568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.419697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.141 [2024-11-26 01:20:45.419724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.141 qpair failed and we were unable to recover it. 00:27:55.141 [2024-11-26 01:20:45.419832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.419930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.419972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.420105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.420203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.420230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.420344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.420461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.420486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.420586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.420715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.420758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.420853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.421128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.421362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.421669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.421854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.421970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.422272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.422593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.422884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.422989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.423176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.423481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.423733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.423883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.424033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.424211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.424235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.424327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.424460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.424485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.424622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.424746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.424777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.424897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.425173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.425459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.425719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.425877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.426006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.426136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.426164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.426317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.426438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.426465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.426577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.426722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.426748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.426867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.427145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.427398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.427719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.142 [2024-11-26 01:20:45.427916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.142 qpair failed and we were unable to recover it. 00:27:55.142 [2024-11-26 01:20:45.428042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.428165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.428191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.428285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.428426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.428455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.428553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.428709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.428738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.428915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.429187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.429478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.429786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.429929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.430063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.430188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.430216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.430329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.430467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.430496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.430666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.430795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.430821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.430969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.431077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.431106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.431242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.431413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.431442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.431591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.431722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.431748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.431902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.432224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.432536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.432791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.432965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.433128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.433257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.433285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.433403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.433498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.433523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.433657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.433784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.433810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.433904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.434206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.434518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.434802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.434930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.435085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.435210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.435236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.435385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.435487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.435512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.435638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.435832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.435861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.435985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.436082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.436107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.436255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.436398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.143 [2024-11-26 01:20:45.436426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.143 qpair failed and we were unable to recover it. 00:27:55.143 [2024-11-26 01:20:45.436586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.436697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.436727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.436849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.436972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.436997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.437164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.437299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.437326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.437439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.437583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.437611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.437774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.437901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.437926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.438081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.438186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.438215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.438321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.438425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.438453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.438592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.438765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.438791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.438911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.439073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.439099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.439247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.439360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.439388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.439557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.439661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.439727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.439862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.440182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.440456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.440741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.440916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.441062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.441190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.441215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.441333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.441456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.441482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.441620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.441748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.441777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.441895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.442132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.442415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.442712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.442903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.443013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.443164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.443189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.443360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.443520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.443547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.443697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.443818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.443843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.144 [2024-11-26 01:20:45.444044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.444132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.144 [2024-11-26 01:20:45.444157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.144 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.444249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.444375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.444400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.444523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.444692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.444721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.444838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.444965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.444990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.445139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.445267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.445294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.445420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.445554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.445581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.445737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.445856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.445881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.445991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.446194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.446220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.446347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.446530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.446558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.446704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.446832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.446857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.446954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.447197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.447521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.447859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.447975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.448137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.448442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.448667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.448906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.449061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.449191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.449216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.449416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.449583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.449612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.449741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.449839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.449868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.450017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.450143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.450168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.450368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.450534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.450562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.450696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.450902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.450930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.451062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.451202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.451230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.451370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.451522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.451547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.451750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.451908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.451936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.452044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.452293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.452521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.145 qpair failed and we were unable to recover it. 00:27:55.145 [2024-11-26 01:20:45.452823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.145 [2024-11-26 01:20:45.452959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.453108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.453229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.453254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.453371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.453510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.453536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.453629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.453743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.453770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.453899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.454210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.454535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.454824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.454980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.455124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.455288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.455315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.455451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.455575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.455602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.455733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.455832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.455857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.455970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.456260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.456492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.456822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.456950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.457061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.457194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.457222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.457362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.457456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.457481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.457619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.457727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.457760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.457875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.458208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.458482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.458821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.458986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.459158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.459283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.459308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.459490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.459628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.459656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.459803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.459904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.459929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.460035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.460153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.460178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.460316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.460457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.460485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.460670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.460773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.460798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.460929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.461081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.461106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.146 qpair failed and we were unable to recover it. 00:27:55.146 [2024-11-26 01:20:45.461287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.461395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.146 [2024-11-26 01:20:45.461422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.461557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.461700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.461730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.461853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.461989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.462154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.462488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.462752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.462906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.462997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.463121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.463147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.463274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.463414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.463441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.463557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.463708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.463733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.463893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.464198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.464457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.464724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.464871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.464973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.465115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.465158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.465254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.465378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.465405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.465552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.465696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.465740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.465867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.466172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.466456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.466778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.466906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.467013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.467278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.467542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.467875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.467975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.468138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.468472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.468759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.468886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.469007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.469130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.469157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.469281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.469378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.469404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.147 qpair failed and we were unable to recover it. 00:27:55.147 [2024-11-26 01:20:45.469557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.147 [2024-11-26 01:20:45.469730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.469759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.469894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.470215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.470512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.470803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.470993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.471086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.471180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.471208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.471329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.471448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.471473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.471591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.471742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.471769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.471913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.472202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.472505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.472798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.472975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.473124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.473243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.473268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.473418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.473528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.473555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.473738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.473862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.473887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.474005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.474120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.474146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.474288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.474418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.474446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.474585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.474744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.474773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.474913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.475175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.475437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.475727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.475884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.475979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.476213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.476486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.476789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.476950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.477085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.477246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.477274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.477419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.477552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.477577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.148 qpair failed and we were unable to recover it. 00:27:55.148 [2024-11-26 01:20:45.477712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.477865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.148 [2024-11-26 01:20:45.477890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.478015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.478105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.478130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.478295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.478429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.478454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.478611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.478714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.478743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.478905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.479238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.479514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.479845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.479985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.480075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.480221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.480245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.480395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.480536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.480564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.480714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.480837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.480863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.480967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.481283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.481594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.481893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.481994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.482135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.482380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.482697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.482844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.482949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.483278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.483566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.483824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.483948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.484047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.484169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.484194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.484330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.484458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.484484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.484677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.484821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.484847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.484967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.485099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.149 [2024-11-26 01:20:45.485127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.149 qpair failed and we were unable to recover it. 00:27:55.149 [2024-11-26 01:20:45.485273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.485392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.485418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.485560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.485700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.485730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.485841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.485968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.485996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.486142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.486240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.486267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.486401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.486559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.486587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.486757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.486893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.486918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.487042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.487142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.487167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.487288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.487441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.487469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.487603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.487707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.487750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.487904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.488204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.488474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.488763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.488890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.489025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.489291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.489590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.489830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.489958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.490082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.490205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.490235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.490385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.490473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.490498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.490621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.490754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.490784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.490929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.491206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.491506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.491792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.491983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.492108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.492224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.492250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.492350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.492499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.492524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.492675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.492795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.492823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.492996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.493117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.493141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.493304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.493458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.150 [2024-11-26 01:20:45.493482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.150 qpair failed and we were unable to recover it. 00:27:55.150 [2024-11-26 01:20:45.493606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.493740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.493765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.493890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.494218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.494528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.494820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.494969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.495060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.495182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.495207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.495331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.495456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.495483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.495604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.495758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.495784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.495907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.496134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.496411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.496706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.496875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.497010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.497152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.497177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.497326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.497469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.497612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.497770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.497799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.497926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.498194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.498447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.498750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.498888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.499050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.499173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.499214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.499374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.499506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.499533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.499721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.499821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.499846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.499943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.500185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.500475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.500720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.500872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.500992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.501159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.501187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.501295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.501402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.501429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.501578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.501708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.151 [2024-11-26 01:20:45.501734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.151 qpair failed and we were unable to recover it. 00:27:55.151 [2024-11-26 01:20:45.501842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.501985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.502140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.502439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.502757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.502906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.503016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.503114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.503144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.503299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.503422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.503447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.503585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.503711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.503741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.503877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.504177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.504489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.504819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.504996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.505118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.505235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.505260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.505358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.505502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.505530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.505676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.505824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.505850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.505984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.506278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.506589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.506842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.506952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.507094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.507238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.507263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.507394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.507515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.507541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.507671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.507771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.507798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.507918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.508216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.508525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.508867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.508999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.509130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.509288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.509316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.509433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.509534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.509559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.509706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.509856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.509881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.510009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.510098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.152 [2024-11-26 01:20:45.510139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.152 qpair failed and we were unable to recover it. 00:27:55.152 [2024-11-26 01:20:45.510286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.510433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.510458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.510617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.510711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.510740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.510875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.511188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.511428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.511725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.511850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.511995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.512260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.512585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.512882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.512980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.513127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.513406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.513763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.513882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.513984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.514257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.514519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.514806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.514980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.515105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.515208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.515236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.515404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.515531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.515557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.515705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.515853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.515879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.515976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.516117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.516146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.516291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.516411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.516436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.516575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.516714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.516744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.516883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.517188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.517475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.517755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.517905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.518034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.518123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.518149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.153 [2024-11-26 01:20:45.518282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.518424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.153 [2024-11-26 01:20:45.518448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.153 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.518597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.518738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.518767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.518891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.519160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.519479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.519739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.519868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.520014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.520146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.520174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.520272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.520426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.520452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.520582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.520769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.520795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.520919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.521172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.521481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.521775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.521908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.522071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.522216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.522241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.522391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.522481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.522506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.522656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.522783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.522813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.522916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.523230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.523556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.523864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.523980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.524138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.524404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.524731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.524904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.525049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.525311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.525575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.154 qpair failed and we were unable to recover it. 00:27:55.154 [2024-11-26 01:20:45.525875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.154 [2024-11-26 01:20:45.525994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.526143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.526396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.526742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.526895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.527044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.527134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.527160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.527256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.527371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.527396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.527553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.527708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.527734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.527858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.528008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.528034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.528187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.528295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.528324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.528536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.528722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.528773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.528907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.529210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.529481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.529707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.529840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.529937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.530200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.530452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.530678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.530852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.530976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.531267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.531606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.531852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.531971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.532092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.532217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.532242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.532343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.532510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.532539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.532679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.532821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.532862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.533000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.533296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.533522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.533837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.533959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.155 qpair failed and we were unable to recover it. 00:27:55.155 [2024-11-26 01:20:45.534113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.155 [2024-11-26 01:20:45.534233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.534263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.534381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.534506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.534532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.534616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.534734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.534760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.534899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.534995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.535178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.535472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.535755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.535885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.535973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.536122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.536147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.536327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.536452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.536477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.536617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.536825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.536855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.537028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.537131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.537161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.537301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.537420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.537447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.537581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.537724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.537753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.537901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.538209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.538503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.538792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.538914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.539006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.539097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.539122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.539214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.539366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.539393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.539544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.539744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.539770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.539931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.540228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.540490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.540832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.540971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.541172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.541335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.541363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.541507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.541630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.541656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.541825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.541926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.541953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.542075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.542203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.542228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.542379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.542473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.542498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.156 qpair failed and we were unable to recover it. 00:27:55.156 [2024-11-26 01:20:45.542587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.542705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.156 [2024-11-26 01:20:45.542731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.542876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.543217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.543536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.543809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.543945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.544093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.544178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.544204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.544320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.544428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.544456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.544565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.544701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.544730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.544883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.545009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.545035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.545153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.545360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.545387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.545525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.545694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.545723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.545901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.546182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.546539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.546888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.546985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.547193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.547526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.547821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.547929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.548053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.548200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.548227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.548371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.548491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.548516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.548639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.548753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.548796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.548901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.549088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.549113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.549239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.549361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.549389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.549534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.549692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.549718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.549866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.550135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.550344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.550669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.550808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.550923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.551038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.551064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.157 qpair failed and we were unable to recover it. 00:27:55.157 [2024-11-26 01:20:45.551187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.157 [2024-11-26 01:20:45.551270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.551295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.551438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.551588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.551613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.551743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.551884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.551913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.552029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.552151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.552183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.552296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.552422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.552450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.552597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.552705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.552734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.552882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.553216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.553467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.553821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.553970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.554084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.554226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.554252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.554391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.554527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.554554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.554726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.554855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.554880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.554967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.555092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.555117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.555273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.555434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.555462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.555572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.555705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.555760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.555897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.556243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.556489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.556780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.556962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.557095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.557196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.557224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.557363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.557484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.557508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.557629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.557759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.557788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.557932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.558055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.558080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.558237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.558334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.558359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.158 qpair failed and we were unable to recover it. 00:27:55.158 [2024-11-26 01:20:45.558483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.158 [2024-11-26 01:20:45.558625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.558652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.558796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.558894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.558920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.559069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.559157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.559182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.559290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.559399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.559429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.559589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.559733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.559761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.559929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.560160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.560385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.560630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.560892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.560993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.561123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.561370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.561618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.561846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.561970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.562089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.562240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.562265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.562365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.562504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.562531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.562649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.562791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.562817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.562920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.563170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.563384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.563641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.563872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.563994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.564119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.564391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.564660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.564821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.564919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.565163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.565425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.565699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.159 [2024-11-26 01:20:45.565850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.159 qpair failed and we were unable to recover it. 00:27:55.159 [2024-11-26 01:20:45.565947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.566184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.566423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.566635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.566872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.566991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.567085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.567313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.567555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.567842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.567997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.568129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.568255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.568280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.568377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.568466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.568491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.568623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.568742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.568767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.568885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.569199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.569448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.569697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.569849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.569941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.570218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.570524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.570801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.570927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.571077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.571351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.571592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.571823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.571965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.572068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.572344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.572605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.572848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.572968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.573120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.573222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.160 [2024-11-26 01:20:45.573247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.160 qpair failed and we were unable to recover it. 00:27:55.160 [2024-11-26 01:20:45.573368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.573495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.573520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.573613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.573735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.573760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.573858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.573953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.573979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.574073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.574304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.574519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.574826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.574971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.575103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.575379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.575591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.575861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.575990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.576114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.576325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.576597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.576870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.576996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.577122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.577276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.577302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.577426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.577560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.577585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.577682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.577824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.577850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.577943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.578255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.578481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.578726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.578912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.579063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.579339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.579611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.579870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.579994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.580136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.580383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.161 [2024-11-26 01:20:45.580657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.161 [2024-11-26 01:20:45.580808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.161 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.580923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.581221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.581490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.581732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.581851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.582053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.582331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.582630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.582861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.582979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.583095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.583210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.583234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.583367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.583483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.583508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.583633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.583729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.583755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.583863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.584132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.584404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.584655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.584814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.584914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.585222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.585495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.585756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.585910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.586070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.586200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.586225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.586347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.586504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.586529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.586625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.586724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.586749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.586873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.587125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.587359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.587597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.587849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.587997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.588121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.588246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.588272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.162 [2024-11-26 01:20:45.588364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.588515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.162 [2024-11-26 01:20:45.588541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.162 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.588660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.588764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.588791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.588920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.589183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.589473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.589696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.589823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.589988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.590344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.590574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.590839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.590986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.591135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.591349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.591587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.591824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.591976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.592100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.592341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.592574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.592889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.592985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.593154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.593430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.593683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.593850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.593977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.594197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.594475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.594751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.594866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.594972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.595058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.595083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.163 qpair failed and we were unable to recover it. 00:27:55.163 [2024-11-26 01:20:45.595183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.595283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.163 [2024-11-26 01:20:45.595313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.595404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.595495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.595521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.595755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.595876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.595901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.596029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.596293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.596547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.596792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.596941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.597035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.597257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.597507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.597755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.597929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.598064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.598323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.598600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.598854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.598974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.599092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.599368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.599613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.599851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.599982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.600131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.600433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.600704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.600829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.600966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.601174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.601415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.601710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.601828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.601925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.602166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.602437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.164 qpair failed and we were unable to recover it. 00:27:55.164 [2024-11-26 01:20:45.602680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.164 [2024-11-26 01:20:45.602805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.602832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.602937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.603155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.603458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.603757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.603903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.604020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.604324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.604544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.604793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.604917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.605065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.605235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.605263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.605408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.605492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.605517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.605637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.605766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.605792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.605923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.606193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.606435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.606675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.606800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.606894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.607155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.607469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.607705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.607852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.607991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.608290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.608533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.608777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.608894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.608993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.609253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.609528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.609776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.609900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.609996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.610139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.610167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.165 qpair failed and we were unable to recover it. 00:27:55.165 [2024-11-26 01:20:45.610305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.165 [2024-11-26 01:20:45.610465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.610494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.610641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.610735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.610762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.610897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.610990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.611140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.611439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.611682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.611863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.611961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.612178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.612467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.612747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.612895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.612983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.613133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.613157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.613297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.613406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.613435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.613595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.613770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.613796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.613890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.614154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.614423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.614671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.614813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.614909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.615175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.615454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.615735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.615877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.616029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.616272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.616541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.616856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.616977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.617141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.617281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.617306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.617455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.617549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.617577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.617736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.617885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.617911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.618086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.618214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.166 [2024-11-26 01:20:45.618239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.166 qpair failed and we were unable to recover it. 00:27:55.166 [2024-11-26 01:20:45.618330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.618416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.618441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.618580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.618762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.618788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.618912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.619121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.619366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.619615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.619862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.619997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.620125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.620466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.620785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.620925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.621029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.621139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.621167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.621305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.621410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.621436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.621552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.621714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.621741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.621893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.622168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.622427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.622684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.622885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.623010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.623160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.623186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.623315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.623474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.623501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.623638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.623801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.623830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.623951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.624227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.624517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.624768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.624883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.625017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.625160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.625186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.167 [2024-11-26 01:20:45.625314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.625433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.167 [2024-11-26 01:20:45.625463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.167 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.625589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.625682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.625715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.625833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.625925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.625950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.626117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.626299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.626324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.626441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.626597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.626622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.626749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.626845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.626871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.626992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.627259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.627499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.627772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.627895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.627988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.628103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.628128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.628250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.628382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.628410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.628575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.628725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.628754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.628892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.629193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.629416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.629725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.629899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.630045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.630183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.630211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.630351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.630514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.630542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.630664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.630806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.630832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.630963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.631285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.631600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.631853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.631966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.632139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.632279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.632308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.632422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.632515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.632540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.632643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.632765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.632794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.632900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.633062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.633090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.168 [2024-11-26 01:20:45.633237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.633364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.168 [2024-11-26 01:20:45.633389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.168 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.633536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.633676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.633713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.633824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.633958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.633988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.634119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.634257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.634283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.634408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.634507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.634550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.634696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.634792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.634817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.634944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.635168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.635499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.635757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.635902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.636009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.636312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.636578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.636828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.636981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.637106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.637204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.637239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.637353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.637488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.637516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.637614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.637735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.637764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.637894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.638130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.638371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.638698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.638850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.638997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.639231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.639492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.639765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.639943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.640046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.640253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.640541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.640851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.640992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.169 qpair failed and we were unable to recover it. 00:27:55.169 [2024-11-26 01:20:45.641175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.641281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.169 [2024-11-26 01:20:45.641317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.170 qpair failed and we were unable to recover it. 00:27:55.449 [2024-11-26 01:20:45.641444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.449 [2024-11-26 01:20:45.641552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.449 [2024-11-26 01:20:45.641577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.449 qpair failed and we were unable to recover it. 00:27:55.449 [2024-11-26 01:20:45.641677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.449 [2024-11-26 01:20:45.641822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.641847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.641978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.642260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.642531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.642790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.642912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.643024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.643325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.643543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.643779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.643929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.644073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.644210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.644237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.644410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.644508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.644533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.644662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.644794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.644821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.644954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.645292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.645569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.645834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.645990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.646107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.646206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.646231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.646378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.646525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.646553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.646699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.646791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.646816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.646916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.647203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.647498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.647763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.647886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.648005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.648264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.648566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.648823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.648977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.649099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.649190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.649215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.649311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.649406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.450 [2024-11-26 01:20:45.649431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.450 qpair failed and we were unable to recover it. 00:27:55.450 [2024-11-26 01:20:45.649527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.649717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.649759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.649882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.650142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.650374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.650609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.650775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.650970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.651095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.651135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.651272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.651397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.651424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.651595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.651736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.651766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.651906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.652180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.652446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.652752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.652922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.653032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.653318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.653578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.653853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.653985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.654101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.654232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.654260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.654408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.654533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.654559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.654712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.654832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.654857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.654979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.655299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.655570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.655825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.655945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.656042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.656307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.656586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.656851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.656974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.657061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.657210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.451 [2024-11-26 01:20:45.657238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.451 qpair failed and we were unable to recover it. 00:27:55.451 [2024-11-26 01:20:45.657373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.657548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.657572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.657658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.657772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.657798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.657904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.657992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.658117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.658333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.658634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.658770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.658892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.659155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.659437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.659775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.659888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.660007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.660259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.660538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.660822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.660938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.661068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.661159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.661184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.661361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.661544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.661572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.661709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.661883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.661909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.662079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.662202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.662227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.662381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.662469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.662493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.662702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.662874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.662900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.663028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.663250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.663489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.663828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.663981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.664141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.664254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.664282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.664402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.664505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.664530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.664679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.664857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.664885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.665034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.665170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.665210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.665357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.665446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.452 [2024-11-26 01:20:45.665471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.452 qpair failed and we were unable to recover it. 00:27:55.452 [2024-11-26 01:20:45.665605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.665731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.665758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.665879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.665970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.665995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.666091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.666227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.666253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.666368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.666520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.666546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.666639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.666776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.666805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.666907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.667239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.667524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.667812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.667993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.668105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.668245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.668273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.668415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.668534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.668559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.668698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.668833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.668859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.668980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.669275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.669608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.669849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.669997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.670146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.670278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.670306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.670408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.670545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.670572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.670732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.670833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.670858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.670967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.671200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.671520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.671822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.671947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.672032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.672179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.672204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.672373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.672473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.672502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.672602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.672783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.672809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.672934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.673059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.673085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.673237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.673388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.673413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.673559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.673699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.453 [2024-11-26 01:20:45.673728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.453 qpair failed and we were unable to recover it. 00:27:55.453 [2024-11-26 01:20:45.673914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.674153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.674389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.674668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.674818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.674952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.675238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.675484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.675730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.675846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.675964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.676112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.676140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.676261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.676429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.676454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.676647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.676779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.676805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.676931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.677183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.677494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.677800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.677909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.678032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.678205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.678234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.678383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.678480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.678506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.678637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.678736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.678762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.678881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.679164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.679436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.679752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.679897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.680078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.680195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.680220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.680377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.680532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.680557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.454 qpair failed and we were unable to recover it. 00:27:55.454 [2024-11-26 01:20:45.680749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.680846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.454 [2024-11-26 01:20:45.680871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.680982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.681259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.681471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.681711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.681827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.681956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.682239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.682520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.682816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.682973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.683113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.683263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.683288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.683410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.683564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.683605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.683767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.683937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.683965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.684122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.684259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.684287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.684429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.684525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.684551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.684712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.684862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.684887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.685064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.685168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.685198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.685364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.685491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.685520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.685654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.685799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.685843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.685990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.686282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.686562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.686813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.686959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.687085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.687232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.687274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.687414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.688353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.688388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.688555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.688702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.688732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.688869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.688956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.688981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.689184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.689327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.689356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.689502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.689635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.689664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.689814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.689983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.690008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.455 qpair failed and we were unable to recover it. 00:27:55.455 [2024-11-26 01:20:45.690161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.455 [2024-11-26 01:20:45.690278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.690304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.690400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.690527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.690553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.690674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.690827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.690855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.690997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.691131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.691166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.691343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.691462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.691487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.691610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.691737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.691763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.691887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.692212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.692459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.692762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.692910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.693081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.693288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.693316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.693456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.693591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.693619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.693771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.693901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.693927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.694055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.694306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.694587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.694849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.694997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.695112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.695267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.695315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.695442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.695621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.695646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.695791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.695907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.695935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.696063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.696211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.696236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.696359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.696442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.696467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.696606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.696759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.696785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.696910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.697167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.697455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.697723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.456 [2024-11-26 01:20:45.697889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.456 qpair failed and we were unable to recover it. 00:27:55.456 [2024-11-26 01:20:45.698021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.698341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.698594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.698869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.698999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.699108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.699256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.699281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.699431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.699542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.699570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.699680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.699778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.699804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.699926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.700180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.700461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.700740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.700914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.701036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.701253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.701546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.701824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.701945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.702117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.702253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.702281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.702434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.702591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.702619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.702776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.702901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.702927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.703025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.703283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.703535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.703828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.703952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.704058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.704304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.704543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.704796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.704952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.705049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.705190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.705216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.705341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.705477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.705506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.457 qpair failed and we were unable to recover it. 00:27:55.457 [2024-11-26 01:20:45.705636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.705758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.457 [2024-11-26 01:20:45.705784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.705873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.705964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.705989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.706109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.706213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.706238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.706390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.706478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.706503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.706641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.706832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.706857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.706959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.707164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.707427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.707647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.707830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.707951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.708224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.708519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.708808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.708939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.709069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.709190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.709215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.709366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.709501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.709548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.709651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.709785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.709814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.709921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.710236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.710495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.710779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.710903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.711054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.711158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.711184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.711226] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a0d600 (9): Bad file descriptor 00:27:55.458 [2024-11-26 01:20:45.711416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.711538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.711571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.711715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.711863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.711889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.711992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.712255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.712553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.712780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.712931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.713047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.713192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.713217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.713388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.713521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.458 [2024-11-26 01:20:45.713549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.458 qpair failed and we were unable to recover it. 00:27:55.458 [2024-11-26 01:20:45.713680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.713801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.713827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.713949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.714217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.714443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.714704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.714856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.714981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.715284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.715585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.715809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.715932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.716062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.716184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.716209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.716322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.716449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.716477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.716597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.716756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.716782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.716927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.717177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.717399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.717743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.717900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.718023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.718166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.718194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.718305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.718437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.718479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.718641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.718766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.718792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.718942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.719176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.719486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.719812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.719932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.720081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.720230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.720256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.720357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.720446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.720472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.459 qpair failed and we were unable to recover it. 00:27:55.459 [2024-11-26 01:20:45.720569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.720699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.459 [2024-11-26 01:20:45.720729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.720841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.720944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.720970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.721153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.721298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.721339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.721476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.721572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.721600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.721752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.721850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.721875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.722046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.722195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.722220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.722344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.722472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.722497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.722651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.722766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.722804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.722962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.723248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.723562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.723858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.723977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.724096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.724223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.724249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.724376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.724481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.724509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.724640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.724752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.724778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.724901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.725179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.725465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.725745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.725893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.726013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.726262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.726592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.726846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.726968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.727152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.727409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.727695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.727847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.727992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.728151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.728179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.728316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.728496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.728521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.728644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.728733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.728758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.460 qpair failed and we were unable to recover it. 00:27:55.460 [2024-11-26 01:20:45.728855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.460 [2024-11-26 01:20:45.729003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.729140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.729473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.729708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.729856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.729947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.730159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.730446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.730795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.730941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.731068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.731210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.731238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.731409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.731536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.731561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.731656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.731812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.731837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.731975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.732267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.732565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.732837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.732964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.733088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.733189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.733216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.733368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.733491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.733517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.733645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.733772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.733798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.733898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.734160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.734456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.734727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.734896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.735065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.735158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.735184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.735343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.735473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.735498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.735622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.735755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.735784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.735932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.736058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.736083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.736254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.736352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.736380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.461 qpair failed and we were unable to recover it. 00:27:55.461 [2024-11-26 01:20:45.736510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.461 [2024-11-26 01:20:45.736671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.736706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.736853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.736981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.737129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.737415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.737729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.737884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.737985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.738293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.738594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.738866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.738997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.739124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.739295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.739320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.739419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.739541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.739567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.739714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.739834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.739860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.739984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.740160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.740188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.740340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.740463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.740489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.740655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.740815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.740851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.740971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.741329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.741569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.741836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.741997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.742144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.742365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.742580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.742835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.742980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.743133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.743404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.743725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.462 [2024-11-26 01:20:45.743901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.462 qpair failed and we were unable to recover it. 00:27:55.462 [2024-11-26 01:20:45.744050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.744287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.744574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.744873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.744995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.745137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.745270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.745299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.745420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.745520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.745546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.745674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.745777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.745802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.745908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.746142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.746383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.746658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.746851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.746983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.747230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.747493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.747753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.747907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.748070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.748335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.748630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.748887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.748990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.749110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.749419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.749698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.749859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.749967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.750212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.750548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.463 qpair failed and we were unable to recover it. 00:27:55.463 [2024-11-26 01:20:45.750824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.463 [2024-11-26 01:20:45.750909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.750935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.751089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.751229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.751272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.751399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.751521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.751548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.751653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.751826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.751854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.752008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.752249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.752493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.752798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.752977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.753098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.753228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.753255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.753390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.753535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.753564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.753698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.753847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.753873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.753996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.754131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.754157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.754331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.754451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.754476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.754655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.754786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.754811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.754936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.755255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.755570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.755842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.755976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.756113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.756211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.756239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.756415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.756538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.756563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.756704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.756838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.756866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.756994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.757152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.757179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.757360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.757475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.757500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.757647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.757763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.757791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.757931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.758230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.758476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.758708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.758882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.759010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.759125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.464 [2024-11-26 01:20:45.759150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.464 qpair failed and we were unable to recover it. 00:27:55.464 [2024-11-26 01:20:45.759278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.759381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.759411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.759543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.759701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.759728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.759860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.759985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.760125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.760416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.760723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.760851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.760973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.761261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.761517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.761820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.761996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.762139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.762277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.762305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.762444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.762542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.762567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.762722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.762826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.762851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.762942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.763257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.763618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.763857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.763999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.764141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.764271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.764297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.764427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.764517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.764559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.764670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.764813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.764842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.764988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.765302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.765534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.765827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.765980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.766100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.766226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.766251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.766381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.766508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.766533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.766696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.766809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.766835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.766930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.767048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.767082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.767188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.767354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.465 [2024-11-26 01:20:45.767382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.465 qpair failed and we were unable to recover it. 00:27:55.465 [2024-11-26 01:20:45.767553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.767650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.767675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.767829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.767974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.768144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.768485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.768787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.768967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.769103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.769221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.769254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.769369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.769488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.769514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.769656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.769849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.769875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.769988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.770245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.770553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.770816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.770982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.771104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.771250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.771275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.771396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.771554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.771582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.771698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.771842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.771869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.771988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.772255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.772536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.772836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.772968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.773077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.773171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.773196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.773351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.773453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.773481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.773628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.773756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.773782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.773890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.774222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.774555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.774812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.774937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.775054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.775149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.775177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.775301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.775432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.775474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.466 qpair failed and we were unable to recover it. 00:27:55.466 [2024-11-26 01:20:45.775797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.466 [2024-11-26 01:20:45.775981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.776154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.776462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.776762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.776927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.777074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.777366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.777632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.777886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.777994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.778141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.778387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.778649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.778770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.778922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.779233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.779562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.779819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.779998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.780090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.780228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.780256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.780397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.780529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.780557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.780699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.780849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.780873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.780997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.781119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.781144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.781265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.781403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.781431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.781561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.781708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.781755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.781907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.782210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.782518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.782807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.782963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.783138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.783281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.783309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.783455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.783610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.783635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.783842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.783945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.783980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.784095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.784252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.784281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.467 qpair failed and we were unable to recover it. 00:27:55.467 [2024-11-26 01:20:45.784417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.467 [2024-11-26 01:20:45.784564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.784590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.784733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.784867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.784895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.785035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.785196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.785228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.785401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.785555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.785595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.785746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.785900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.785926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.786023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.786142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.786170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.786323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.786408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.786432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.786573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.786710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.786750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.786884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.787225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.787505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.787775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.787901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.788029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.788150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.788176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.788299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.788469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.788497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.788660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.788810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.788836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.788953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.789114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.789155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.789317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.789449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.789478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.789629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.789765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.789791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.789918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.790185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.790515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.790799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.790919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.791019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.791197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.791225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.791371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.791518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.791543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.791669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.791809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.791836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.792023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.792130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.468 [2024-11-26 01:20:45.792159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.468 qpair failed and we were unable to recover it. 00:27:55.468 [2024-11-26 01:20:45.792322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.792467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.792492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.792642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.792785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.792829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.792990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.793147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.793175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.793316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.793456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.793484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.793604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.793774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.793801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.793895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.794257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.794581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.794839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.794961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.795177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.795458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.795714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.795837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.795957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.796236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.796551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.796840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.796979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.797128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.797373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.797656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.797800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.797925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.798211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.798509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.798817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.798944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.799070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.799161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.799204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.799303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.799466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.799494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.799634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.799730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.799757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.799924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.800079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.800107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.800217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.800321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.800366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.800480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.800600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.469 [2024-11-26 01:20:45.800627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.469 qpair failed and we were unable to recover it. 00:27:55.469 [2024-11-26 01:20:45.800774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.800914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.800942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.801103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.801258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.801286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.801426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.801523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.801548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.801700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.801852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.801880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.802021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.802130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.802158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.802301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.802418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.802443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.802587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.802681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.802717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.802850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.803182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.803420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.803677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.803874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.804018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.804161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.804187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.804314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.804412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.804440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.804577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.804751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.804777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.804927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.805139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.805464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.805800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.805951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.806093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.806230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.806258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.806426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.806565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.806593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.806736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.806863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.806888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.807033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.807186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.807212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.807338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.807486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.807514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.807658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.807800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.807825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.807974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.808235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.808548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.808867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.808994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.809018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.470 qpair failed and we were unable to recover it. 00:27:55.470 [2024-11-26 01:20:45.809161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.809297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.470 [2024-11-26 01:20:45.809325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.809468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.809626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.809655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.809788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.809878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.809904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.810004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.810168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.810196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.810321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.810447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.810472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.810618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.810754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.810783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.810889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.811064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.811089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.811221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.811368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.811409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.811576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.811743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.811769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.811886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.812146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.812400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.812716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.812909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.813031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.813158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.813183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.813331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.813490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.813517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.813682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.813805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.813830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.813926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.814159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.814434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.814761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.814922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.815078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.815314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.815596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.815878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.815978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.816107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.816422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.816673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.816810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.816989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.817095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.817122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.471 [2024-11-26 01:20:45.817267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.817382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.471 [2024-11-26 01:20:45.817407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.471 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.817594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.817708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.817733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.817857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.817974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.817999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.818149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.818271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.818296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.818393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.818510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.818550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.818699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.818844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.818869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.819017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.819297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.819540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.819835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.819950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.820117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.820234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.820262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.820412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.820512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.820537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.820641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.820781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.820807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.820928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.821172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.821468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.821746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.821897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.822057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.822325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.822574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.822843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.822972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.823122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.823273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.823298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.823444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.823583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.823611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.823775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.823898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.823924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.824077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.824250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.824279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.824380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.824515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.824543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.824712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.824825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.824850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.824976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.825096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.825121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.825261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.825370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.825398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.472 qpair failed and we were unable to recover it. 00:27:55.472 [2024-11-26 01:20:45.825507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.472 [2024-11-26 01:20:45.825609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.825637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.825757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.825853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.825878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.826007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.826156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.826184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.826322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.826429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.826457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.826616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.826761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.826787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.826910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.827187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.827454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.827748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.827912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.828023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.828154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.828181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.828301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.828450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.828475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.828592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.828734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.828760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.828911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.829176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.829456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.829739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.829937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.830057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.830265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.830519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.830809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.830954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.831077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.831324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.831589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.831862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.831980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.832024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.832151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.832289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.832317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.473 [2024-11-26 01:20:45.832435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.832528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.473 [2024-11-26 01:20:45.832558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.473 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.832722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.832820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.832848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.832982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.833278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.833508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.833812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.833967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.834099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.834243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.834268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.834407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.834543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.834572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.834718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.834869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.834894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.834985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.835232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.835579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.835856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.835993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.836190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.836430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.836718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.836870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.837011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.837264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.837546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.837835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.837999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.838173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.838291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.838316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.838474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.838568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.838595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.838747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.838879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.838907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.839036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.839308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.839611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.839870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.839992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.840115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.840215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.840240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.840359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.840456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.840481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.474 qpair failed and we were unable to recover it. 00:27:55.474 [2024-11-26 01:20:45.840606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.840751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.474 [2024-11-26 01:20:45.840780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.840926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.841192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.841486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.841784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.841933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.842081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.842212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.842240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.842347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.842484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.842524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.842641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.842785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.842812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.842992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.843265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.843520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.843801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.843970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.844184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.844394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.844421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.844572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.844700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.844728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.844872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.845181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.845494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.845720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.845842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.845967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.846295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.846543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.846852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.846992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.847175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.847407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.847693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.847840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.847961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.848184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.848457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.848707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.475 [2024-11-26 01:20:45.848855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.475 qpair failed and we were unable to recover it. 00:27:55.475 [2024-11-26 01:20:45.849002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.849104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.849132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.849268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.849474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.849503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.849643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.849773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.849799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.849923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.850023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.850049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.850217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.850326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.850354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.850486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.850711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.850739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.850903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.851174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.851519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.851827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.851976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.852092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.852409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.852722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.852865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.853002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.853111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.853138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.853315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.853417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.853442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.853589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.853790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.853819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.853952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.854252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.854524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.854883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.854994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.855162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.855459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.855766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.855906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.856000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.856253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.856559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.856862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.856987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.857013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.857162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.857379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.857406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.476 qpair failed and we were unable to recover it. 00:27:55.476 [2024-11-26 01:20:45.857567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.476 [2024-11-26 01:20:45.857677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.857713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.857930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.858201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.858509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.858803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.858963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.859112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.859220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.859248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.859393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.859522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.859548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.859697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.859792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.859818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.859970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.860105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.860130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.860272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.860437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.860465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.860610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.860760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.860787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.860934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.861168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.861522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.861824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.861976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.862103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.862218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.862243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.862368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.862485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.862515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.862655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.862798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.862827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.862977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.863249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.863497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.863740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.863857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.863978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.864238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.864561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.864853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.477 [2024-11-26 01:20:45.864977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.477 qpair failed and we were unable to recover it. 00:27:55.477 [2024-11-26 01:20:45.865099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.865193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.865218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.865356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.865486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.865514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.865663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.865762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.865788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.865909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.866205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.866520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.866783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.866909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.867003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.867271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.867481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.867738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.867859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.867962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.868202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.868439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.868680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.868840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.868980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.869301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.869618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.869835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.869979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.870132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.870515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.870828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.870986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.871122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.871290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.871315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.871407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.871527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.871552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.871638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.871767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.871793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.871909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.872227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.872474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.872772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.478 [2024-11-26 01:20:45.872934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.478 qpair failed and we were unable to recover it. 00:27:55.478 [2024-11-26 01:20:45.873075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.873170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.873197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.873316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.873460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.873488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.873587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.873769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.873795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.873923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.874159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.874423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.874793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.874991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.875130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.875269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.875295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.875401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.875530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.875558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.875679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.875774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.875799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.875888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.876223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.876554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.876861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.876981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.877193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.877431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.877717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.877866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.878009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.878147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.878175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.878352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.878485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.878525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.878632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.878770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.878799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.878931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.879211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.879515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.879854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.879995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.880193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.880486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.880799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.880995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.881090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.881236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.881262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.479 [2024-11-26 01:20:45.881404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.881513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.479 [2024-11-26 01:20:45.881541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.479 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.881670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.881821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.881847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.881938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.882060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.882086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.882221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.882338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.882363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.882533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.882679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.882717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.882866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.883173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.883531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.883805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.883961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.884149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.884273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.884298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.884452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.884606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.884631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.884727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.884868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.884893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.885037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.885135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.885163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.885262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.885394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.885423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.885547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.885668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.885704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.885862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.886156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.886486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.886790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.886986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.887186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.887330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.887358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.887466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.887592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.887617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.887712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.887829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.887857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.887985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.888215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.888262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.888378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.888467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.888493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.888632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.888749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.888778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.888905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.889204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.889489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.889829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.480 [2024-11-26 01:20:45.889953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.480 qpair failed and we were unable to recover it. 00:27:55.480 [2024-11-26 01:20:45.890080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.890237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.890262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.890483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.890633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.890658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.890758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.890887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.890912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.891035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.891121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.891146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.891278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.891412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.891440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.891577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.891704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.891747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.891850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.892216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.892489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.892764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.892907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.893007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.893364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.893605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.893884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.893978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.894152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.894417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.894663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.894813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.894955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.895088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.895115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.895236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.895357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.895382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.895525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.895737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.895765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.895906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.896194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.896448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.896777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.896927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.897044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.897161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.897187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.897284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.897432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.897460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.481 [2024-11-26 01:20:45.897559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.897697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.481 [2024-11-26 01:20:45.897725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.481 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.897858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.897957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.897981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.898152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.898294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.898322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.898418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.898551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.898578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.898725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.898826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.898850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.898974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.899073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.899115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.899251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.899357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.899385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.899522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.899641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.899666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.899918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.900253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.900550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.900828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.900953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.901045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.901266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa558000b90 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.901486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.901754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.901902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.902005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.902311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.902639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.902861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.902985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.903077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.903283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.903311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.903413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.903539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.903567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.903717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.903818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.903843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.903943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.904067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.904092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.482 qpair failed and we were unable to recover it. 00:27:55.482 [2024-11-26 01:20:45.904223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.904320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.482 [2024-11-26 01:20:45.904346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.904470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.904586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.904611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.904731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.904827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.904852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.904973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.905221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.905472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.905806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.905953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.906047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.906204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.906229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.906382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.906490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.906518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.906681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.906837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.906865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.906995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.907289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.907546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.907828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.907978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.908090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.908242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.908267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.908392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.908514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.908539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.908665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.908796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.908823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.908934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.909271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.909548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.909806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.909959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.910089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.910186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.910212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.910353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.910495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.910520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.910656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.910815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.910840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.910940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.911261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.911563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.911806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.483 [2024-11-26 01:20:45.911968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.483 qpair failed and we were unable to recover it. 00:27:55.483 [2024-11-26 01:20:45.912094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.912346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.912649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.912883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.912974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.913128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.913403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.913708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.913860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.913984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.914267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.914534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.914783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.914924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.915049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.915319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.915524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.915777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.915927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.916018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.916294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.916583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.916856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.916973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.917121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.917240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.917265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.917403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.917501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.917526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.917649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.917759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.917785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.917902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.918186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.918412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.918711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.918869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.918991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.919110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.919135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.919230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.919375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.919400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.484 [2024-11-26 01:20:45.919496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.919644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.484 [2024-11-26 01:20:45.919669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.484 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.919801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.919895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.919920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.920071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.920311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.920555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.920840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.920987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.921108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.921257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.921282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.921405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.921555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.921579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.921704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.921860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.921885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.921973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.922242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.922507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.922780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.922931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.923049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.923173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.923198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.923333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.923481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.923507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.923606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.923754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.923781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.923876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.924111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.924360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.924597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.924746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.924897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.925145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.925400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.925655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.925782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.925928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.926163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.926413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.926655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.926804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.485 [2024-11-26 01:20:45.926955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.927048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.485 [2024-11-26 01:20:45.927074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.485 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.927177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.927301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.927328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.927452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.927544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.927569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.927699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.927791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.927817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.927934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.928205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.928460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.928760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.928904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.929031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.929157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.929182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.929337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.929487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.929512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.929635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.929778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.929804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.929928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.930148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.930429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.930668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.930820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.930930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.931156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.931429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.931700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.931818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.931913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.932160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.932404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.932652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.932808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.932930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.933166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.933412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.933701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.933845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.933941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.934051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.934081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.934183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.934271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.934296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.486 qpair failed and we were unable to recover it. 00:27:55.486 [2024-11-26 01:20:45.934423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.486 [2024-11-26 01:20:45.934572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.934597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.934739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.934878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.934905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.935003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.935247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.935587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.935818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.935938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.936058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.936348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.936616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.936867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.936996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.937132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.937266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.937294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.937429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.937526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.937551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.937706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.937849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.937874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.937972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.938244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.938599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.938866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.938992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.939114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.939238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.939264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.939372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.939473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.939503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.939648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.939768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.939795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.939923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.940182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.940504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.940782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.940923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.941009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.941125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.941150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.487 qpair failed and we were unable to recover it. 00:27:55.487 [2024-11-26 01:20:45.941282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.941462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.487 [2024-11-26 01:20:45.941486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.941674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.941806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.941831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.941930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.942204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.942531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.942866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.942981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.943067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.943214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.943240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.943343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.943435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.943462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.943585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.943741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.943767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.943893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.944160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.944380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.944600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.944850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.944975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.945101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.945323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.945580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.945796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.945911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.946047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.946265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.946494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.946725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.946837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.946952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.947233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.947532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.947807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.947929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.948030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.948153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.948179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.488 qpair failed and we were unable to recover it. 00:27:55.488 [2024-11-26 01:20:45.948269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.488 [2024-11-26 01:20:45.948362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.948388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.948483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.948607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.948632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.948758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.948881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.948906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.949041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.949301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.949545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.949779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.949890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.950033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.950346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.950594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.950846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.950956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.951093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.951254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.951282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.951395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.951527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.951553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.951701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.951800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.951825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.951921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.952228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.952487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.952749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.952887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.953003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.953314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.953523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.953765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.953905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.954056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.954354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.954584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.954848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.954972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.955002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.955129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.955305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.955330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.955475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.955588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.489 [2024-11-26 01:20:45.955629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.489 qpair failed and we were unable to recover it. 00:27:55.489 [2024-11-26 01:20:45.955725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.955851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.955876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.955966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.956219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.956514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.956798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.956931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.957037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.957326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.957594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.957871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.957993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.958083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.958209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.958237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.958349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.958512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.958540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.958649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.958784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.958811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.958907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.959002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.959029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.959169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.959285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.959313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.490 [2024-11-26 01:20:45.959417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.959528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.490 [2024-11-26 01:20:45.959556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.490 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.959699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.959795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.959820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.959921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.960191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.960488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.960780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.960921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.961031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.961349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.961633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.961870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.961995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.962088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.962366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.962598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.962862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.962983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.963104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.963370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.963648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.963866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.963982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.964118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.964401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.964650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.964822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.964949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.965291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.965547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.965812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.965968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.966114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.966244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.966272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.966449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.966589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.966631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.966782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.966882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.966907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.967026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.967285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.967559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.967902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.967997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.968023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.968145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.968268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.968293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.770 qpair failed and we were unable to recover it. 00:27:55.770 [2024-11-26 01:20:45.968413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.968500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.770 [2024-11-26 01:20:45.968525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.968656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.968761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.968791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.968921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.969151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.969443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.969772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.969889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.970037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.970201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.970230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.970373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.970505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.970530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.970675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.970796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.970822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.970966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.971253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.971473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.971702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.971828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.971927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.972174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.972488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.972835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.972957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.973063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.973369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.973636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.973874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.973997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.974122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.974251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.974280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.974434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.974559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.974584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.974723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.974835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.974860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.974985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.975216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.975474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.975744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.975893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.975984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.976276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.976606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.976868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.976984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.977107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.977241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.977270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.977397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.977501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.977529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.977674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.977783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.977809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.977908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.978174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.978462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.978748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.978869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.979019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.979162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.979186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.979308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.979456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.979482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.979672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.979800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.979826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.979929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.980175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.980466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.980744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.980900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.981026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.981151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.981176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.771 [2024-11-26 01:20:45.981323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.981404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.771 [2024-11-26 01:20:45.981430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.771 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.981546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.981635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.981659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.981770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.981866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.981891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.982002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.982146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.982175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.982303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.982483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.982509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.982654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.982809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.982839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.982930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.983243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.983502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.983770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.983911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.984011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.984288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.984554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.984841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.984984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.985182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.985490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.985778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.985897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.985995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.986239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.986456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.986758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.986878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.986966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.987271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.987519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.987747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.987895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.988032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.988171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.988198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.988349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.988447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.988472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.988615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.988771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.988796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.988895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.989184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.989448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.989716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.989853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.989956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.990228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.990500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.990803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.990917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.991018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.991289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.991571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.991863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.991987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.992106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.992221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.992248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.992389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.992485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.992510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.992614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.992757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.992783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.992916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.993250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.993552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.993799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.993947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.994068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.994170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.994195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.994284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.994405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.994430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.772 [2024-11-26 01:20:45.994521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.994642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.772 [2024-11-26 01:20:45.994667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.772 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.994805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.994903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.994929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.995054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.995286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.995504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.995739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.995890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.996020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.996287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.996557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.996865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.996987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.997136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.997369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.997576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.997823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.997972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.998060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.998210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.998234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.998356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.998483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.998509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.998599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.998725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.998750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.998852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.999156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.999375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.999616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:45.999793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:45.999885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.000181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.000437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.000654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.000791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.000891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.001184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.001409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.001714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.001827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.001922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.002156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.002399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.002616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.002876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.002991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.003113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.003335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.003609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.003834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.003957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.004058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.004348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.004597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.004864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.004991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.005085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.005213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.005238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.005338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.005459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.005484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.005631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.005751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.005777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.005899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.006148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.006398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.006669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.006892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.006988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.007114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.007380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.007610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.007820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.007946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.008052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.008177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.008201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.773 [2024-11-26 01:20:46.008326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.008447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.773 [2024-11-26 01:20:46.008472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.773 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.008575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.008712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.008739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.008861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.008989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.009114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.009406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.009708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.009875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.009977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.010233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.010523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.010827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.010955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.011080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.011314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.011617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.011891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.011996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.012149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.012471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.012673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.012809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.012906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.013240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.013498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.013770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.013881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.014003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.014242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.014509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.014813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.014937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.015067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.015208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.015236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.015380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.015502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.015528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.015677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.015865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.015891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.016010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.016149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.016178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.016295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.016459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.016488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.016632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.016755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.016781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.016906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.017223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.017489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.017767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.017901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.018061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.018348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.018579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.018801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.018960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.019060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.019183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.019208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.019375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.019519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.019544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.019638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.019754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.019780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.019909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.020166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.020410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.020744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.020871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.020961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.021182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.021451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.021696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.021821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.021950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.022240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.022500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.022752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.022876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.022971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.023062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.023088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.774 qpair failed and we were unable to recover it. 00:27:55.774 [2024-11-26 01:20:46.023232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.023379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.774 [2024-11-26 01:20:46.023403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.023521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.023625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.023667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.023820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.023948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.023974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.024073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.024330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.024618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.024834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.024985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.025087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.025211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.025237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.025356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.025481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.025507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.025627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.025755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.025786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.025881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.026126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.026390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.026694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.026821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.026968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.027305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.027576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.027853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.027980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.028149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.028417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.028730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.028906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.029026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.029179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.029204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.029319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.029439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.029481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.029600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.029774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.029800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.029895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.030155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.030440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.030702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.030842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.030965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.031205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.031522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.031836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.031955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.032104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.032204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.032229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.032371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.032534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.032560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.032697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.032818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.032845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.033021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.033301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.033564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.033848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.033979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.034236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.034524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.034782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.034905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.035053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.035350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.035626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.035883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.035979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.036091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.036392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.036720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.036915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.037075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.037198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.037223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.037343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.037463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.037489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.037605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.037743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.037771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.775 qpair failed and we were unable to recover it. 00:27:55.775 [2024-11-26 01:20:46.037880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.775 [2024-11-26 01:20:46.038016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.038151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.038462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.038729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.038855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.038979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.039205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.039428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.039714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.039868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.039963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.040240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.040580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.040798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.040943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.041033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.041274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.041495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.041823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.041964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.042156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.042272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.042297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.042443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.042589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.042617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.042724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.042868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.042900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.043043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.043168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.043195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.043293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.043426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.043451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.043587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.043765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.043793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.043910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.044214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.044504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.044811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.044975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.045097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.045184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.045209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.045335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.045485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.045513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.045661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.045771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.045798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.045915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.046212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.046527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.046791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.046921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.047019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.047260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.047582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.047863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.047956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.048119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.048409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.048729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.048899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.049017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.049301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.049612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.049868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.049974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.050123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.050394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.050658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.050842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.050943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.051260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.051587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.051826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.051952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.052054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.052360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.052588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.052831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.052984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.776 [2024-11-26 01:20:46.053135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.053235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.776 [2024-11-26 01:20:46.053260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.776 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.053374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.053550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.053575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.053698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.053879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.053907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.054061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.054206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.054231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.054377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.054524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.054551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.054661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.054805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.054834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.054976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.055311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.055623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.055874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.055989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.056137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.056309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.056334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.056458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.056607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.056649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.056793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.056890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.056915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.057088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.057178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.057203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.057360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.057476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.057509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.057705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.057873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.057899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.058079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.058239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.058266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.058377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.058538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.058566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.058713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.058848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.058873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.058990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.059080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.059122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.059230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.059358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.059387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.059580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.059747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.059775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.059920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.060218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.060521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.060749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.060920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.061045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.061234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.061258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.061387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.061513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.061538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.061658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.061783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.061827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.061949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.062194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.062430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.062734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.062863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.062955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.063205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.063513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.063858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.063998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.064173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.064326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.064350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.064465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.064603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.064627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.064735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.064835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.064860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.064963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.065126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.065153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.065264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.065367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.065408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.065534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.065678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.065726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.065867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.066156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.066488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.066791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.066937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.067035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.067156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.067198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.067368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.067490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.067514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.067663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.067791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.067819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.067953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.068059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.068085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.068254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.068381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.068406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.777 qpair failed and we were unable to recover it. 00:27:55.777 [2024-11-26 01:20:46.068539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.777 [2024-11-26 01:20:46.068698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.068737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.068896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.069155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.069423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.069788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.069968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.070137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.070230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.070254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.070372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.070502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.070531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.070699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.070809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.070834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.070960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.071084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.071108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.071294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.071442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.071467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.071590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.071746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.071771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.071898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.072197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.072464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.072747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.072897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.073014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.073134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.073160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.073286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.073414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.073443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.073593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.073717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.073743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.073902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.074168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.074412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.074699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.074861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.075009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.075187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.075215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.075363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.075486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.075511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.075658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.075813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.075841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.075982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.076228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.076515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.076822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.076956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.077105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.077232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.077257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.077406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.077546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.077574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.077734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.077882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.077907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.078063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.078189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.078233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.078345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.078509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.078536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.078681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.078840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.078867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.078981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.079261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.079552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.079868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.079998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.080165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.080324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.080352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.080469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.080617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.080642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.080777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.080932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.080975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.081123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.081232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.081259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.081388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.081522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.081563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.081719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.081849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.081890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.082028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.082165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.082192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.082327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.082471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.082499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.082654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.082808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.082834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.082955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.083199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.083498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.083818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.083991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.084090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.084213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.084238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.084369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.084468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.084493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.778 [2024-11-26 01:20:46.084661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.084798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.778 [2024-11-26 01:20:46.084823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.778 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.084923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.085197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.085469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.085781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.085901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.086007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.086154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.086179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.086332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.086447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.086474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.086605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.086777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.086804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.086904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.087172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.087469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.087812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.087966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.088116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.088239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.088266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.088374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.088512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.088539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.088681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.088815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.088840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.088994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.089293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.089577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.089808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.089973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.090111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.090396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.090692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.090884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.091006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.091139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.091166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.091337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.091488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.091530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.091712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.091817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.091842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.091966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.092241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.092456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.092788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.092940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.093064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.093332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.093582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.093847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.093998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.094134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.094230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.094258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.094395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.094506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.094535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.094693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.094814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.094839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.094966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.095306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.095591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.095871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.095985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.096106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.096232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.096260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.096441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.096610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.096638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.096808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.096908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.096937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.097100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.097239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.097267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.097437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.097560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.097585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.097762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.097869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.097900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.098046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.098288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.098567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.098829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.098994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.099105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.099210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.099236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.099357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.099479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.099505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.099666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.099809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.099836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.099957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.100046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.100071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.100220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.100337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.100365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.100530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.100634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.779 [2024-11-26 01:20:46.100662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.779 qpair failed and we were unable to recover it. 00:27:55.779 [2024-11-26 01:20:46.100799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.100905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.100931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.101061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.101205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.101234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.101369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.101470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.101499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.101635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.101786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.101813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.101964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.102112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.102137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.102291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.102435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.102484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.102611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.102732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.102758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.102885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.103163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.103463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.103736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.103896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.104031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.104303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.104556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.104833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.104994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.105088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.105237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.105267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.105418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.105579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.105609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.105749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.105907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.105936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.106074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.106195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.106221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.106362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.106486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.106515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.106641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.106780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.106809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.106924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.107159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.107426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.107711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.107838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.107939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.108165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.108454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.108697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.108860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.108967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.109278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.109548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.109820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.109986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.110107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.110261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.110287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.110465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.110580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.110608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.110724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.110886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.110914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.111039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.111137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.111163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.111276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.111425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.111450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.111577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.111717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.111746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.111902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.112169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.112459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.112772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.112923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.113069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.113238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.113263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.113395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.113536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.113564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.113699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.113825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.113851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.113944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.114230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.114539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.114845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.114969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.115012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.115129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.115265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.780 [2024-11-26 01:20:46.115293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.780 qpair failed and we were unable to recover it. 00:27:55.780 [2024-11-26 01:20:46.115429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.115550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.115575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.115719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.115827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.115855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.115952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.116261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.116492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.116809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.116966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.117123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.117240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.117265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.117407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.117537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.117565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.117736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.117844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.117873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.118003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.118322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.118554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.118860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.118985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.119154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.119469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.119781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.119907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.120013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.120142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.120183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.120274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.120403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.120428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.120614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.120720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.120747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.120899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.121174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.121441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.121756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.121885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.122021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.122186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.122212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.122362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.122453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.122479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.122673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.122766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.122791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.122926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.123196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.123436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.123735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.123910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.124028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.124273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.124581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.124861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.124986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.125154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.125462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.125816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.125963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.126108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.126255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.126280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.126379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.126460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.126486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.126607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.126768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.126793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.126985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.127218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.127472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.127796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.127951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.128103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.128267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.128293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.128443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.128566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.128592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.128719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.128847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.128872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.128963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.129151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.129176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.129299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.129449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.129474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.129592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.129754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.129782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.129890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.130195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.130456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.130727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.130918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.131037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.131162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.131187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.781 [2024-11-26 01:20:46.131320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.131458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.781 [2024-11-26 01:20:46.131485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.781 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.131621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.131740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.131768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.131913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.132229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.132521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.132826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.132972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.133120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.133255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.133284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.133418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.133519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.133547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.133695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.133784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.133810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.133965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.134204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.134548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.134859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.134994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.135194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.135485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.135774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.135897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.136046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.136175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.136200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.136365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.136491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.136516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.136669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.136798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.136827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.136992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.137128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.137157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.137304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.137456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.137481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.137593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.137753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.137781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.137921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.138252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.138513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.138821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.138985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.139124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.139245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.139270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.139400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.139531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.139559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.139698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.139832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.139857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.139986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.140215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.140555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.140834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.140982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.141125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.141278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.141306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.141413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.141574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.141602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.141746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.141847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.141873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.142016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.142247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.142506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.142858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.142970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.143059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.143181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.143206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.143368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.143469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.143495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.143629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.143806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.143832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.143955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.144122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.144150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.144272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.144395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.144421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.144571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.144697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.144740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.144887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.145187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.145451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.145786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.145938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.146059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.146174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.146198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.146324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.146505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.146530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.782 qpair failed and we were unable to recover it. 00:27:55.782 [2024-11-26 01:20:46.146623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.146750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.782 [2024-11-26 01:20:46.146794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.146977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.147294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.147565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.147840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.147963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.148065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.148191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.148217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.148355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.148493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.148521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.148670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.148822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.148848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.148971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.149220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.149499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.149797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.149960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.150092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.150263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.150290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.150430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.150548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.150574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.150700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.150808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.150836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.150967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.151138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.151165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.151337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.151456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.151482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.151667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.151767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.151793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.151887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.152166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.152422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.152737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.152851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.152980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.153291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.153530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.153845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.153995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.154132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.154434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.154704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.154856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.154982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.155310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.155609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.155847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.155970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.156139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.156240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.156267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.156407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.156503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.156529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.156658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.156847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.156874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.156996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.157144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.157172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.157310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.157460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.157486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.157612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.157763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.157790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.157940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.158200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.158476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.158745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.158897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.158995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.159153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.159178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.159318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.159454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.159482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.159582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.159744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.159769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.159888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.160242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.160492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.160801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.160945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.161049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.161165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.161190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.161304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.161437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.161465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.161615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.161737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.161762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.161907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.162032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.162073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.162181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.162307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.162336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.783 [2024-11-26 01:20:46.162455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.162577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.783 [2024-11-26 01:20:46.162602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.783 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.162699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.162801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.162827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.162928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.163242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.163545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.163861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.163987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.164160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.164408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.164803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.164953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.165081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.165199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.165225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.165333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.165510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.165535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.165665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.165826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.165852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.165944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.166212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.166519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.166861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.166987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.167145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.167420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.167702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.167854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.168024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.168156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.168185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.168322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.168454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.168481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.168623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.168713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.168739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.168913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.169186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.169456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.169700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.169817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.169965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.170275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.170533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.170851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.170994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.171111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.171203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.171227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.171354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.171517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.171545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.171659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.171830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.171856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.172002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.172297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.172585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.172842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.172983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.173112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.173258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.173286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.173451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.173581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.173609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.173721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.173839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.173864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.173977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.174277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.174579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.174838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.174956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.175099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.175211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.175240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.175385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.175474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.175499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.175643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.175798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.175824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.175926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.176217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.176506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.176841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.176967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.784 qpair failed and we were unable to recover it. 00:27:55.784 [2024-11-26 01:20:46.177091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.784 [2024-11-26 01:20:46.177180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.177208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.177335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.177475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.177503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.177645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.177776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.177806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.177927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.178229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.178533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.178853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.178998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.179117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.179241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.179269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.179401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.179526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.179554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.179725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.179825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.179851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.179994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.180257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.180581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.180850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.180984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.181124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.181289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.181315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.181440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.181529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.181555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.181641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.181775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.181805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.181895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.182194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.182431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.182716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.182912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.183062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.183184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.183210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.183329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.184896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.184931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.185108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.185250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.185278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.185403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.185530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.185556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.185681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.185826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.185855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.186000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.186199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.186249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.186394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.186518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.186544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.186701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.186814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.186843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.186993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.187271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.187491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.187766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.187893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.188001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.188225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.188490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.188816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.188960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.189088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.189205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.189231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.189352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.189463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.189491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.189636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.189766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.189792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.189942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.190206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.190487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.190759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.190905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.191057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.191189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.191217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.191340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.191430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.191456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.191577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.191736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.191775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.191924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.192229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.192487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.192788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.192914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.193047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.193182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.193211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.193384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.193536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.193561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.193655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.193757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.193783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.193878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.194010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.194036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.785 qpair failed and we were unable to recover it. 00:27:55.785 [2024-11-26 01:20:46.194193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.194288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.785 [2024-11-26 01:20:46.194313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.194481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.194584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.194612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.194789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.194903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.194928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.195075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.195186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.195215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.195352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.195483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.195512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.195610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.195759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.195785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.195920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.196225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.196464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.196714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.196848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.196993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.197125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.197153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.197315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.197453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.197483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.197632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.197762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.197792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.197899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.198183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.198458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.198790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.198961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.199081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.199207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.199235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.199379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.199503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.199529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.199635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.199790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.199816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.199906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.200225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.200529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.200826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.200979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.201099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.201213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.201238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.201364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.201477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.201502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.201626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.201765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.201790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.201894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.202133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.202383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.202641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.202821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.202912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.203172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.203447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.203703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.203834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.203927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.204202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.204535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.204834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.204954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.205116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.205374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.205603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.205870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.205996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.206115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.206364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.206630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.206842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.206967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.207092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.207259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.207287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.207408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.207504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.207529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.207631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.207760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.207786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.207911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.208220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.208455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.208700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.208880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.208979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.209101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.209126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.786 [2024-11-26 01:20:46.209266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.209363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.786 [2024-11-26 01:20:46.209391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.786 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.209499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.209633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.209661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.209796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.209912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.209938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.210058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.210193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.210221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.210356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.210496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.210524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.210669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.210769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.210795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.210891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.211121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.211385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.211630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.211786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.211887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.212132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.212406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.212717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.212913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.213008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.213141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.213167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.213327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.213464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.213492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.213628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.213771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.213797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.213947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.214213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.214548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.214829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.214974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.215088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.215191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.215219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.215328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.215464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.215492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.215612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.215745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.215771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.215898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.216190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.216478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.216812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.216964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.217104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.217400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.217650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.217910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.217998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.218141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.218383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.218614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.218861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.218979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.219100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.219378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.219698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.219848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.219942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.220153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.220414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.220663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.220842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.220950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.221210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.221424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.221667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.221801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.221925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.222025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.222051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.787 [2024-11-26 01:20:46.222153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.222322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.787 [2024-11-26 01:20:46.222348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.787 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.222478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.222618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.222646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.222797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.222900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.222927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.223024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.223141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.223165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.223306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.223438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.223466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.223601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.223770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.223796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.223892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.224224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.224531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.224775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.224917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.225060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.225195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.225222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.225369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.225522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.225548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.225725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.225831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.225859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.225969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.226249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.226536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.226832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.226976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.227126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.227342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.227588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.227733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.227897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.228198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.228489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.228768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.228895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.229023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.229285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.229556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.229819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.229977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.230069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.230240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.230268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.230407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.230537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.230562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.230671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.230815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.230844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.230954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.231233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.231486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.231790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.231935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.232081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.232200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.232225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.232365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.232472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.232501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.232632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.232751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.232778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.232873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.233137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.233408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.233704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.233851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.234036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.234171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.234199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.234335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.234470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.234512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.234607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.234738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.234764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.234913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.235175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.235476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.235732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.235926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.236025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.236166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.236194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.236314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.236446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.236471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.236635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.236752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.236781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.236947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.237206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.237426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.788 qpair failed and we were unable to recover it. 00:27:55.788 [2024-11-26 01:20:46.237674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.788 [2024-11-26 01:20:46.237809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.237837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.237977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.238237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.238529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.238828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.238972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.239066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.239185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.239211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.239339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.239502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.239531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.239639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.239782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.239808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.239926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.240173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.240524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.240838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.240971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.241074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.241207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.241234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.241378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.241477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.241502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.241610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.241745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.241774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.241883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.242205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.242480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.242752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.242907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.243018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.243296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.243599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.243850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.243977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.244094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.244363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.244587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.244839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.244954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.245099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.245220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.245245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.245343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.245441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.245466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.245637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.245783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.245827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.789 qpair failed and we were unable to recover it. 00:27:55.789 [2024-11-26 01:20:46.245921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.246058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.789 [2024-11-26 01:20:46.246085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.246257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.246375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.246400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.246553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.246657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.246694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.246835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.246939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.246967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.247087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.247180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.247206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.247355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.247442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.247467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.247598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.247760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.247789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.247929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.248191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.248454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.248756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.248903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.249051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.249155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.249185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.249320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.249466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.249491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.249648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.249780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.249823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.249959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.250239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.250518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.250773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.250975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.251077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.251248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.251276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.251428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.251527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.251552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.251678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.251781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.251807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.251960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.252301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.252552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.252849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.252974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.253016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.253162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.253247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.253272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.790 [2024-11-26 01:20:46.253437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.253533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.790 [2024-11-26 01:20:46.253561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.790 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.253734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.253896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.253925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.254076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.254196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.254221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.254344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.254492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.254517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.254670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.254851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.254878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.254999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.255293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.255549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.255830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.255977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.256119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.256279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.256307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.256435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.256575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.256603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.256719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.256851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.256876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.257029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.257169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.257202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.257336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.257461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.257489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.257634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.257728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.257755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.257896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.258032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.258062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.258222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.258346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.258374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.258514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.258657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.258682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.258882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.259151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.259463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.259724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.259863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.259959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.260275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.260600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.260831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.260995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.261146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.261295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.261320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.261464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.261570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.261597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.261762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.261904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.261932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.791 qpair failed and we were unable to recover it. 00:27:55.791 [2024-11-26 01:20:46.262052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.791 [2024-11-26 01:20:46.262142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.262255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.262535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.262810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.262937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.263060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.263186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.263214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.263310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.263441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.263469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.263594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.263714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.263740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.263885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.264180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.264428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.264678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.264837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.264936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.265266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.265554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.265850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.265982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.266155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.266302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.266328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.266438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.266593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.266618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.266755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.266887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.266915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.267062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.267315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.267599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.267899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.267982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.268173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.268468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.268734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.268893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.269030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.269287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.269519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.269771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.269952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.792 qpair failed and we were unable to recover it. 00:27:55.792 [2024-11-26 01:20:46.270088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.792 [2024-11-26 01:20:46.270237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.270262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.270361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.270447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.270488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.270601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.270760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.270787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.270916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.271223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.271550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.271823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.271996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.272121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.272246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.272271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.272376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.272487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.272516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.272680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.272823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.272853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.273008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.273127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.273152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.273302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.273451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.273476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.273605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.273792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.273818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.273939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.274169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.274494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.274768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.274916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.275025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.275305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.275571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.275881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.275986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.276150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.276500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.276752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.276895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.277019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.277294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.277561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.277842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.277979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.278103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.278232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.793 [2024-11-26 01:20:46.278257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.793 qpair failed and we were unable to recover it. 00:27:55.793 [2024-11-26 01:20:46.278359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.278474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.278502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.794 qpair failed and we were unable to recover it. 00:27:55.794 [2024-11-26 01:20:46.278612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.278722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.278752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.794 qpair failed and we were unable to recover it. 00:27:55.794 [2024-11-26 01:20:46.278869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.278992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.794 qpair failed and we were unable to recover it. 00:27:55.794 [2024-11-26 01:20:46.279118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.794 qpair failed and we were unable to recover it. 00:27:55.794 [2024-11-26 01:20:46.279406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.794 qpair failed and we were unable to recover it. 00:27:55.794 [2024-11-26 01:20:46.279672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.279820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:55.794 qpair failed and we were unable to recover it. 00:27:55.794 [2024-11-26 01:20:46.279925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.280045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:55.794 [2024-11-26 01:20:46.280074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.280188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.281233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.281269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.281403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.281530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.281556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.281722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.281828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.281856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.281950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.282192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.282442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.282699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.282832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.282950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.283193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.283455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.283693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.283841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.283951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.284212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.284488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.284784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.284905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.285020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.285338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.285601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.285832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.285948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.286101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.286233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.286259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.286382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.286480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.286506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.084 [2024-11-26 01:20:46.286608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.286767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.084 [2024-11-26 01:20:46.286793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.084 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.286892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.287204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.287496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.287732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.287887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.288030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.288148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.288174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.288339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.288489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.288515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.288635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.288790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.288834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.288985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.289246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.289529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.289809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.289949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.290077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.290299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.290583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.290826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.290946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.291099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.291349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.291568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.291815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.291943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.292096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.292243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.292269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.292421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.292544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.292569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.292717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.292861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.292905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.293055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.293169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.293194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.293349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.293439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.293465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.293591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.293761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.293805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.293937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.294180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.294426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.085 qpair failed and we were unable to recover it. 00:27:56.085 [2024-11-26 01:20:46.294672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.085 [2024-11-26 01:20:46.294775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.294806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.294910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.295208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.295448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.295725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.295899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.296046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.296217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.296242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.296394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.296516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.296542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.296699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.296819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.296862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.296981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.297229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.297478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.297802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.297955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.298075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.298285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.298529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.298760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.298878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.298999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.299230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.299496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.299743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.299858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.299945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.300186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.300427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.300656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.300824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.300943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.301062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.301086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.301207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.301303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.301327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.301421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.301544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.086 [2024-11-26 01:20:46.301569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.086 qpair failed and we were unable to recover it. 00:27:56.086 [2024-11-26 01:20:46.301714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.301837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.301879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.302031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.302270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.302521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.302786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.302925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.303020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.303287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.303553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.303810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.303980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.304107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.304227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.304252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.304374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.304489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.304513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.304664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.304802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.304829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.304925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.305154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.305404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.305645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.305780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.305885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.306162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.306456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.306702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.306827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.306998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.307230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.307276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.307369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.307470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.307496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.307610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.307741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.307767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.307889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.308209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.308481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.308776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.308963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.309085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.309357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.309603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.309840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.309984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.310077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.310196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.310221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.087 [2024-11-26 01:20:46.310324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.310450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.087 [2024-11-26 01:20:46.310476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.087 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.310583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.310711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.310737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.310871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.310994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.311145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.311443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.311774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.311932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.312093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.312235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.312261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.312411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.312509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.312533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.312656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.312790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.312834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.312936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.313232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.313498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.313775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.313898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.314021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.314267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.314505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.314783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.314906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.315025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.315350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.315595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.088 qpair failed and we were unable to recover it. 00:27:56.088 [2024-11-26 01:20:46.315840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.315997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.088 [2024-11-26 01:20:46.316024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.316277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.316301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.316430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.316545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.316570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.316719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.316814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.316840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.316941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.317178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.317433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.317708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.317879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.318001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.318281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.318555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.318838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.318987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.319110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.319378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.319644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.319896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.319993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.320100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.320351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.320596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.320874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.320994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.321088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.321233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.321257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.321406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.321530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.321554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.321683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.321807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.321833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.321940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.322207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.322534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.322784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.322937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.323054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.323189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.323232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.323384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.323482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.323506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.323636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.323735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.323760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.323855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.324004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.324028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.089 qpair failed and we were unable to recover it. 00:27:56.089 [2024-11-26 01:20:46.324166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.089 [2024-11-26 01:20:46.324310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.324335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.324446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.324541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.324567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.324697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.324825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.324850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.324997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.325292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.325564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.325850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.325996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.326148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.326275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.326299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.326392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.326539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.326563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.326662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.326798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.326824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.326956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.327222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.327443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.327729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.327882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.328010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.328263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.328565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.328845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.328986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.329107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.329230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.329254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.329383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.329470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.329494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.329614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.329738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.329765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.329891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.330170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.330460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.330759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.330946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.331103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.331235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.331260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.331362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.331461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.331487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.331611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.331758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.331802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.331896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.332194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.332433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.090 qpair failed and we were unable to recover it. 00:27:56.090 [2024-11-26 01:20:46.332702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.090 [2024-11-26 01:20:46.332839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.332864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.333011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.333279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.333493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.333768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.333935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.334088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.334205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.334230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.334321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.334448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.334473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.334565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.334716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.334742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.334868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.335174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.335447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.335699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.335879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.336020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.336211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.336253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.336345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.336463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.336489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.336609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.336722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.336752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.336909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.337259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.337534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.337815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.337968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.338102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.338370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.338650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.338807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.338928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.339235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.339452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.339696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.339850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.339977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.340211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.340450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.340665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.340856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.341009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.341101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.341130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.091 qpair failed and we were unable to recover it. 00:27:56.091 [2024-11-26 01:20:46.341223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.091 [2024-11-26 01:20:46.341339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.341365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.341522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.341614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.341638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.341806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.341950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.341975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.342097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.342212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.342236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.342360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.342478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.342502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.342605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.342706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.342731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.342872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.343176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.343455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.343756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.343948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.344049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.344344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.344571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.344847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.344971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.345127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.345257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.345282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.345430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.345575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.345599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.345730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.345845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.345872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.346000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.346259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.346538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.346882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.346988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.347132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.347345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.347644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.347802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.347929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.348224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.348499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.348733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.348881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.348977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.349246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.349547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.092 qpair failed and we were unable to recover it. 00:27:56.092 [2024-11-26 01:20:46.349841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.092 [2024-11-26 01:20:46.349984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.350079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.350206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.350232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.350331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.350467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.350492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.350642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.350737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.350763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.350910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.351259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.351516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.351796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.351979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.352119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.352268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.352293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.352422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.352544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.352568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.352666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.352814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.352858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.352995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.353154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.353197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.353320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.353442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.353467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.353594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.353732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.353761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.353954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.354260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.354482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.354767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.354965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.355103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.355240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.355265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.355393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.355516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.355541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.355667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.355770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.355796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.355910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.356178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.356420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.356701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.356819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.356954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.357050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.357074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.357197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.357339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.357364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.357462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.357593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.093 [2024-11-26 01:20:46.357617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.093 qpair failed and we were unable to recover it. 00:27:56.093 [2024-11-26 01:20:46.357771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.357917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.357942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.358068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.358347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.358575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.358821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.358935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.359025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.359146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.359170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.359267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.359392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.359416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.359544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.359673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.359704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.359856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.360203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.360486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.360744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.360959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.361067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.361206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.361231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.361354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.361502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.361526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.361655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.361792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.361818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.361942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.362235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.362497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.362763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.362928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.363049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.363316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.363562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.363844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.363961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.364060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.364209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.364234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.364385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.364478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.364503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.364605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.364722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.364748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.364900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.365169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.365464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.365773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.365973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.094 [2024-11-26 01:20:46.366110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.366249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.094 [2024-11-26 01:20:46.366275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.094 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.366432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.366545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.366570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.366740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.366995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.367190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.367480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.367774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.367961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.368118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.368285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.368309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.368465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.368558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.368583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.368751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.368894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.368920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.369045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.369313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.369588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.369842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.369993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.370097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.370336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.370611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.370855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.370977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.371104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.371372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.371599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.371775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.371925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.372167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.372426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.372752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.372957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.373123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.373267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.373291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.373416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.373574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.373600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.373729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.373855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.373880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.374002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.374257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.374532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.374843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.374985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.375110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.375234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.095 [2024-11-26 01:20:46.375259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.095 qpair failed and we were unable to recover it. 00:27:56.095 [2024-11-26 01:20:46.375384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.375488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.375513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.375640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.375788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.375814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.375913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.376161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.376427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.376708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.376855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.376983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.377279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.377553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.377851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.377995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.378160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.378422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.378668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.378791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.378948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.379225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.379462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.379737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.379890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.380012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.380163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.380188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.380342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.380464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.380489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.380609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.380713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.380741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.380873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.381257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.381473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.381774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.381917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.382032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.382293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.382564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.382862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.382993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.383177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.383439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.096 qpair failed and we were unable to recover it. 00:27:56.096 [2024-11-26 01:20:46.383732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.096 [2024-11-26 01:20:46.383901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.384021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.384174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.384199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.384345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.384490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.384515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.384669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.384828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.384871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.384982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.385243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.385569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.385833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.385996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.386172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.386466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.386721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.386892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.387051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.387348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.387604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.387879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.387992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.388167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.388418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.388693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.388892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.388989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.389259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.389534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.389777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.389983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.390074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.390293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.390586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.390830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.390956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.391085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.391177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.391204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.391334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.391456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.391481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.097 qpair failed and we were unable to recover it. 00:27:56.097 [2024-11-26 01:20:46.391600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.097 [2024-11-26 01:20:46.391718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.391744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.391864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.391986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.392144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.392358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.392609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.392763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.392886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.393187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.393425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.393715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.393928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.394075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.394242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.394267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.394362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.394478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.394503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.394617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.394755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.394784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.394933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.395182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.395440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.395664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.395854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.395993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.396132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.396159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.396283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.396408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.396432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.396527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.396652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.396678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.396838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.397185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.397451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.397670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.397859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.397958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.398187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.398461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.398729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.398914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.399039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.399164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.399189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.399280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.399429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.399454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.399603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.399738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.399776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.098 qpair failed and we were unable to recover it. 00:27:56.098 [2024-11-26 01:20:46.399913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.098 [2024-11-26 01:20:46.400067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.400245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.400523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.400786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.400902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.401030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.401241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.401481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.401775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.401938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.402080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.402221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.402246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.402393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.402491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.402515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.402617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.402758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.402802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.402928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.403197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.403444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.403691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.403811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.403907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.404179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.404484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.404784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.404970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.405101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.405236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.405261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.405388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.405505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.405530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.405648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.405804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.405848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.405972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.406243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.406492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.406747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.406897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.406996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.407246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.407545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.407794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.407970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.408071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.408190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.408215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.099 qpair failed and we were unable to recover it. 00:27:56.099 [2024-11-26 01:20:46.408366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.099 [2024-11-26 01:20:46.408482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.408507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.408671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.408820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.408847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.408982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.409261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.409514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.409815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.409942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.410039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.410341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.410583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.410857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.410989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.411112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.411261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.411286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.411415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.411510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.411536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.411660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.411779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.411822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.411965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.412236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.412503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.412829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.412985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.413119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.413260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.413285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.413434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.413561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.413586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.413756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.413897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.413922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.414067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.414210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.414235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa55c000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.414375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.414485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.414513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.414666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.414827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.414857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.414961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.415231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.415560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.415830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.415997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.416132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.416266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.416294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.416454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.416593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.416621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.416767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.416867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.416892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.417041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.417170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.417198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.100 qpair failed and we were unable to recover it. 00:27:56.100 [2024-11-26 01:20:46.417365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.100 [2024-11-26 01:20:46.417467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.417495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.417667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.417821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.417846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.417972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.418097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.418123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.418270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.418403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.418430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.418574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.418699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.418724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.418878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.419192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.419455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.419768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.419922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.420072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.420213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.420241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.420402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.420569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.420597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.420720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.420844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.420869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.421014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.421121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.421150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.421330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.421458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.421485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.421631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.421731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.421756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.421904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.422238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.422532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.422781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.422958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.423073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.423184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.423211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.423346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.423475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.423503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.423605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.423755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.423781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.423914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.424203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.424471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.424771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.424946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.425111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.425257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.101 [2024-11-26 01:20:46.425285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.101 qpair failed and we were unable to recover it. 00:27:56.101 [2024-11-26 01:20:46.425445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.425565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.425589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.425723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.425846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.425872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.425996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.426320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.426602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.426897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.426989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.427163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.427446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.427719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.427872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.427965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.428289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.428582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.428878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.428995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.429019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.429140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.429310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.429343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.429582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.429711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.429752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.429876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.429993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.430117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.430352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.430624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.430817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.430939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.431258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.431615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.431876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.431993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.432193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.432524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.432834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.432991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.433160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.433256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.433281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.433396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.433528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.433555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.433709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.433807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.433833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.433985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.434105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.434129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.434258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.434403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.434427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.102 qpair failed and we were unable to recover it. 00:27:56.102 [2024-11-26 01:20:46.434581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.102 [2024-11-26 01:20:46.434752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.434780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.434954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.435318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.435594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.435832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.435981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.436159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.436331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.436356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.436490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.436579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.436604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.436790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.436916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.436940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.437081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.437194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.437221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.437329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.437471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.437500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.437635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.437723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.437748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.437879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.438147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.438466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.438788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1172058 Killed "${NVMF_APP[@]}" "$@" 00:27:56.103 [2024-11-26 01:20:46.438923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.438951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.439086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 01:20:46 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:27:56.103 [2024-11-26 01:20:46.439196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.439223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 01:20:46 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:56.103 [2024-11-26 01:20:46.439363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.439461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 01:20:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:56.103 [2024-11-26 01:20:46.439487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 01:20:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:56.103 [2024-11-26 01:20:46.439627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:27:56.103 [2024-11-26 01:20:46.439760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.439789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.439893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.439990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.440150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.440470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.440710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.440870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.441018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.441290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.441558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.441866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.441995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.442114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.442358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.442620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 [2024-11-26 01:20:46.442769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.103 qpair failed and we were unable to recover it. 00:27:56.103 [2024-11-26 01:20:46.442898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.103 01:20:46 -- nvmf/common.sh@469 -- # nvmfpid=1172642 00:27:56.103 [2024-11-26 01:20:46.443032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.443059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 01:20:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:56.104 01:20:46 -- nvmf/common.sh@470 -- # waitforlisten 1172642 00:27:56.104 [2024-11-26 01:20:46.443199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.443315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.443345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 01:20:46 -- common/autotest_common.sh@829 -- # '[' -z 1172642 ']' 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 01:20:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:56.104 [2024-11-26 01:20:46.443492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 01:20:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:56.104 [2024-11-26 01:20:46.443636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.443664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 01:20:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:56.104 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:56.104 [2024-11-26 01:20:46.443838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 01:20:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:56.104 [2024-11-26 01:20:46.443940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 01:20:46 -- common/autotest_common.sh@10 -- # set +x 00:27:56.104 [2024-11-26 01:20:46.443964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.444056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.444305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.444598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.444859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.444998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.445118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.445233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.445260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.445437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.445548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.445578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.445716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.445859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.445892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.446006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.446135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.446160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.446355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.446476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.446501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.446707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.446832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.446857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.446980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.447276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.447617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.447882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.447983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.448137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.448450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.448706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.448823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.448955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.449241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.449539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.449829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.449976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.450119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.450261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.450288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.450408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.450531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.450556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.450719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.450851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.450879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.450984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.451117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.104 [2024-11-26 01:20:46.451146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.104 qpair failed and we were unable to recover it. 00:27:56.104 [2024-11-26 01:20:46.451316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.451442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.451467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.451610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.451734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.451760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.451864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.451983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.452127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.452358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.452698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.452834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.452977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.453099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.453124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.453299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.453420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.453447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.453611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.453750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.453779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.453943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.454232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.454548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.454890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.454982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.455200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.455517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.455805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.455994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.456126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.456272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.456297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.456392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.456511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.456536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.456647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.456812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.456853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.456961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.457110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.457135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.457287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.457450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.457477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.457637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.457814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.457840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.457993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.458249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.458537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.458824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.458970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.459122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.459234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.459260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.105 qpair failed and we were unable to recover it. 00:27:56.105 [2024-11-26 01:20:46.459386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.105 [2024-11-26 01:20:46.459509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.459533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.459681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.459834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.459861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.460004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.460251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.460466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.460813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.460938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.461060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.461179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.461204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.461357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.461450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.461476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.461628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.461812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.461841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.462009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.462279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.462580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.462824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.462967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.463151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.463285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.463312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.463466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.463579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.463607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.463722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.463855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.463881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.464014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.464261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.464618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.464887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.464987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.465129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.465445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.465725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.465856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.465955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.466123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.466150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.466272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.466419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.466445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.466613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.466798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.466828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.466959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.467184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.467427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.467733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.467892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.468016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.468133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.468158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.106 [2024-11-26 01:20:46.468275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.468414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.106 [2024-11-26 01:20:46.468442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.106 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.468583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.468716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.468745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.468891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.468989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.469138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.469419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.469771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.469892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.470031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.470184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.470209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.470333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.470475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.470503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.470682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.470808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.470833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.470959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.471271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.471597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.471842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.471988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.472090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.472215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.472243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.472382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.472533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.472563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.472676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.472800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.472826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.472916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.473222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.473468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.473712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.473885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.474003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.474255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.474556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.474842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.474992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.475175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.475451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.475746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.475889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.476032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.476165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.476193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.476336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.476498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.476526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.476635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.476792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.476819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.476915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.477036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.477061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.107 qpair failed and we were unable to recover it. 00:27:56.107 [2024-11-26 01:20:46.477183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.107 [2024-11-26 01:20:46.477326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.477354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.477500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.477621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.477646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.477778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.477915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.477943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.478043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.478178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.478206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.478326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.478449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.478476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.478631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.478729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.478757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.478892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.479233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.479522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.479785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.479949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.480092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.480218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.480244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.480375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.480483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.480511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.480643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.480753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.480781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.480924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.481265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.481538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.481805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.481979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.482132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.482236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.482265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.482364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.482528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.482555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.482698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.482821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.482846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.482992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.483299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.483543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.483828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.483983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.484124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.484108] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:56.108 [2024-11-26 01:20:46.484190] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:56.108 [2024-11-26 01:20:46.484265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.484294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.484462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.484586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.484611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.484761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.484879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.484904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.485053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.485167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.485195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.485341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.485441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.485466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.108 qpair failed and we were unable to recover it. 00:27:56.108 [2024-11-26 01:20:46.485618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.108 [2024-11-26 01:20:46.485742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.485768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.485863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.485950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.485975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.486071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.486197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.486222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.486333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.486516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.486544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.486653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.486781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.486811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.486936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.487183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.487434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.487730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.487848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.488003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.488282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.488563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.488837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.488979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.489180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.489430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.489775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.489923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.490056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.490332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.490567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.490876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.490988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.491181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.491475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.491779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.491933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.492052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.492165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.492190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.492316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.492439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.492465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.492660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.492759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.492785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.492908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.493059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.493084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.493241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.493523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.493554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.493750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.493891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.493920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.494027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.494179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.494204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.494369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.494465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.494495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.109 qpair failed and we were unable to recover it. 00:27:56.109 [2024-11-26 01:20:46.494663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.494803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.109 [2024-11-26 01:20:46.494832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.494950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.495260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.495536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.495821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.495974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.496095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.496257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.496285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.496417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.496581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.496609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.496722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.496815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.496841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.496944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.497188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.497494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.497765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.497875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.497978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.498242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.498467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.498716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.498838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.498989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.499298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.499539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.499846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.499971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.500099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.500219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.500245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.500337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.500460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.500486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.500605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.500702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.500728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.500868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.501132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.501407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.501664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.501832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.501959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.502099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.502127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.110 qpair failed and we were unable to recover it. 00:27:56.110 [2024-11-26 01:20:46.502239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.110 [2024-11-26 01:20:46.502365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.502390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.502561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.502696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.502725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.502868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.503175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.503494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.503768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.503928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.504039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.504286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.504617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.504902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.504999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.505114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.505433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.505782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.505931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.506042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.506341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.506563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.506807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.506964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.507117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.507427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.507759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.507885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.508003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.508124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.508152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.508268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.508416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.508441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.508580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.508679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.508724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.508890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.509158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.509422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.509726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.509899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.510022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.510256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.510520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.510821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.510970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.111 qpair failed and we were unable to recover it. 00:27:56.111 [2024-11-26 01:20:46.511116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.511262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.111 [2024-11-26 01:20:46.511287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.511412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.511549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.511577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.511681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.511806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.511831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.511959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.512281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.512554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.512887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.512988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.513121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.513436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.513754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.513894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.514008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.514282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.514550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.514880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.514994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.515145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.515373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.515740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.515887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.515987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.516134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.516159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.516268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.516410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.516437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.516627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.516774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.516800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.516951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.517279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.517581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.517852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.517977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 EAL: No free 2048 kB hugepages reported on node 1 00:27:56.112 [2024-11-26 01:20:46.518099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.518337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.518605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.518843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.518990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.519157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.519395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.519670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.519843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.112 [2024-11-26 01:20:46.519975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.520087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.112 [2024-11-26 01:20:46.520115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.112 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.520265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.520391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.520416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.520565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.520665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.520698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.520829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.520966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.520992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.521120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.521250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.521275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.521426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.521568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.521593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.521705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.521809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.521834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.521956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.522246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.522515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.522770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.522921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.523053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.523291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.523568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.523810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.523931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.524068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.524312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.524581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.524858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.524986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.525074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.525221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.525246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.525374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.525523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.525548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.525640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.525786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.525812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.525916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.526165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.526463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.526731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.526872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.527002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.527266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.527515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.527811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.527946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.528041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.528165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.528190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.528284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.528405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.113 [2024-11-26 01:20:46.528430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.113 qpair failed and we were unable to recover it. 00:27:56.113 [2024-11-26 01:20:46.528550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.528653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.528679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.528809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.528907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.528932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.529026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.529272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.529511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.529730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.529878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.530004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.530241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.530466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.530716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.530890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.531020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.531281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.531500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.531747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.531869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.531963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.532210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.532449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.532668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.532846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.532948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.533185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.533477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.533727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.533844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.533946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.534193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.534425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.534712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.534836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.534956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.535083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.535107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.114 [2024-11-26 01:20:46.535238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.535356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.114 [2024-11-26 01:20:46.535381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.114 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.535505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.535629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.535654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.535753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.535846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.535871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.535965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.536235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.536505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.536778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.536922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.537016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.537278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.537549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.537784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.537908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.538060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.538357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.538573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.538791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.538909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.539012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.539274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.539474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.539730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.539848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.539944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.540215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.540455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.540703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.540834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.540956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.541194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.541471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.541682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.541856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.541957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.542184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.542408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.542651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.542775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.115 qpair failed and we were unable to recover it. 00:27:56.115 [2024-11-26 01:20:46.542925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.115 [2024-11-26 01:20:46.543048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.543201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.543506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.543784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.543896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.544021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.544294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.544550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.544786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.544910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.545005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.545220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.545454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.545711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.545886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.545981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.546254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.546496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.546709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.546858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.546946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.547241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.547486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.547725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.547842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.547967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.548201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.548435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.548643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.548821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.548940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.549204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.549406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.549673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.549793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.549950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.550192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.550454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.116 qpair failed and we were unable to recover it. 00:27:56.116 [2024-11-26 01:20:46.550671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.116 [2024-11-26 01:20:46.550800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.550898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.551193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.551490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.551788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.551910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.552001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.552235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.552514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.552720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.552842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.552941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.553270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.553460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:56.117 [2024-11-26 01:20:46.553545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.553798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.553943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.554045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.554341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.554556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.554812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.554963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.555066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.555306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.555555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.555839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.555959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.556109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.556359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.556621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.556862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.556980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.557105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.557199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.557225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.557348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.557477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.557502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.557623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.557717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.557743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.557896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.558164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.558454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.117 qpair failed and we were unable to recover it. 00:27:56.117 [2024-11-26 01:20:46.558720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.117 [2024-11-26 01:20:46.558860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.558982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.559255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.559542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.559781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.559929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.560079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.560354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.560603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.560854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.560962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.561057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.561157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.561182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.561306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.561474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.561500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.561598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.561714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.561740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.561891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.562131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.562367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.562612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.562883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.562997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.563148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.563414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.563664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.563795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.563947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.564188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.564514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.564768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.564895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.565020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.565234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.565500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.118 [2024-11-26 01:20:46.565799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.118 [2024-11-26 01:20:46.565975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.118 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.566078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.566394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.566593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.566847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.566962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.567056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.567209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.567234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.567385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.567503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.567528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.567625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.567723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.567749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.567874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.568175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.568423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.568714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.568828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.568949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.569191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.569430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.569680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.569836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.569984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.570256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.570484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.570747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.570892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.570996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.571230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.571472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.571768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.571887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.571986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.572216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.572458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.572696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.572847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.572973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.573213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.573449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.573716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.119 [2024-11-26 01:20:46.573831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.119 qpair failed and we were unable to recover it. 00:27:56.119 [2024-11-26 01:20:46.573949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.574181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.574426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.574718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.574836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.574962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.575223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.575467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.575747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.575866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.575965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.576263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.576471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.576715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.576836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.576934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.577172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.577461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.577701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.577824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.577946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.578192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.578482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.578756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.578919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.579037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.579327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.579586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.579877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.579983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.580098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.580343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.580583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.580839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.580999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.581122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.581372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.581620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.120 qpair failed and we were unable to recover it. 00:27:56.120 [2024-11-26 01:20:46.581891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.120 [2024-11-26 01:20:46.581985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.121 qpair failed and we were unable to recover it. 00:27:56.121 [2024-11-26 01:20:46.582133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.121 qpair failed and we were unable to recover it. 00:27:56.121 [2024-11-26 01:20:46.582343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.121 qpair failed and we were unable to recover it. 00:27:56.121 [2024-11-26 01:20:46.582613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.121 qpair failed and we were unable to recover it. 00:27:56.121 [2024-11-26 01:20:46.582859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.582986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.583011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.121 qpair failed and we were unable to recover it. 00:27:56.121 [2024-11-26 01:20:46.583100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.583221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.583246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.121 qpair failed and we were unable to recover it. 00:27:56.121 [2024-11-26 01:20:46.583339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.121 [2024-11-26 01:20:46.583466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.583491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.583620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.583754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.583781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.583912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.584165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.584381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.584626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.584845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.584970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.585060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.585274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.585484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.585717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.585840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.585956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.586199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.586415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.586633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.586798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.586926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.587169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.587455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.587666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.587791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.587917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.588171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.588373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.588591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.588861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.588990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.589142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.589387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.589647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.589866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.589991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.590085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.590211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.590236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.590357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.590502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.390 [2024-11-26 01:20:46.590528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.390 qpair failed and we were unable to recover it. 00:27:56.390 [2024-11-26 01:20:46.590645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.590795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.590821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.590950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.591186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.591468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.591695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.591872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.591964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.592229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.592440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.592709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.592839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.592937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.593203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.593456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.593733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.593852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.593958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.594223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.594487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.594732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.594845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.594935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.595200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.595436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.595704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.595850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.595942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.596180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.596456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.596696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.596843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.596948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.597197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.597431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.597700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.597815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.597921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.598192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.598431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.598668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.598840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.598993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.599300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.599535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.599814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.599969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.600096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.600367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fa564000b90 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.600581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.391 qpair failed and we were unable to recover it. 00:27:56.391 [2024-11-26 01:20:46.600835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.391 [2024-11-26 01:20:46.600964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.600989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.601082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.601288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.601537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.601799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.601942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.602044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.602288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.602553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.602782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.602893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.603023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.603264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.603539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.603758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.603908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.604030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.604302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.604573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.604806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.604931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.605051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.605267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.605563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.605813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.605959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.606042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.606280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.606559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.606855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.606998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.607145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.607388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.607628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.607874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.607986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.608118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.608380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.608654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.608912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.608998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.609112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.609414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.609665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.609816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.609910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.610205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.610408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.610618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.610768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.610884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.611013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.611038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.392 qpair failed and we were unable to recover it. 00:27:56.392 [2024-11-26 01:20:46.611173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.392 [2024-11-26 01:20:46.611275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.611300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.611430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.611549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.611574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.611668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.611765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.611791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.611925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.612198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.612447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.612718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.612892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.613014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.613269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.613508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.613756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.613904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.614021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.614251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.614497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.614732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.614849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.614996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.615212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.615460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.615736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.615860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.615959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.616196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.616409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.616644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.616769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.616875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.617152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.617423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.617672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.617807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.617957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.618265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.618539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.618765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.618888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.619017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.619286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.619518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.619854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.619995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.620118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.620267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.620292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.393 qpair failed and we were unable to recover it. 00:27:56.393 [2024-11-26 01:20:46.620412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.620506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.393 [2024-11-26 01:20:46.620533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.620653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.620788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.620814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.620937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.621219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.621438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.621679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.621807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.621928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.622151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.622478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.622733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.622855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.622952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.623253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.623536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.623811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.623959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.624084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.624329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.624567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.624813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.624937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.625037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.625282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.625534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.625812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.625952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.626078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.626197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.626222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.626323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.626444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.626469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.626599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.626722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.626748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.626897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.627176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.627449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.627754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.627878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.627985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.628256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.628466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.628751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.628911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.629042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.629323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.629583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.629850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.629998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.630122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.630247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.630272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.630391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.630521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.630548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.630664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.630790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.630816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.630916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.631022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.394 [2024-11-26 01:20:46.631047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.394 qpair failed and we were unable to recover it. 00:27:56.394 [2024-11-26 01:20:46.631168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.631261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.631286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.631408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.631523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.631547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.631666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.631771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.631797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.631997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.632265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.632514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.632749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.632863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.632982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.633245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.633484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.633761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.633904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.634034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.634304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.634566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.634837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.634991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.635108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.635229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.635254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.635370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.635493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.635519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.635643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.635766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.635792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.635947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.636164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.636407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.636702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.636853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.636946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.637212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.637421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.637752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.637895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.638021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.638286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.638546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.638807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.638924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.639040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.639308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.639531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.639784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.639927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.640012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.640282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.640591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.640834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.640951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.641048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.641193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.641218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.641342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.641502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.641527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.641624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.641751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.395 [2024-11-26 01:20:46.641776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.395 qpair failed and we were unable to recover it. 00:27:56.395 [2024-11-26 01:20:46.641895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.642166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.642434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.642722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.642868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.643018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.643289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.643524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.643768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.643925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.644019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.644229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.644526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.644807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.644954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.645073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.645340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.645554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.645835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.645952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.646080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.646320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.646532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.646792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.646904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.647018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.647333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.647638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.647885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.647977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.648093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.648363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.648680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.648839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.648962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.649265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.649536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.649793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.649909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.650036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.650303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.650509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.650824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.650967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.651088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.651204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.651229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.651352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.651472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.396 [2024-11-26 01:20:46.651496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.396 qpair failed and we were unable to recover it. 00:27:56.396 [2024-11-26 01:20:46.651650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.651808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.651833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.651928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.652198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.652466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.652716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.652859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.652954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.653219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.653438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.653678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.653834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.653955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.654188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.654406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.654638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.654888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.654975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.655096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.655306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.655650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.655779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.655900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.656176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.656400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.656674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.656829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.656956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.657226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.657486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.657803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.657955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.658051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.658293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.658565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.658800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.658974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.659078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.659311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.659537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.659844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.659967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.660088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.660331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.660600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.660841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.660960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.661161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.661258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.661283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.661408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.661539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.661564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.661693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.661783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.661809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.661902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.662019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.662044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.397 qpair failed and we were unable to recover it. 00:27:56.397 [2024-11-26 01:20:46.662139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.397 [2024-11-26 01:20:46.662255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.662285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.662383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.662506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.662531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.662652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.662779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.662804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.662924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.663195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.663505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.663765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.663913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.664038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.664298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.664584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.664854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.664984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.665110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.665411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.665662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.665786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.665933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.666174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.666449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.666780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.666896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.666988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 [2024-11-26 01:20:46.667097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.667200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667220] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:56.398 [2024-11-26 01:20:46.667240] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:56.398 [2024-11-26 01:20:46.667254] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:56.398 [2024-11-26 01:20:46.667291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.667333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:56.398 [2024-11-26 01:20:46.667420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:56.398 [2024-11-26 01:20:46.667387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:56.398 [2024-11-26 01:20:46.667507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:56.398 [2024-11-26 01:20:46.667535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.667633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.667844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.667960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.668058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.668271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.668514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.668747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.668887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.669015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.669247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.669496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.669739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.669852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.670005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.670245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.670460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.670661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.670866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.670988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.671013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.671161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.671252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.671277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.398 [2024-11-26 01:20:46.671478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.671625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.398 [2024-11-26 01:20:46.671650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.398 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.671754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.671854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.671879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.672002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.672230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.672474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.672705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.672826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.672959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.673199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.673458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.673674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.673831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.673953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.674193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.674516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.674750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.674865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.674952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.675219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.675465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.675672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.675815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.675934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.676201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.676536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.676782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.676934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.677031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.677229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.677263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.677355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.677457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.677483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.677574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.677697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.677723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.677888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.678129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.678343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.678556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.678775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.678928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.679023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.679251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.679463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.679732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.679844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.679964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.680236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.680440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.680698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.680811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.681013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.681130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.681154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.399 qpair failed and we were unable to recover it. 00:27:56.399 [2024-11-26 01:20:46.681237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.681328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.399 [2024-11-26 01:20:46.681353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.681445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.681529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.681554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.681642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.681754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.681780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.681869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.681997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.682154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.682398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.682628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.682848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.682989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.683079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.683325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.683594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.683903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.683995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.684111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.684383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.684593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.684854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.684978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.685092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.685350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.685588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.685836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.685949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.686042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.686301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.686543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.686843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.686964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.687065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.687281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.687540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.687784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.687906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.688007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.688298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.688505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.688744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.688853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.688968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.689234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.689433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.689771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.689902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.689990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.690071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.690096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.400 [2024-11-26 01:20:46.690199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.690397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.400 [2024-11-26 01:20:46.690422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.400 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.690510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.690625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.690651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.690770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.690859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.690885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.691049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.691253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.691572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.691808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.691955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.692075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.692298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.692593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.692813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.692926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.693049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.693265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.693504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.693747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.693856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.693947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.694188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.694449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.694796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.694906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.695022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.695260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.695489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.695741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.695888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.695972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.696243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.696446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.696663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.696881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.696979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.697155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.697364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.697601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.697758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.697879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.698133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.698355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.698576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.698833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.698974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.699069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.699270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.699296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.699412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.699531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.699556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.699690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.699816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.699842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.700041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.700156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.700181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.700308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.700406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.700431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.401 qpair failed and we were unable to recover it. 00:27:56.401 [2024-11-26 01:20:46.700556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.401 [2024-11-26 01:20:46.700644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.700680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.700812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.700904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.700929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.701034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.701121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.701146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.701347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.701440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.701464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.701586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.701698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.701735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.701827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.702215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.702448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.702740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.702861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.702948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.703181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.703508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.703783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.703899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.704012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.704245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.704496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.704750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.704898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.705010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.705310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.705525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.705748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.705881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.705991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.706260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.706467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.706671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.706825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.706916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.707177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.707396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.707636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.707798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.707929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.708194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.708439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.708703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.708830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.708947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.709161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.709368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.709605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.709862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.709986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.710119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.710369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.710608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.402 qpair failed and we were unable to recover it. 00:27:56.402 [2024-11-26 01:20:46.710846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.710981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.402 [2024-11-26 01:20:46.711006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.711107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.711326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.711571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.711796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.711950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.712046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.712291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.712565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.712835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.712981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.713072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.713370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.713579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.713805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.713924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.714027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.714125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.714150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.714351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.714474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.714498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.714614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.714719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.714745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.714848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.715219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.715456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.715723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.715840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.715936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.716182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.716502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.716781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.716927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.717048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.717283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.717528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.717795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.717929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.718024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.718271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.718529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.718812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.718933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.719024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.719235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.719481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.719837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.719949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.403 qpair failed and we were unable to recover it. 00:27:56.403 [2024-11-26 01:20:46.720051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.720179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.403 [2024-11-26 01:20:46.720204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.720305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.720434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.720459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.720563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.720650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.720684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.720781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.720869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.720895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.720985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.721219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.721462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.721730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.721854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.721982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.722298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.722572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.722823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.722943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.723043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.723260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.723503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.723784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.723904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.724028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.724294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.724506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.724720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.724868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.724987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.725130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.725156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 [2024-11-26 01:20:46.725252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.725374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.725398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x19ffcb0 with addr=10.0.0.2, port=4420 00:27:56.404 qpair failed and we were unable to recover it. 00:27:56.404 A controller has encountered a failure and is being reset. 00:27:56.404 [2024-11-26 01:20:46.725564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.725746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:56.404 [2024-11-26 01:20:46.725777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a0d600 with addr=10.0.0.2, port=4420 00:27:56.404 [2024-11-26 01:20:46.725796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0d600 is same with the state(5) to be set 00:27:56.404 [2024-11-26 01:20:46.725821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a0d600 (9): Bad file descriptor 00:27:56.404 [2024-11-26 01:20:46.725840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:56.404 [2024-11-26 01:20:46.725854] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:56.404 [2024-11-26 01:20:46.725870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:56.404 Unable to reset the controller. 00:27:56.969 01:20:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:56.969 01:20:47 -- common/autotest_common.sh@862 -- # return 0 00:27:56.969 01:20:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:56.969 01:20:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:56.969 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:56.969 01:20:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:56.969 01:20:47 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:56.969 01:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.969 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:56.969 Malloc0 00:27:56.969 01:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:56.969 01:20:47 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:56.969 01:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:56.969 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:56.969 [2024-11-26 01:20:47.493000] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:56.969 01:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.226 01:20:47 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:57.226 01:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.226 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:57.226 01:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.226 01:20:47 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:57.226 01:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.226 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:57.226 01:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.226 01:20:47 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:57.226 01:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.226 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:57.226 [2024-11-26 01:20:47.521297] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:57.226 01:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.226 01:20:47 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:57.226 01:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:57.226 01:20:47 -- common/autotest_common.sh@10 -- # set +x 00:27:57.226 01:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:57.226 01:20:47 -- host/target_disconnect.sh@58 -- # wait 1172213 00:27:57.226 Controller properly reset. 00:28:02.489 Initializing NVMe Controllers 00:28:02.489 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:02.489 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:02.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:02.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:02.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:02.489 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:02.489 Initialization complete. Launching workers. 00:28:02.489 Starting thread on core 1 00:28:02.489 Starting thread on core 2 00:28:02.489 Starting thread on core 3 00:28:02.489 Starting thread on core 0 00:28:02.489 01:20:52 -- host/target_disconnect.sh@59 -- # sync 00:28:02.489 00:28:02.489 real 0m11.417s 00:28:02.489 user 0m36.745s 00:28:02.489 sys 0m7.533s 00:28:02.489 01:20:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:02.489 01:20:52 -- common/autotest_common.sh@10 -- # set +x 00:28:02.489 ************************************ 00:28:02.489 END TEST nvmf_target_disconnect_tc2 00:28:02.489 ************************************ 00:28:02.489 01:20:52 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:02.489 01:20:52 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:02.489 01:20:52 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:02.489 01:20:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:02.489 01:20:52 -- nvmf/common.sh@116 -- # sync 00:28:02.489 01:20:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:02.489 01:20:52 -- nvmf/common.sh@119 -- # set +e 00:28:02.489 01:20:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:02.489 01:20:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:02.489 rmmod nvme_tcp 00:28:02.489 rmmod nvme_fabrics 00:28:02.489 rmmod nvme_keyring 00:28:02.489 01:20:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:02.489 01:20:52 -- nvmf/common.sh@123 -- # set -e 00:28:02.490 01:20:52 -- nvmf/common.sh@124 -- # return 0 00:28:02.490 01:20:52 -- nvmf/common.sh@477 -- # '[' -n 1172642 ']' 00:28:02.490 01:20:52 -- nvmf/common.sh@478 -- # killprocess 1172642 00:28:02.490 01:20:52 -- common/autotest_common.sh@936 -- # '[' -z 1172642 ']' 00:28:02.490 01:20:52 -- common/autotest_common.sh@940 -- # kill -0 1172642 00:28:02.490 01:20:52 -- common/autotest_common.sh@941 -- # uname 00:28:02.490 01:20:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:02.490 01:20:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1172642 00:28:02.490 01:20:52 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:02.490 01:20:52 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:02.490 01:20:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1172642' 00:28:02.490 killing process with pid 1172642 00:28:02.490 01:20:52 -- common/autotest_common.sh@955 -- # kill 1172642 00:28:02.490 01:20:52 -- common/autotest_common.sh@960 -- # wait 1172642 00:28:02.749 01:20:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:02.749 01:20:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:02.749 01:20:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:02.749 01:20:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:02.749 01:20:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:02.749 01:20:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:02.749 01:20:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:02.749 01:20:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:04.652 01:20:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:04.652 00:28:04.652 real 0m16.270s 00:28:04.652 user 1m2.115s 00:28:04.652 sys 0m10.004s 00:28:04.652 01:20:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:04.652 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:04.652 ************************************ 00:28:04.652 END TEST nvmf_target_disconnect 00:28:04.652 ************************************ 00:28:04.912 01:20:55 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:04.912 01:20:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:04.912 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:04.912 01:20:55 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:04.912 00:28:04.912 real 21m29.788s 00:28:04.912 user 62m38.203s 00:28:04.912 sys 5m1.692s 00:28:04.912 01:20:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:04.912 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:04.912 ************************************ 00:28:04.912 END TEST nvmf_tcp 00:28:04.912 ************************************ 00:28:04.912 01:20:55 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:04.912 01:20:55 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:04.912 01:20:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:04.912 01:20:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:04.912 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:04.912 ************************************ 00:28:04.912 START TEST spdkcli_nvmf_tcp 00:28:04.912 ************************************ 00:28:04.912 01:20:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:04.912 * Looking for test storage... 00:28:04.912 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:04.912 01:20:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:04.912 01:20:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:04.912 01:20:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:04.912 01:20:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:04.912 01:20:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:04.912 01:20:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:04.912 01:20:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:04.912 01:20:55 -- scripts/common.sh@335 -- # IFS=.-: 00:28:04.912 01:20:55 -- scripts/common.sh@335 -- # read -ra ver1 00:28:04.912 01:20:55 -- scripts/common.sh@336 -- # IFS=.-: 00:28:04.912 01:20:55 -- scripts/common.sh@336 -- # read -ra ver2 00:28:04.912 01:20:55 -- scripts/common.sh@337 -- # local 'op=<' 00:28:04.912 01:20:55 -- scripts/common.sh@339 -- # ver1_l=2 00:28:04.912 01:20:55 -- scripts/common.sh@340 -- # ver2_l=1 00:28:04.912 01:20:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:04.912 01:20:55 -- scripts/common.sh@343 -- # case "$op" in 00:28:04.912 01:20:55 -- scripts/common.sh@344 -- # : 1 00:28:04.912 01:20:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:04.912 01:20:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:04.912 01:20:55 -- scripts/common.sh@364 -- # decimal 1 00:28:04.912 01:20:55 -- scripts/common.sh@352 -- # local d=1 00:28:04.912 01:20:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:04.912 01:20:55 -- scripts/common.sh@354 -- # echo 1 00:28:04.912 01:20:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:04.912 01:20:55 -- scripts/common.sh@365 -- # decimal 2 00:28:04.912 01:20:55 -- scripts/common.sh@352 -- # local d=2 00:28:04.912 01:20:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:04.912 01:20:55 -- scripts/common.sh@354 -- # echo 2 00:28:04.912 01:20:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:04.912 01:20:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:04.912 01:20:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:04.912 01:20:55 -- scripts/common.sh@367 -- # return 0 00:28:04.912 01:20:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:04.912 01:20:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:04.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:04.912 --rc genhtml_branch_coverage=1 00:28:04.912 --rc genhtml_function_coverage=1 00:28:04.912 --rc genhtml_legend=1 00:28:04.912 --rc geninfo_all_blocks=1 00:28:04.912 --rc geninfo_unexecuted_blocks=1 00:28:04.912 00:28:04.912 ' 00:28:04.912 01:20:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:04.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:04.912 --rc genhtml_branch_coverage=1 00:28:04.912 --rc genhtml_function_coverage=1 00:28:04.912 --rc genhtml_legend=1 00:28:04.912 --rc geninfo_all_blocks=1 00:28:04.912 --rc geninfo_unexecuted_blocks=1 00:28:04.912 00:28:04.912 ' 00:28:04.912 01:20:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:04.912 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:04.912 --rc genhtml_branch_coverage=1 00:28:04.912 --rc genhtml_function_coverage=1 00:28:04.912 --rc genhtml_legend=1 00:28:04.912 --rc geninfo_all_blocks=1 00:28:04.912 --rc geninfo_unexecuted_blocks=1 00:28:04.912 00:28:04.912 ' 00:28:04.913 01:20:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:04.913 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:04.913 --rc genhtml_branch_coverage=1 00:28:04.913 --rc genhtml_function_coverage=1 00:28:04.913 --rc genhtml_legend=1 00:28:04.913 --rc geninfo_all_blocks=1 00:28:04.913 --rc geninfo_unexecuted_blocks=1 00:28:04.913 00:28:04.913 ' 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:04.913 01:20:55 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:04.913 01:20:55 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:04.913 01:20:55 -- nvmf/common.sh@7 -- # uname -s 00:28:04.913 01:20:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:04.913 01:20:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:04.913 01:20:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:04.913 01:20:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:04.913 01:20:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:04.913 01:20:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:04.913 01:20:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:04.913 01:20:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:04.913 01:20:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:04.913 01:20:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:04.913 01:20:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:04.913 01:20:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:04.913 01:20:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:04.913 01:20:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:04.913 01:20:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:04.913 01:20:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:04.913 01:20:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:04.913 01:20:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:04.913 01:20:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:04.913 01:20:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.913 01:20:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.913 01:20:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.913 01:20:55 -- paths/export.sh@5 -- # export PATH 00:28:04.913 01:20:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:04.913 01:20:55 -- nvmf/common.sh@46 -- # : 0 00:28:04.913 01:20:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:04.913 01:20:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:04.913 01:20:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:04.913 01:20:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:04.913 01:20:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:04.913 01:20:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:04.913 01:20:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:04.913 01:20:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:04.913 01:20:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:04.913 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:04.913 01:20:55 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:04.913 01:20:55 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1173869 00:28:04.913 01:20:55 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:04.913 01:20:55 -- spdkcli/common.sh@34 -- # waitforlisten 1173869 00:28:04.913 01:20:55 -- common/autotest_common.sh@829 -- # '[' -z 1173869 ']' 00:28:04.913 01:20:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:04.913 01:20:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:04.913 01:20:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:04.913 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:04.913 01:20:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:04.913 01:20:55 -- common/autotest_common.sh@10 -- # set +x 00:28:04.913 [2024-11-26 01:20:55.440044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:04.913 [2024-11-26 01:20:55.440144] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1173869 ] 00:28:05.172 EAL: No free 2048 kB hugepages reported on node 1 00:28:05.172 [2024-11-26 01:20:55.501563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:05.172 [2024-11-26 01:20:55.609924] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:05.172 [2024-11-26 01:20:55.610150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:05.172 [2024-11-26 01:20:55.610151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:06.199 01:20:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:06.199 01:20:56 -- common/autotest_common.sh@862 -- # return 0 00:28:06.199 01:20:56 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:06.199 01:20:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:06.199 01:20:56 -- common/autotest_common.sh@10 -- # set +x 00:28:06.199 01:20:56 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:06.199 01:20:56 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:06.199 01:20:56 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:06.199 01:20:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:06.199 01:20:56 -- common/autotest_common.sh@10 -- # set +x 00:28:06.199 01:20:56 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:06.199 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:06.199 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:06.199 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:06.199 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:06.199 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:06.199 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:06.199 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:06.199 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:06.199 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:06.199 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:06.199 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:06.199 ' 00:28:06.458 [2024-11-26 01:20:56.842581] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:08.987 [2024-11-26 01:20:59.015630] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:09.920 [2024-11-26 01:21:00.284264] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:12.449 [2024-11-26 01:21:02.603868] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:14.347 [2024-11-26 01:21:04.606349] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:15.720 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:15.720 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:15.720 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:15.720 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:15.720 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:15.720 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:15.720 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:15.720 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:15.721 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:15.721 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:15.721 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:15.721 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:15.721 01:21:06 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:15.721 01:21:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:15.721 01:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:15.978 01:21:06 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:15.978 01:21:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:15.978 01:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:15.978 01:21:06 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:15.978 01:21:06 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:16.236 01:21:06 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:16.236 01:21:06 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:16.236 01:21:06 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:16.236 01:21:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:16.236 01:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:16.494 01:21:06 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:16.494 01:21:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:16.494 01:21:06 -- common/autotest_common.sh@10 -- # set +x 00:28:16.494 01:21:06 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:16.494 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:16.494 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:16.494 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:16.494 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:16.494 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:16.494 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:16.494 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:16.494 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:16.494 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:16.494 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:16.494 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:16.494 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:16.494 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:16.494 ' 00:28:21.755 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:21.755 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:21.755 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:21.755 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:21.755 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:21.755 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:21.755 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:21.755 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:21.755 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:21.755 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:21.755 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:21.755 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:21.755 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:21.755 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:21.755 01:21:12 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:21.755 01:21:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:21.755 01:21:12 -- common/autotest_common.sh@10 -- # set +x 00:28:21.755 01:21:12 -- spdkcli/nvmf.sh@90 -- # killprocess 1173869 00:28:21.755 01:21:12 -- common/autotest_common.sh@936 -- # '[' -z 1173869 ']' 00:28:21.755 01:21:12 -- common/autotest_common.sh@940 -- # kill -0 1173869 00:28:21.755 01:21:12 -- common/autotest_common.sh@941 -- # uname 00:28:21.755 01:21:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:21.755 01:21:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1173869 00:28:21.755 01:21:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:21.755 01:21:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:21.755 01:21:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1173869' 00:28:21.755 killing process with pid 1173869 00:28:21.755 01:21:12 -- common/autotest_common.sh@955 -- # kill 1173869 00:28:21.755 [2024-11-26 01:21:12.162098] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:21.755 01:21:12 -- common/autotest_common.sh@960 -- # wait 1173869 00:28:22.013 01:21:12 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:22.013 01:21:12 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:22.013 01:21:12 -- spdkcli/common.sh@13 -- # '[' -n 1173869 ']' 00:28:22.013 01:21:12 -- spdkcli/common.sh@14 -- # killprocess 1173869 00:28:22.013 01:21:12 -- common/autotest_common.sh@936 -- # '[' -z 1173869 ']' 00:28:22.013 01:21:12 -- common/autotest_common.sh@940 -- # kill -0 1173869 00:28:22.013 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1173869) - No such process 00:28:22.013 01:21:12 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1173869 is not found' 00:28:22.013 Process with pid 1173869 is not found 00:28:22.013 01:21:12 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:22.013 01:21:12 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:22.013 01:21:12 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:22.013 00:28:22.013 real 0m17.193s 00:28:22.013 user 0m36.720s 00:28:22.013 sys 0m0.831s 00:28:22.013 01:21:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:22.013 01:21:12 -- common/autotest_common.sh@10 -- # set +x 00:28:22.013 ************************************ 00:28:22.013 END TEST spdkcli_nvmf_tcp 00:28:22.013 ************************************ 00:28:22.013 01:21:12 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:22.013 01:21:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:22.013 01:21:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:22.013 01:21:12 -- common/autotest_common.sh@10 -- # set +x 00:28:22.013 ************************************ 00:28:22.013 START TEST nvmf_identify_passthru 00:28:22.013 ************************************ 00:28:22.013 01:21:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:22.013 * Looking for test storage... 00:28:22.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:22.013 01:21:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:22.013 01:21:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:22.013 01:21:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:22.272 01:21:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:22.272 01:21:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:22.272 01:21:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:22.272 01:21:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:22.272 01:21:12 -- scripts/common.sh@335 -- # IFS=.-: 00:28:22.272 01:21:12 -- scripts/common.sh@335 -- # read -ra ver1 00:28:22.272 01:21:12 -- scripts/common.sh@336 -- # IFS=.-: 00:28:22.272 01:21:12 -- scripts/common.sh@336 -- # read -ra ver2 00:28:22.272 01:21:12 -- scripts/common.sh@337 -- # local 'op=<' 00:28:22.272 01:21:12 -- scripts/common.sh@339 -- # ver1_l=2 00:28:22.272 01:21:12 -- scripts/common.sh@340 -- # ver2_l=1 00:28:22.272 01:21:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:22.272 01:21:12 -- scripts/common.sh@343 -- # case "$op" in 00:28:22.272 01:21:12 -- scripts/common.sh@344 -- # : 1 00:28:22.272 01:21:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:22.272 01:21:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:22.272 01:21:12 -- scripts/common.sh@364 -- # decimal 1 00:28:22.272 01:21:12 -- scripts/common.sh@352 -- # local d=1 00:28:22.272 01:21:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:22.272 01:21:12 -- scripts/common.sh@354 -- # echo 1 00:28:22.272 01:21:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:22.272 01:21:12 -- scripts/common.sh@365 -- # decimal 2 00:28:22.272 01:21:12 -- scripts/common.sh@352 -- # local d=2 00:28:22.272 01:21:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:22.272 01:21:12 -- scripts/common.sh@354 -- # echo 2 00:28:22.272 01:21:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:22.272 01:21:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:22.272 01:21:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:22.272 01:21:12 -- scripts/common.sh@367 -- # return 0 00:28:22.272 01:21:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:22.272 01:21:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:22.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.272 --rc genhtml_branch_coverage=1 00:28:22.272 --rc genhtml_function_coverage=1 00:28:22.272 --rc genhtml_legend=1 00:28:22.272 --rc geninfo_all_blocks=1 00:28:22.272 --rc geninfo_unexecuted_blocks=1 00:28:22.272 00:28:22.272 ' 00:28:22.272 01:21:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:22.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.272 --rc genhtml_branch_coverage=1 00:28:22.272 --rc genhtml_function_coverage=1 00:28:22.272 --rc genhtml_legend=1 00:28:22.272 --rc geninfo_all_blocks=1 00:28:22.272 --rc geninfo_unexecuted_blocks=1 00:28:22.272 00:28:22.272 ' 00:28:22.272 01:21:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:22.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.272 --rc genhtml_branch_coverage=1 00:28:22.272 --rc genhtml_function_coverage=1 00:28:22.272 --rc genhtml_legend=1 00:28:22.272 --rc geninfo_all_blocks=1 00:28:22.272 --rc geninfo_unexecuted_blocks=1 00:28:22.272 00:28:22.272 ' 00:28:22.272 01:21:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:22.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.272 --rc genhtml_branch_coverage=1 00:28:22.272 --rc genhtml_function_coverage=1 00:28:22.272 --rc genhtml_legend=1 00:28:22.272 --rc geninfo_all_blocks=1 00:28:22.272 --rc geninfo_unexecuted_blocks=1 00:28:22.272 00:28:22.272 ' 00:28:22.272 01:21:12 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:22.272 01:21:12 -- nvmf/common.sh@7 -- # uname -s 00:28:22.272 01:21:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:22.272 01:21:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:22.272 01:21:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:22.272 01:21:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:22.272 01:21:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:22.272 01:21:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:22.272 01:21:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:22.272 01:21:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:22.272 01:21:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:22.272 01:21:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:22.272 01:21:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:22.273 01:21:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:22.273 01:21:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:22.273 01:21:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:22.273 01:21:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:22.273 01:21:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:22.273 01:21:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:22.273 01:21:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:22.273 01:21:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:22.273 01:21:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- paths/export.sh@5 -- # export PATH 00:28:22.273 01:21:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- nvmf/common.sh@46 -- # : 0 00:28:22.273 01:21:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:22.273 01:21:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:22.273 01:21:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:22.273 01:21:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:22.273 01:21:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:22.273 01:21:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:22.273 01:21:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:22.273 01:21:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:22.273 01:21:12 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:22.273 01:21:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:22.273 01:21:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:22.273 01:21:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:22.273 01:21:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- paths/export.sh@5 -- # export PATH 00:28:22.273 01:21:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.273 01:21:12 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:22.273 01:21:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:22.273 01:21:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:22.273 01:21:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:22.273 01:21:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:22.273 01:21:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:22.273 01:21:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:22.273 01:21:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:22.273 01:21:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.273 01:21:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:22.273 01:21:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:22.273 01:21:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:22.273 01:21:12 -- common/autotest_common.sh@10 -- # set +x 00:28:24.177 01:21:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:24.177 01:21:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:24.177 01:21:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:24.177 01:21:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:24.177 01:21:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:24.177 01:21:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:24.177 01:21:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:24.177 01:21:14 -- nvmf/common.sh@294 -- # net_devs=() 00:28:24.177 01:21:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:24.177 01:21:14 -- nvmf/common.sh@295 -- # e810=() 00:28:24.177 01:21:14 -- nvmf/common.sh@295 -- # local -ga e810 00:28:24.177 01:21:14 -- nvmf/common.sh@296 -- # x722=() 00:28:24.177 01:21:14 -- nvmf/common.sh@296 -- # local -ga x722 00:28:24.177 01:21:14 -- nvmf/common.sh@297 -- # mlx=() 00:28:24.177 01:21:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:24.177 01:21:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:24.177 01:21:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:24.177 01:21:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:24.177 01:21:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:24.177 01:21:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:24.177 01:21:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:24.177 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:24.177 01:21:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:24.177 01:21:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:24.177 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:24.177 01:21:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:24.177 01:21:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:24.177 01:21:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:24.177 01:21:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:24.177 01:21:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:24.177 01:21:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:24.177 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:24.177 01:21:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:24.177 01:21:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:24.177 01:21:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:24.177 01:21:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:24.177 01:21:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:24.177 01:21:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:24.177 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:24.177 01:21:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:24.177 01:21:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:24.177 01:21:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:24.177 01:21:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:24.177 01:21:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:24.177 01:21:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:24.177 01:21:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:24.177 01:21:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:24.177 01:21:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:24.177 01:21:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:24.177 01:21:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:24.177 01:21:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:24.177 01:21:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:24.177 01:21:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:24.177 01:21:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:24.177 01:21:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:24.177 01:21:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:24.177 01:21:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:24.177 01:21:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:24.177 01:21:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:24.177 01:21:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:24.177 01:21:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:24.177 01:21:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:24.177 01:21:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:24.177 01:21:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:24.177 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:24.177 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.256 ms 00:28:24.177 00:28:24.177 --- 10.0.0.2 ping statistics --- 00:28:24.177 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:24.177 rtt min/avg/max/mdev = 0.256/0.256/0.256/0.000 ms 00:28:24.177 01:21:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:24.177 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:24.177 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:28:24.177 00:28:24.178 --- 10.0.0.1 ping statistics --- 00:28:24.178 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:24.178 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:28:24.178 01:21:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:24.178 01:21:14 -- nvmf/common.sh@410 -- # return 0 00:28:24.178 01:21:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:24.178 01:21:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:24.178 01:21:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:24.178 01:21:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:24.178 01:21:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:24.178 01:21:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:24.178 01:21:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:24.436 01:21:14 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:24.436 01:21:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:24.436 01:21:14 -- common/autotest_common.sh@10 -- # set +x 00:28:24.436 01:21:14 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:24.436 01:21:14 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:24.436 01:21:14 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:24.436 01:21:14 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:24.436 01:21:14 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:24.436 01:21:14 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:24.436 01:21:14 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:24.436 01:21:14 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:24.436 01:21:14 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:24.436 01:21:14 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:24.436 01:21:14 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:24.436 01:21:14 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:24.436 01:21:14 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:24.436 01:21:14 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:24.436 01:21:14 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:24.436 01:21:14 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:24.436 01:21:14 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:24.436 01:21:14 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:24.436 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.625 01:21:18 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:28.625 01:21:18 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:28.625 01:21:18 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:28.625 01:21:18 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:28.625 EAL: No free 2048 kB hugepages reported on node 1 00:28:32.810 01:21:23 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:32.810 01:21:23 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:32.810 01:21:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:32.810 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:32.810 01:21:23 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:32.811 01:21:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:32.811 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:32.811 01:21:23 -- target/identify_passthru.sh@31 -- # nvmfpid=1179491 00:28:32.811 01:21:23 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:32.811 01:21:23 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:32.811 01:21:23 -- target/identify_passthru.sh@35 -- # waitforlisten 1179491 00:28:32.811 01:21:23 -- common/autotest_common.sh@829 -- # '[' -z 1179491 ']' 00:28:32.811 01:21:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:32.811 01:21:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:32.811 01:21:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:32.811 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:32.811 01:21:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:32.811 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:32.811 [2024-11-26 01:21:23.314482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:32.811 [2024-11-26 01:21:23.314564] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:33.069 EAL: No free 2048 kB hugepages reported on node 1 00:28:33.069 [2024-11-26 01:21:23.390101] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:33.069 [2024-11-26 01:21:23.509780] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:33.069 [2024-11-26 01:21:23.509952] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:33.069 [2024-11-26 01:21:23.509969] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:33.069 [2024-11-26 01:21:23.509982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:33.069 [2024-11-26 01:21:23.513712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:33.069 [2024-11-26 01:21:23.513766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:33.069 [2024-11-26 01:21:23.513864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:33.069 [2024-11-26 01:21:23.513867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:33.069 01:21:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:33.069 01:21:23 -- common/autotest_common.sh@862 -- # return 0 00:28:33.069 01:21:23 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:33.069 01:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.069 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:33.069 INFO: Log level set to 20 00:28:33.069 INFO: Requests: 00:28:33.069 { 00:28:33.069 "jsonrpc": "2.0", 00:28:33.069 "method": "nvmf_set_config", 00:28:33.069 "id": 1, 00:28:33.069 "params": { 00:28:33.069 "admin_cmd_passthru": { 00:28:33.069 "identify_ctrlr": true 00:28:33.069 } 00:28:33.069 } 00:28:33.069 } 00:28:33.069 00:28:33.069 INFO: response: 00:28:33.069 { 00:28:33.069 "jsonrpc": "2.0", 00:28:33.069 "id": 1, 00:28:33.069 "result": true 00:28:33.069 } 00:28:33.069 00:28:33.069 01:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.069 01:21:23 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:33.069 01:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.069 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:33.069 INFO: Setting log level to 20 00:28:33.069 INFO: Setting log level to 20 00:28:33.069 INFO: Log level set to 20 00:28:33.069 INFO: Log level set to 20 00:28:33.069 INFO: Requests: 00:28:33.069 { 00:28:33.069 "jsonrpc": "2.0", 00:28:33.069 "method": "framework_start_init", 00:28:33.069 "id": 1 00:28:33.069 } 00:28:33.069 00:28:33.069 INFO: Requests: 00:28:33.069 { 00:28:33.069 "jsonrpc": "2.0", 00:28:33.069 "method": "framework_start_init", 00:28:33.069 "id": 1 00:28:33.069 } 00:28:33.069 00:28:33.327 [2024-11-26 01:21:23.691102] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:33.327 INFO: response: 00:28:33.327 { 00:28:33.327 "jsonrpc": "2.0", 00:28:33.327 "id": 1, 00:28:33.327 "result": true 00:28:33.327 } 00:28:33.327 00:28:33.327 INFO: response: 00:28:33.327 { 00:28:33.327 "jsonrpc": "2.0", 00:28:33.327 "id": 1, 00:28:33.327 "result": true 00:28:33.327 } 00:28:33.327 00:28:33.327 01:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.327 01:21:23 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:33.327 01:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.327 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:33.327 INFO: Setting log level to 40 00:28:33.327 INFO: Setting log level to 40 00:28:33.327 INFO: Setting log level to 40 00:28:33.327 [2024-11-26 01:21:23.701216] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:33.327 01:21:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.327 01:21:23 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:33.327 01:21:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:33.327 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:33.327 01:21:23 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:33.327 01:21:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.327 01:21:23 -- common/autotest_common.sh@10 -- # set +x 00:28:36.606 Nvme0n1 00:28:36.606 01:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.606 01:21:26 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:36.606 01:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.606 01:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:36.606 01:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.606 01:21:26 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:36.606 01:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.606 01:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:36.606 01:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.606 01:21:26 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:36.606 01:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.606 01:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:36.606 [2024-11-26 01:21:26.595933] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:36.606 01:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.606 01:21:26 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:36.606 01:21:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.606 01:21:26 -- common/autotest_common.sh@10 -- # set +x 00:28:36.606 [2024-11-26 01:21:26.603617] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:36.606 [ 00:28:36.606 { 00:28:36.606 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:36.606 "subtype": "Discovery", 00:28:36.606 "listen_addresses": [], 00:28:36.606 "allow_any_host": true, 00:28:36.606 "hosts": [] 00:28:36.606 }, 00:28:36.606 { 00:28:36.606 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:36.606 "subtype": "NVMe", 00:28:36.606 "listen_addresses": [ 00:28:36.606 { 00:28:36.606 "transport": "TCP", 00:28:36.606 "trtype": "TCP", 00:28:36.606 "adrfam": "IPv4", 00:28:36.606 "traddr": "10.0.0.2", 00:28:36.606 "trsvcid": "4420" 00:28:36.606 } 00:28:36.606 ], 00:28:36.606 "allow_any_host": true, 00:28:36.606 "hosts": [], 00:28:36.606 "serial_number": "SPDK00000000000001", 00:28:36.606 "model_number": "SPDK bdev Controller", 00:28:36.606 "max_namespaces": 1, 00:28:36.606 "min_cntlid": 1, 00:28:36.606 "max_cntlid": 65519, 00:28:36.606 "namespaces": [ 00:28:36.606 { 00:28:36.606 "nsid": 1, 00:28:36.606 "bdev_name": "Nvme0n1", 00:28:36.606 "name": "Nvme0n1", 00:28:36.606 "nguid": "8A80EE711FBC4CABA2D92287215A84E2", 00:28:36.606 "uuid": "8a80ee71-1fbc-4cab-a2d9-2287215a84e2" 00:28:36.606 } 00:28:36.606 ] 00:28:36.606 } 00:28:36.606 ] 00:28:36.606 01:21:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.606 01:21:26 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:36.606 01:21:26 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:36.606 01:21:26 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:36.606 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.606 01:21:26 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:36.606 01:21:26 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:36.606 01:21:26 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:36.606 01:21:26 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:36.606 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.606 01:21:27 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:36.606 01:21:27 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:36.606 01:21:27 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:36.606 01:21:27 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:36.606 01:21:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.606 01:21:27 -- common/autotest_common.sh@10 -- # set +x 00:28:36.606 01:21:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.606 01:21:27 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:36.606 01:21:27 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:36.606 01:21:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:36.607 01:21:27 -- nvmf/common.sh@116 -- # sync 00:28:36.607 01:21:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:36.607 01:21:27 -- nvmf/common.sh@119 -- # set +e 00:28:36.607 01:21:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:36.607 01:21:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:36.607 rmmod nvme_tcp 00:28:36.607 rmmod nvme_fabrics 00:28:36.607 rmmod nvme_keyring 00:28:36.607 01:21:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:36.607 01:21:27 -- nvmf/common.sh@123 -- # set -e 00:28:36.607 01:21:27 -- nvmf/common.sh@124 -- # return 0 00:28:36.607 01:21:27 -- nvmf/common.sh@477 -- # '[' -n 1179491 ']' 00:28:36.607 01:21:27 -- nvmf/common.sh@478 -- # killprocess 1179491 00:28:36.607 01:21:27 -- common/autotest_common.sh@936 -- # '[' -z 1179491 ']' 00:28:36.607 01:21:27 -- common/autotest_common.sh@940 -- # kill -0 1179491 00:28:36.607 01:21:27 -- common/autotest_common.sh@941 -- # uname 00:28:36.607 01:21:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:36.607 01:21:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1179491 00:28:36.864 01:21:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:36.864 01:21:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:36.864 01:21:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1179491' 00:28:36.864 killing process with pid 1179491 00:28:36.864 01:21:27 -- common/autotest_common.sh@955 -- # kill 1179491 00:28:36.864 [2024-11-26 01:21:27.160091] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:36.864 01:21:27 -- common/autotest_common.sh@960 -- # wait 1179491 00:28:38.237 01:21:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:38.237 01:21:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:38.237 01:21:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:38.237 01:21:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:38.237 01:21:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:38.237 01:21:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:38.237 01:21:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:38.237 01:21:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:40.785 01:21:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:40.785 00:28:40.785 real 0m18.329s 00:28:40.785 user 0m27.395s 00:28:40.785 sys 0m2.364s 00:28:40.785 01:21:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:40.785 01:21:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.785 ************************************ 00:28:40.785 END TEST nvmf_identify_passthru 00:28:40.785 ************************************ 00:28:40.785 01:21:30 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:40.785 01:21:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:40.785 01:21:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:40.785 01:21:30 -- common/autotest_common.sh@10 -- # set +x 00:28:40.785 ************************************ 00:28:40.785 START TEST nvmf_dif 00:28:40.785 ************************************ 00:28:40.785 01:21:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:40.785 * Looking for test storage... 00:28:40.785 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:40.785 01:21:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:40.785 01:21:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:40.785 01:21:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:40.785 01:21:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:40.785 01:21:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:40.785 01:21:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:40.785 01:21:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:40.785 01:21:30 -- scripts/common.sh@335 -- # IFS=.-: 00:28:40.785 01:21:30 -- scripts/common.sh@335 -- # read -ra ver1 00:28:40.785 01:21:30 -- scripts/common.sh@336 -- # IFS=.-: 00:28:40.785 01:21:30 -- scripts/common.sh@336 -- # read -ra ver2 00:28:40.785 01:21:30 -- scripts/common.sh@337 -- # local 'op=<' 00:28:40.785 01:21:30 -- scripts/common.sh@339 -- # ver1_l=2 00:28:40.785 01:21:30 -- scripts/common.sh@340 -- # ver2_l=1 00:28:40.785 01:21:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:40.785 01:21:30 -- scripts/common.sh@343 -- # case "$op" in 00:28:40.785 01:21:30 -- scripts/common.sh@344 -- # : 1 00:28:40.785 01:21:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:40.785 01:21:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:40.785 01:21:30 -- scripts/common.sh@364 -- # decimal 1 00:28:40.785 01:21:30 -- scripts/common.sh@352 -- # local d=1 00:28:40.785 01:21:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:40.785 01:21:30 -- scripts/common.sh@354 -- # echo 1 00:28:40.785 01:21:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:40.785 01:21:30 -- scripts/common.sh@365 -- # decimal 2 00:28:40.785 01:21:30 -- scripts/common.sh@352 -- # local d=2 00:28:40.785 01:21:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:40.785 01:21:30 -- scripts/common.sh@354 -- # echo 2 00:28:40.785 01:21:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:40.785 01:21:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:40.785 01:21:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:40.785 01:21:30 -- scripts/common.sh@367 -- # return 0 00:28:40.785 01:21:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:40.785 01:21:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:40.785 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.785 --rc genhtml_branch_coverage=1 00:28:40.785 --rc genhtml_function_coverage=1 00:28:40.785 --rc genhtml_legend=1 00:28:40.785 --rc geninfo_all_blocks=1 00:28:40.785 --rc geninfo_unexecuted_blocks=1 00:28:40.785 00:28:40.785 ' 00:28:40.785 01:21:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:40.785 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.785 --rc genhtml_branch_coverage=1 00:28:40.785 --rc genhtml_function_coverage=1 00:28:40.785 --rc genhtml_legend=1 00:28:40.785 --rc geninfo_all_blocks=1 00:28:40.785 --rc geninfo_unexecuted_blocks=1 00:28:40.785 00:28:40.785 ' 00:28:40.785 01:21:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:40.785 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.785 --rc genhtml_branch_coverage=1 00:28:40.785 --rc genhtml_function_coverage=1 00:28:40.785 --rc genhtml_legend=1 00:28:40.785 --rc geninfo_all_blocks=1 00:28:40.785 --rc geninfo_unexecuted_blocks=1 00:28:40.785 00:28:40.785 ' 00:28:40.785 01:21:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:40.785 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:40.785 --rc genhtml_branch_coverage=1 00:28:40.785 --rc genhtml_function_coverage=1 00:28:40.785 --rc genhtml_legend=1 00:28:40.785 --rc geninfo_all_blocks=1 00:28:40.785 --rc geninfo_unexecuted_blocks=1 00:28:40.785 00:28:40.785 ' 00:28:40.785 01:21:30 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:40.785 01:21:30 -- nvmf/common.sh@7 -- # uname -s 00:28:40.785 01:21:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:40.785 01:21:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:40.785 01:21:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:40.785 01:21:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:40.785 01:21:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:40.785 01:21:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:40.785 01:21:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:40.785 01:21:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:40.785 01:21:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:40.785 01:21:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:40.785 01:21:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:40.785 01:21:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:40.785 01:21:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:40.785 01:21:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:40.785 01:21:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:40.785 01:21:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:40.785 01:21:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:40.785 01:21:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:40.785 01:21:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:40.785 01:21:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.785 01:21:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.785 01:21:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.785 01:21:30 -- paths/export.sh@5 -- # export PATH 00:28:40.785 01:21:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:40.785 01:21:30 -- nvmf/common.sh@46 -- # : 0 00:28:40.785 01:21:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:40.785 01:21:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:40.785 01:21:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:40.785 01:21:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:40.785 01:21:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:40.785 01:21:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:40.785 01:21:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:40.785 01:21:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:40.785 01:21:30 -- target/dif.sh@15 -- # NULL_META=16 00:28:40.785 01:21:30 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:40.785 01:21:30 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:40.785 01:21:30 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:40.785 01:21:30 -- target/dif.sh@135 -- # nvmftestinit 00:28:40.785 01:21:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:40.785 01:21:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:40.785 01:21:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:40.785 01:21:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:40.785 01:21:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:40.785 01:21:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:40.785 01:21:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:40.785 01:21:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:40.786 01:21:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:40.786 01:21:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:40.786 01:21:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:40.786 01:21:30 -- common/autotest_common.sh@10 -- # set +x 00:28:42.688 01:21:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:42.688 01:21:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:42.688 01:21:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:42.688 01:21:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:42.688 01:21:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:42.688 01:21:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:42.688 01:21:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:42.688 01:21:33 -- nvmf/common.sh@294 -- # net_devs=() 00:28:42.688 01:21:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:42.688 01:21:33 -- nvmf/common.sh@295 -- # e810=() 00:28:42.688 01:21:33 -- nvmf/common.sh@295 -- # local -ga e810 00:28:42.688 01:21:33 -- nvmf/common.sh@296 -- # x722=() 00:28:42.688 01:21:33 -- nvmf/common.sh@296 -- # local -ga x722 00:28:42.688 01:21:33 -- nvmf/common.sh@297 -- # mlx=() 00:28:42.688 01:21:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:42.688 01:21:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:42.688 01:21:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:42.688 01:21:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:42.688 01:21:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:42.688 01:21:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:42.688 01:21:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:42.688 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:42.688 01:21:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:42.688 01:21:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:42.688 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:42.688 01:21:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:42.688 01:21:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:42.688 01:21:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:42.688 01:21:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:42.688 01:21:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:42.688 01:21:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:42.689 01:21:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:42.689 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:42.689 01:21:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:42.689 01:21:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:42.689 01:21:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:42.689 01:21:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:42.689 01:21:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:42.689 01:21:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:42.689 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:42.689 01:21:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:42.689 01:21:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:42.689 01:21:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:42.689 01:21:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:42.689 01:21:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:42.689 01:21:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:42.689 01:21:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:42.689 01:21:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:42.689 01:21:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:42.689 01:21:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:42.689 01:21:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:42.689 01:21:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:42.689 01:21:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:42.689 01:21:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:42.689 01:21:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:42.689 01:21:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:42.689 01:21:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:42.689 01:21:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:42.689 01:21:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:42.689 01:21:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:42.689 01:21:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:42.689 01:21:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:42.689 01:21:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:42.689 01:21:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:42.689 01:21:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:42.689 01:21:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:42.689 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:42.689 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:28:42.689 00:28:42.689 --- 10.0.0.2 ping statistics --- 00:28:42.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:42.689 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:28:42.689 01:21:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:42.689 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:42.689 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:28:42.689 00:28:42.689 --- 10.0.0.1 ping statistics --- 00:28:42.689 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:42.689 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:28:42.689 01:21:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:42.689 01:21:33 -- nvmf/common.sh@410 -- # return 0 00:28:42.689 01:21:33 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:42.689 01:21:33 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:44.066 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:44.066 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:44.066 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:44.066 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:44.066 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:44.066 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:44.066 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:44.066 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:44.066 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:44.066 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:44.066 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:44.066 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:44.066 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:44.066 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:44.066 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:44.066 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:44.066 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:44.066 01:21:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:44.066 01:21:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:44.066 01:21:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:44.066 01:21:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:44.066 01:21:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:44.066 01:21:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:44.066 01:21:34 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:44.066 01:21:34 -- target/dif.sh@137 -- # nvmfappstart 00:28:44.066 01:21:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:44.066 01:21:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:44.066 01:21:34 -- common/autotest_common.sh@10 -- # set +x 00:28:44.066 01:21:34 -- nvmf/common.sh@469 -- # nvmfpid=1182817 00:28:44.066 01:21:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:44.066 01:21:34 -- nvmf/common.sh@470 -- # waitforlisten 1182817 00:28:44.066 01:21:34 -- common/autotest_common.sh@829 -- # '[' -z 1182817 ']' 00:28:44.066 01:21:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:44.066 01:21:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:44.066 01:21:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:44.066 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:44.066 01:21:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:44.066 01:21:34 -- common/autotest_common.sh@10 -- # set +x 00:28:44.066 [2024-11-26 01:21:34.526275] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:44.066 [2024-11-26 01:21:34.526349] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:44.066 EAL: No free 2048 kB hugepages reported on node 1 00:28:44.066 [2024-11-26 01:21:34.595663] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:44.325 [2024-11-26 01:21:34.707556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:44.326 [2024-11-26 01:21:34.707727] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:44.326 [2024-11-26 01:21:34.707752] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:44.326 [2024-11-26 01:21:34.707768] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:44.326 [2024-11-26 01:21:34.707798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:45.260 01:21:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:45.260 01:21:35 -- common/autotest_common.sh@862 -- # return 0 00:28:45.260 01:21:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:45.260 01:21:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 01:21:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:45.260 01:21:35 -- target/dif.sh@139 -- # create_transport 00:28:45.260 01:21:35 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:45.260 01:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 [2024-11-26 01:21:35.545973] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:45.260 01:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.260 01:21:35 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:45.260 01:21:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:45.260 01:21:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 ************************************ 00:28:45.260 START TEST fio_dif_1_default 00:28:45.260 ************************************ 00:28:45.260 01:21:35 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:45.260 01:21:35 -- target/dif.sh@86 -- # create_subsystems 0 00:28:45.260 01:21:35 -- target/dif.sh@28 -- # local sub 00:28:45.260 01:21:35 -- target/dif.sh@30 -- # for sub in "$@" 00:28:45.260 01:21:35 -- target/dif.sh@31 -- # create_subsystem 0 00:28:45.260 01:21:35 -- target/dif.sh@18 -- # local sub_id=0 00:28:45.260 01:21:35 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:45.260 01:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 bdev_null0 00:28:45.260 01:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.260 01:21:35 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:45.260 01:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 01:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.260 01:21:35 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:45.260 01:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 01:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.260 01:21:35 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:45.260 01:21:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.260 01:21:35 -- common/autotest_common.sh@10 -- # set +x 00:28:45.260 [2024-11-26 01:21:35.582280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:45.260 01:21:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.260 01:21:35 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:45.260 01:21:35 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:45.260 01:21:35 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:45.260 01:21:35 -- nvmf/common.sh@520 -- # config=() 00:28:45.260 01:21:35 -- nvmf/common.sh@520 -- # local subsystem config 00:28:45.260 01:21:35 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:45.260 01:21:35 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.260 01:21:35 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:45.260 { 00:28:45.260 "params": { 00:28:45.260 "name": "Nvme$subsystem", 00:28:45.260 "trtype": "$TEST_TRANSPORT", 00:28:45.260 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:45.260 "adrfam": "ipv4", 00:28:45.260 "trsvcid": "$NVMF_PORT", 00:28:45.260 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:45.260 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:45.260 "hdgst": ${hdgst:-false}, 00:28:45.260 "ddgst": ${ddgst:-false} 00:28:45.260 }, 00:28:45.260 "method": "bdev_nvme_attach_controller" 00:28:45.260 } 00:28:45.260 EOF 00:28:45.260 )") 00:28:45.260 01:21:35 -- target/dif.sh@82 -- # gen_fio_conf 00:28:45.260 01:21:35 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.260 01:21:35 -- target/dif.sh@54 -- # local file 00:28:45.260 01:21:35 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:45.260 01:21:35 -- target/dif.sh@56 -- # cat 00:28:45.260 01:21:35 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:45.260 01:21:35 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:45.260 01:21:35 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.260 01:21:35 -- common/autotest_common.sh@1330 -- # shift 00:28:45.260 01:21:35 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:45.260 01:21:35 -- nvmf/common.sh@542 -- # cat 00:28:45.261 01:21:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.261 01:21:35 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.261 01:21:35 -- target/dif.sh@72 -- # (( file <= files )) 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:45.261 01:21:35 -- nvmf/common.sh@544 -- # jq . 00:28:45.261 01:21:35 -- nvmf/common.sh@545 -- # IFS=, 00:28:45.261 01:21:35 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:45.261 "params": { 00:28:45.261 "name": "Nvme0", 00:28:45.261 "trtype": "tcp", 00:28:45.261 "traddr": "10.0.0.2", 00:28:45.261 "adrfam": "ipv4", 00:28:45.261 "trsvcid": "4420", 00:28:45.261 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:45.261 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:45.261 "hdgst": false, 00:28:45.261 "ddgst": false 00:28:45.261 }, 00:28:45.261 "method": "bdev_nvme_attach_controller" 00:28:45.261 }' 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:45.261 01:21:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:45.261 01:21:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:45.261 01:21:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:45.261 01:21:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:45.261 01:21:35 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:45.261 01:21:35 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:45.520 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:45.520 fio-3.35 00:28:45.520 Starting 1 thread 00:28:45.520 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.778 [2024-11-26 01:21:36.233064] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:45.778 [2024-11-26 01:21:36.233147] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:28:57.975 00:28:57.975 filename0: (groupid=0, jobs=1): err= 0: pid=1183061: Tue Nov 26 01:21:46 2024 00:28:57.975 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10012msec) 00:28:57.975 slat (nsec): min=6510, max=62880, avg=8485.93, stdev=3892.58 00:28:57.975 clat (usec): min=40845, max=47524, avg=41003.90, stdev=422.79 00:28:57.975 lat (usec): min=40851, max=47559, avg=41012.38, stdev=423.33 00:28:57.975 clat percentiles (usec): 00:28:57.975 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:28:57.975 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:28:57.975 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:28:57.975 | 99.00th=[41157], 99.50th=[41681], 99.90th=[47449], 99.95th=[47449], 00:28:57.975 | 99.99th=[47449] 00:28:57.975 bw ( KiB/s): min= 384, max= 416, per=99.50%, avg=388.80, stdev=11.72, samples=20 00:28:57.975 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:28:57.975 lat (msec) : 50=100.00% 00:28:57.975 cpu : usr=92.22%, sys=7.49%, ctx=19, majf=0, minf=280 00:28:57.975 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:28:57.975 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:57.975 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:57.975 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:57.975 latency : target=0, window=0, percentile=100.00%, depth=4 00:28:57.975 00:28:57.975 Run status group 0 (all jobs): 00:28:57.975 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10012-10012msec 00:28:57.975 01:21:46 -- target/dif.sh@88 -- # destroy_subsystems 0 00:28:57.975 01:21:46 -- target/dif.sh@43 -- # local sub 00:28:57.975 01:21:46 -- target/dif.sh@45 -- # for sub in "$@" 00:28:57.975 01:21:46 -- target/dif.sh@46 -- # destroy_subsystem 0 00:28:57.975 01:21:46 -- target/dif.sh@36 -- # local sub_id=0 00:28:57.975 01:21:46 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:28:57.975 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.975 01:21:46 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:28:57.975 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.975 00:28:57.975 real 0m11.103s 00:28:57.975 user 0m10.291s 00:28:57.975 sys 0m1.022s 00:28:57.975 01:21:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 ************************************ 00:28:57.975 END TEST fio_dif_1_default 00:28:57.975 ************************************ 00:28:57.975 01:21:46 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:28:57.975 01:21:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:57.975 01:21:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 ************************************ 00:28:57.975 START TEST fio_dif_1_multi_subsystems 00:28:57.975 ************************************ 00:28:57.975 01:21:46 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:28:57.975 01:21:46 -- target/dif.sh@92 -- # local files=1 00:28:57.975 01:21:46 -- target/dif.sh@94 -- # create_subsystems 0 1 00:28:57.975 01:21:46 -- target/dif.sh@28 -- # local sub 00:28:57.975 01:21:46 -- target/dif.sh@30 -- # for sub in "$@" 00:28:57.975 01:21:46 -- target/dif.sh@31 -- # create_subsystem 0 00:28:57.975 01:21:46 -- target/dif.sh@18 -- # local sub_id=0 00:28:57.975 01:21:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:57.975 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 bdev_null0 00:28:57.975 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.975 01:21:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:57.975 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.975 01:21:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:57.975 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.975 01:21:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:57.975 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.975 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.975 [2024-11-26 01:21:46.709159] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:57.975 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.976 01:21:46 -- target/dif.sh@30 -- # for sub in "$@" 00:28:57.976 01:21:46 -- target/dif.sh@31 -- # create_subsystem 1 00:28:57.976 01:21:46 -- target/dif.sh@18 -- # local sub_id=1 00:28:57.976 01:21:46 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:28:57.976 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.976 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.976 bdev_null1 00:28:57.976 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.976 01:21:46 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:28:57.976 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.976 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.976 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.976 01:21:46 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:28:57.976 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.976 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.976 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.976 01:21:46 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:57.976 01:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.976 01:21:46 -- common/autotest_common.sh@10 -- # set +x 00:28:57.976 01:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.976 01:21:46 -- target/dif.sh@95 -- # fio /dev/fd/62 00:28:57.976 01:21:46 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:28:57.976 01:21:46 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:28:57.976 01:21:46 -- nvmf/common.sh@520 -- # config=() 00:28:57.976 01:21:46 -- nvmf/common.sh@520 -- # local subsystem config 00:28:57.976 01:21:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:57.976 01:21:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:57.976 { 00:28:57.976 "params": { 00:28:57.976 "name": "Nvme$subsystem", 00:28:57.976 "trtype": "$TEST_TRANSPORT", 00:28:57.976 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:57.976 "adrfam": "ipv4", 00:28:57.976 "trsvcid": "$NVMF_PORT", 00:28:57.976 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:57.976 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:57.976 "hdgst": ${hdgst:-false}, 00:28:57.976 "ddgst": ${ddgst:-false} 00:28:57.976 }, 00:28:57.976 "method": "bdev_nvme_attach_controller" 00:28:57.976 } 00:28:57.976 EOF 00:28:57.976 )") 00:28:57.976 01:21:46 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.976 01:21:46 -- target/dif.sh@82 -- # gen_fio_conf 00:28:57.976 01:21:46 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.976 01:21:46 -- target/dif.sh@54 -- # local file 00:28:57.976 01:21:46 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:57.976 01:21:46 -- target/dif.sh@56 -- # cat 00:28:57.976 01:21:46 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:57.976 01:21:46 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:57.976 01:21:46 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.976 01:21:46 -- common/autotest_common.sh@1330 -- # shift 00:28:57.976 01:21:46 -- nvmf/common.sh@542 -- # cat 00:28:57.976 01:21:46 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:57.976 01:21:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:57.976 01:21:46 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.976 01:21:46 -- target/dif.sh@72 -- # (( file <= files )) 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:57.976 01:21:46 -- target/dif.sh@73 -- # cat 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:57.976 01:21:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:57.976 01:21:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:57.976 { 00:28:57.976 "params": { 00:28:57.976 "name": "Nvme$subsystem", 00:28:57.976 "trtype": "$TEST_TRANSPORT", 00:28:57.976 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:57.976 "adrfam": "ipv4", 00:28:57.976 "trsvcid": "$NVMF_PORT", 00:28:57.976 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:57.976 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:57.976 "hdgst": ${hdgst:-false}, 00:28:57.976 "ddgst": ${ddgst:-false} 00:28:57.976 }, 00:28:57.976 "method": "bdev_nvme_attach_controller" 00:28:57.976 } 00:28:57.976 EOF 00:28:57.976 )") 00:28:57.976 01:21:46 -- nvmf/common.sh@542 -- # cat 00:28:57.976 01:21:46 -- target/dif.sh@72 -- # (( file++ )) 00:28:57.976 01:21:46 -- target/dif.sh@72 -- # (( file <= files )) 00:28:57.976 01:21:46 -- nvmf/common.sh@544 -- # jq . 00:28:57.976 01:21:46 -- nvmf/common.sh@545 -- # IFS=, 00:28:57.976 01:21:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:57.976 "params": { 00:28:57.976 "name": "Nvme0", 00:28:57.976 "trtype": "tcp", 00:28:57.976 "traddr": "10.0.0.2", 00:28:57.976 "adrfam": "ipv4", 00:28:57.976 "trsvcid": "4420", 00:28:57.976 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:57.976 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:57.976 "hdgst": false, 00:28:57.976 "ddgst": false 00:28:57.976 }, 00:28:57.976 "method": "bdev_nvme_attach_controller" 00:28:57.976 },{ 00:28:57.976 "params": { 00:28:57.976 "name": "Nvme1", 00:28:57.976 "trtype": "tcp", 00:28:57.976 "traddr": "10.0.0.2", 00:28:57.976 "adrfam": "ipv4", 00:28:57.976 "trsvcid": "4420", 00:28:57.976 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:28:57.976 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:28:57.976 "hdgst": false, 00:28:57.976 "ddgst": false 00:28:57.976 }, 00:28:57.976 "method": "bdev_nvme_attach_controller" 00:28:57.976 }' 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:57.976 01:21:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:57.976 01:21:46 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:57.976 01:21:46 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:57.976 01:21:46 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:57.976 01:21:46 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:57.976 01:21:46 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:57.976 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:57.976 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:57.976 fio-3.35 00:28:57.976 Starting 2 threads 00:28:57.976 EAL: No free 2048 kB hugepages reported on node 1 00:28:57.976 [2024-11-26 01:21:47.733611] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:57.976 [2024-11-26 01:21:47.733669] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:07.947 00:29:07.947 filename0: (groupid=0, jobs=1): err= 0: pid=1184498: Tue Nov 26 01:21:57 2024 00:29:07.947 read: IOPS=95, BW=383KiB/s (392kB/s)(3840KiB/10039msec) 00:29:07.947 slat (nsec): min=7825, max=77843, avg=10981.73, stdev=3888.26 00:29:07.947 clat (usec): min=40714, max=46899, avg=41794.53, stdev=530.39 00:29:07.947 lat (usec): min=40723, max=46926, avg=41805.52, stdev=530.59 00:29:07.947 clat percentiles (usec): 00:29:07.947 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:07.947 | 30.00th=[42206], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:29:07.947 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:29:07.947 | 99.00th=[42730], 99.50th=[42730], 99.90th=[46924], 99.95th=[46924], 00:29:07.947 | 99.99th=[46924] 00:29:07.947 bw ( KiB/s): min= 351, max= 384, per=49.52%, avg=382.35, stdev= 7.38, samples=20 00:29:07.947 iops : min= 87, max= 96, avg=95.55, stdev= 2.01, samples=20 00:29:07.947 lat (msec) : 50=100.00% 00:29:07.947 cpu : usr=95.59%, sys=4.09%, ctx=13, majf=0, minf=238 00:29:07.947 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:07.947 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:07.947 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:07.947 issued rwts: total=960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:07.947 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:07.947 filename1: (groupid=0, jobs=1): err= 0: pid=1184499: Tue Nov 26 01:21:57 2024 00:29:07.947 read: IOPS=97, BW=389KiB/s (398kB/s)(3904KiB/10039msec) 00:29:07.947 slat (nsec): min=6711, max=28419, avg=10720.99, stdev=3021.43 00:29:07.947 clat (usec): min=40793, max=46900, avg=41110.13, stdev=490.14 00:29:07.947 lat (usec): min=40802, max=46918, avg=41120.85, stdev=491.06 00:29:07.947 clat percentiles (usec): 00:29:07.947 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:29:07.947 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:29:07.947 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:29:07.947 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:29:07.947 | 99.99th=[46924] 00:29:07.947 bw ( KiB/s): min= 384, max= 416, per=50.30%, avg=388.80, stdev=11.72, samples=20 00:29:07.947 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:29:07.947 lat (msec) : 50=100.00% 00:29:07.947 cpu : usr=95.65%, sys=4.04%, ctx=13, majf=0, minf=132 00:29:07.947 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:07.947 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:07.947 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:07.947 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:07.947 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:07.947 00:29:07.947 Run status group 0 (all jobs): 00:29:07.947 READ: bw=771KiB/s (790kB/s), 383KiB/s-389KiB/s (392kB/s-398kB/s), io=7744KiB (7930kB), run=10039-10039msec 00:29:07.947 01:21:58 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:07.947 01:21:58 -- target/dif.sh@43 -- # local sub 00:29:07.947 01:21:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:07.948 01:21:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:07.948 01:21:58 -- target/dif.sh@36 -- # local sub_id=0 00:29:07.948 01:21:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@45 -- # for sub in "$@" 00:29:07.948 01:21:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:07.948 01:21:58 -- target/dif.sh@36 -- # local sub_id=1 00:29:07.948 01:21:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 00:29:07.948 real 0m11.527s 00:29:07.948 user 0m20.696s 00:29:07.948 sys 0m1.142s 00:29:07.948 01:21:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 ************************************ 00:29:07.948 END TEST fio_dif_1_multi_subsystems 00:29:07.948 ************************************ 00:29:07.948 01:21:58 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:07.948 01:21:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:07.948 01:21:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 ************************************ 00:29:07.948 START TEST fio_dif_rand_params 00:29:07.948 ************************************ 00:29:07.948 01:21:58 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:07.948 01:21:58 -- target/dif.sh@100 -- # local NULL_DIF 00:29:07.948 01:21:58 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:07.948 01:21:58 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:07.948 01:21:58 -- target/dif.sh@103 -- # bs=128k 00:29:07.948 01:21:58 -- target/dif.sh@103 -- # numjobs=3 00:29:07.948 01:21:58 -- target/dif.sh@103 -- # iodepth=3 00:29:07.948 01:21:58 -- target/dif.sh@103 -- # runtime=5 00:29:07.948 01:21:58 -- target/dif.sh@105 -- # create_subsystems 0 00:29:07.948 01:21:58 -- target/dif.sh@28 -- # local sub 00:29:07.948 01:21:58 -- target/dif.sh@30 -- # for sub in "$@" 00:29:07.948 01:21:58 -- target/dif.sh@31 -- # create_subsystem 0 00:29:07.948 01:21:58 -- target/dif.sh@18 -- # local sub_id=0 00:29:07.948 01:21:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 bdev_null0 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:07.948 01:21:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.948 01:21:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.948 [2024-11-26 01:21:58.268988] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:07.948 01:21:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.948 01:21:58 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:07.948 01:21:58 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:07.948 01:21:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:07.948 01:21:58 -- nvmf/common.sh@520 -- # config=() 00:29:07.948 01:21:58 -- nvmf/common.sh@520 -- # local subsystem config 00:29:07.948 01:21:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:07.948 01:21:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:07.948 01:21:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:07.948 { 00:29:07.948 "params": { 00:29:07.948 "name": "Nvme$subsystem", 00:29:07.948 "trtype": "$TEST_TRANSPORT", 00:29:07.948 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:07.948 "adrfam": "ipv4", 00:29:07.948 "trsvcid": "$NVMF_PORT", 00:29:07.948 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:07.948 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:07.948 "hdgst": ${hdgst:-false}, 00:29:07.948 "ddgst": ${ddgst:-false} 00:29:07.948 }, 00:29:07.948 "method": "bdev_nvme_attach_controller" 00:29:07.948 } 00:29:07.948 EOF 00:29:07.948 )") 00:29:07.948 01:21:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:07.948 01:21:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:07.948 01:21:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:07.948 01:21:58 -- target/dif.sh@82 -- # gen_fio_conf 00:29:07.948 01:21:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:07.948 01:21:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:07.948 01:21:58 -- common/autotest_common.sh@1330 -- # shift 00:29:07.948 01:21:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:07.948 01:21:58 -- target/dif.sh@54 -- # local file 00:29:07.948 01:21:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:07.948 01:21:58 -- target/dif.sh@56 -- # cat 00:29:07.948 01:21:58 -- nvmf/common.sh@542 -- # cat 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:07.948 01:21:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:07.948 01:21:58 -- target/dif.sh@72 -- # (( file <= files )) 00:29:07.948 01:21:58 -- nvmf/common.sh@544 -- # jq . 00:29:07.948 01:21:58 -- nvmf/common.sh@545 -- # IFS=, 00:29:07.948 01:21:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:07.948 "params": { 00:29:07.948 "name": "Nvme0", 00:29:07.948 "trtype": "tcp", 00:29:07.948 "traddr": "10.0.0.2", 00:29:07.948 "adrfam": "ipv4", 00:29:07.948 "trsvcid": "4420", 00:29:07.948 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:07.948 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:07.948 "hdgst": false, 00:29:07.948 "ddgst": false 00:29:07.948 }, 00:29:07.948 "method": "bdev_nvme_attach_controller" 00:29:07.948 }' 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:07.948 01:21:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:07.948 01:21:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:07.948 01:21:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:07.948 01:21:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:07.948 01:21:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:07.948 01:21:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:08.206 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:08.207 ... 00:29:08.207 fio-3.35 00:29:08.207 Starting 3 threads 00:29:08.207 EAL: No free 2048 kB hugepages reported on node 1 00:29:08.806 [2024-11-26 01:21:59.034952] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:08.806 [2024-11-26 01:21:59.035041] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:14.108 00:29:14.108 filename0: (groupid=0, jobs=1): err= 0: pid=1185941: Tue Nov 26 01:22:04 2024 00:29:14.108 read: IOPS=220, BW=27.6MiB/s (28.9MB/s)(139MiB/5045msec) 00:29:14.108 slat (nsec): min=3671, max=48590, avg=17035.34, stdev=5088.89 00:29:14.108 clat (usec): min=4508, max=92337, avg=13524.44, stdev=8213.46 00:29:14.108 lat (usec): min=4521, max=92355, avg=13541.47, stdev=8213.52 00:29:14.108 clat percentiles (usec): 00:29:14.108 | 1.00th=[ 5407], 5.00th=[ 7504], 10.00th=[ 8356], 20.00th=[ 9241], 00:29:14.108 | 30.00th=[11076], 40.00th=[11994], 50.00th=[12518], 60.00th=[12911], 00:29:14.108 | 70.00th=[13698], 80.00th=[14484], 90.00th=[15533], 95.00th=[16909], 00:29:14.108 | 99.00th=[51643], 99.50th=[53216], 99.90th=[54789], 99.95th=[92799], 00:29:14.108 | 99.99th=[92799] 00:29:14.108 bw ( KiB/s): min=24576, max=33536, per=33.35%, avg=28446.80, stdev=2756.20, samples=10 00:29:14.108 iops : min= 192, max= 262, avg=222.20, stdev=21.57, samples=10 00:29:14.108 lat (msec) : 10=23.34%, 20=72.26%, 50=2.24%, 100=2.15% 00:29:14.108 cpu : usr=95.12%, sys=4.32%, ctx=8, majf=0, minf=82 00:29:14.108 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.108 issued rwts: total=1114,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.108 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.108 filename0: (groupid=0, jobs=1): err= 0: pid=1185942: Tue Nov 26 01:22:04 2024 00:29:14.108 read: IOPS=217, BW=27.2MiB/s (28.5MB/s)(136MiB/5005msec) 00:29:14.108 slat (nsec): min=5227, max=53005, avg=17879.31, stdev=5250.86 00:29:14.108 clat (usec): min=4556, max=88044, avg=13763.38, stdev=10234.21 00:29:14.108 lat (usec): min=4568, max=88074, avg=13781.26, stdev=10234.28 00:29:14.108 clat percentiles (usec): 00:29:14.108 | 1.00th=[ 5342], 5.00th=[ 7701], 10.00th=[ 8455], 20.00th=[10159], 00:29:14.108 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11600], 60.00th=[12125], 00:29:14.108 | 70.00th=[12518], 80.00th=[13173], 90.00th=[14222], 95.00th=[46924], 00:29:14.108 | 99.00th=[54264], 99.50th=[56886], 99.90th=[86508], 99.95th=[87557], 00:29:14.108 | 99.99th=[87557] 00:29:14.108 bw ( KiB/s): min=18432, max=35072, per=32.59%, avg=27801.60, stdev=5074.57, samples=10 00:29:14.108 iops : min= 144, max= 274, avg=217.20, stdev=39.65, samples=10 00:29:14.108 lat (msec) : 10=18.64%, 20=75.30%, 50=1.93%, 100=4.13% 00:29:14.108 cpu : usr=93.75%, sys=5.76%, ctx=14, majf=0, minf=79 00:29:14.108 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.108 issued rwts: total=1089,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.108 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.108 filename0: (groupid=0, jobs=1): err= 0: pid=1185943: Tue Nov 26 01:22:04 2024 00:29:14.108 read: IOPS=229, BW=28.7MiB/s (30.1MB/s)(145MiB/5045msec) 00:29:14.108 slat (nsec): min=4795, max=52671, avg=17710.41, stdev=5786.75 00:29:14.108 clat (usec): min=4794, max=88052, avg=12997.85, stdev=8488.76 00:29:14.108 lat (usec): min=4808, max=88080, avg=13015.56, stdev=8488.71 00:29:14.108 clat percentiles (usec): 00:29:14.108 | 1.00th=[ 5538], 5.00th=[ 7570], 10.00th=[ 8356], 20.00th=[ 9241], 00:29:14.108 | 30.00th=[10552], 40.00th=[11338], 50.00th=[11731], 60.00th=[12256], 00:29:14.108 | 70.00th=[12911], 80.00th=[13698], 90.00th=[14746], 95.00th=[15926], 00:29:14.108 | 99.00th=[52691], 99.50th=[53740], 99.90th=[86508], 99.95th=[87557], 00:29:14.108 | 99.99th=[87557] 00:29:14.108 bw ( KiB/s): min=16929, max=34816, per=34.73%, avg=29622.50, stdev=5072.35, samples=10 00:29:14.108 iops : min= 132, max= 272, avg=231.40, stdev=39.70, samples=10 00:29:14.108 lat (msec) : 10=24.85%, 20=71.44%, 50=2.07%, 100=1.64% 00:29:14.108 cpu : usr=90.44%, sys=6.62%, ctx=411, majf=0, minf=160 00:29:14.108 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:14.108 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.108 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:14.108 issued rwts: total=1159,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:14.108 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:14.108 00:29:14.108 Run status group 0 (all jobs): 00:29:14.109 READ: bw=83.3MiB/s (87.3MB/s), 27.2MiB/s-28.7MiB/s (28.5MB/s-30.1MB/s), io=420MiB (441MB), run=5005-5045msec 00:29:14.109 01:22:04 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:14.109 01:22:04 -- target/dif.sh@43 -- # local sub 00:29:14.109 01:22:04 -- target/dif.sh@45 -- # for sub in "$@" 00:29:14.109 01:22:04 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:14.109 01:22:04 -- target/dif.sh@36 -- # local sub_id=0 00:29:14.109 01:22:04 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:14.109 01:22:04 -- target/dif.sh@109 -- # bs=4k 00:29:14.109 01:22:04 -- target/dif.sh@109 -- # numjobs=8 00:29:14.109 01:22:04 -- target/dif.sh@109 -- # iodepth=16 00:29:14.109 01:22:04 -- target/dif.sh@109 -- # runtime= 00:29:14.109 01:22:04 -- target/dif.sh@109 -- # files=2 00:29:14.109 01:22:04 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:14.109 01:22:04 -- target/dif.sh@28 -- # local sub 00:29:14.109 01:22:04 -- target/dif.sh@30 -- # for sub in "$@" 00:29:14.109 01:22:04 -- target/dif.sh@31 -- # create_subsystem 0 00:29:14.109 01:22:04 -- target/dif.sh@18 -- # local sub_id=0 00:29:14.109 01:22:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 bdev_null0 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 [2024-11-26 01:22:04.492667] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@30 -- # for sub in "$@" 00:29:14.109 01:22:04 -- target/dif.sh@31 -- # create_subsystem 1 00:29:14.109 01:22:04 -- target/dif.sh@18 -- # local sub_id=1 00:29:14.109 01:22:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 bdev_null1 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@30 -- # for sub in "$@" 00:29:14.109 01:22:04 -- target/dif.sh@31 -- # create_subsystem 2 00:29:14.109 01:22:04 -- target/dif.sh@18 -- # local sub_id=2 00:29:14.109 01:22:04 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 bdev_null2 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:14.109 01:22:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:14.109 01:22:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.109 01:22:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:14.109 01:22:04 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:14.109 01:22:04 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:14.109 01:22:04 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:14.109 01:22:04 -- nvmf/common.sh@520 -- # config=() 00:29:14.109 01:22:04 -- nvmf/common.sh@520 -- # local subsystem config 00:29:14.109 01:22:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:14.109 01:22:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:14.109 { 00:29:14.109 "params": { 00:29:14.109 "name": "Nvme$subsystem", 00:29:14.109 "trtype": "$TEST_TRANSPORT", 00:29:14.109 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:14.109 "adrfam": "ipv4", 00:29:14.109 "trsvcid": "$NVMF_PORT", 00:29:14.109 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:14.109 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:14.109 "hdgst": ${hdgst:-false}, 00:29:14.109 "ddgst": ${ddgst:-false} 00:29:14.109 }, 00:29:14.109 "method": "bdev_nvme_attach_controller" 00:29:14.109 } 00:29:14.109 EOF 00:29:14.109 )") 00:29:14.109 01:22:04 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:14.109 01:22:04 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:14.109 01:22:04 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:14.109 01:22:04 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:14.109 01:22:04 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:14.109 01:22:04 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:14.109 01:22:04 -- target/dif.sh@82 -- # gen_fio_conf 00:29:14.109 01:22:04 -- common/autotest_common.sh@1330 -- # shift 00:29:14.109 01:22:04 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:14.109 01:22:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:14.109 01:22:04 -- target/dif.sh@54 -- # local file 00:29:14.109 01:22:04 -- target/dif.sh@56 -- # cat 00:29:14.109 01:22:04 -- nvmf/common.sh@542 -- # cat 00:29:14.109 01:22:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:14.109 01:22:04 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:14.109 01:22:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:14.109 01:22:04 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:14.109 01:22:04 -- target/dif.sh@72 -- # (( file <= files )) 00:29:14.109 01:22:04 -- target/dif.sh@73 -- # cat 00:29:14.109 01:22:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:14.109 01:22:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:14.109 { 00:29:14.109 "params": { 00:29:14.109 "name": "Nvme$subsystem", 00:29:14.109 "trtype": "$TEST_TRANSPORT", 00:29:14.109 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:14.109 "adrfam": "ipv4", 00:29:14.109 "trsvcid": "$NVMF_PORT", 00:29:14.109 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:14.109 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:14.109 "hdgst": ${hdgst:-false}, 00:29:14.109 "ddgst": ${ddgst:-false} 00:29:14.109 }, 00:29:14.109 "method": "bdev_nvme_attach_controller" 00:29:14.109 } 00:29:14.109 EOF 00:29:14.109 )") 00:29:14.109 01:22:04 -- nvmf/common.sh@542 -- # cat 00:29:14.109 01:22:04 -- target/dif.sh@72 -- # (( file++ )) 00:29:14.109 01:22:04 -- target/dif.sh@72 -- # (( file <= files )) 00:29:14.109 01:22:04 -- target/dif.sh@73 -- # cat 00:29:14.109 01:22:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:14.109 01:22:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:14.109 { 00:29:14.109 "params": { 00:29:14.109 "name": "Nvme$subsystem", 00:29:14.109 "trtype": "$TEST_TRANSPORT", 00:29:14.109 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:14.109 "adrfam": "ipv4", 00:29:14.109 "trsvcid": "$NVMF_PORT", 00:29:14.109 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:14.109 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:14.109 "hdgst": ${hdgst:-false}, 00:29:14.109 "ddgst": ${ddgst:-false} 00:29:14.109 }, 00:29:14.109 "method": "bdev_nvme_attach_controller" 00:29:14.109 } 00:29:14.109 EOF 00:29:14.109 )") 00:29:14.109 01:22:04 -- target/dif.sh@72 -- # (( file++ )) 00:29:14.109 01:22:04 -- target/dif.sh@72 -- # (( file <= files )) 00:29:14.109 01:22:04 -- nvmf/common.sh@542 -- # cat 00:29:14.109 01:22:04 -- nvmf/common.sh@544 -- # jq . 00:29:14.109 01:22:04 -- nvmf/common.sh@545 -- # IFS=, 00:29:14.109 01:22:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:14.109 "params": { 00:29:14.110 "name": "Nvme0", 00:29:14.110 "trtype": "tcp", 00:29:14.110 "traddr": "10.0.0.2", 00:29:14.110 "adrfam": "ipv4", 00:29:14.110 "trsvcid": "4420", 00:29:14.110 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:14.110 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:14.110 "hdgst": false, 00:29:14.110 "ddgst": false 00:29:14.110 }, 00:29:14.110 "method": "bdev_nvme_attach_controller" 00:29:14.110 },{ 00:29:14.110 "params": { 00:29:14.110 "name": "Nvme1", 00:29:14.110 "trtype": "tcp", 00:29:14.110 "traddr": "10.0.0.2", 00:29:14.110 "adrfam": "ipv4", 00:29:14.110 "trsvcid": "4420", 00:29:14.110 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:14.110 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:14.110 "hdgst": false, 00:29:14.110 "ddgst": false 00:29:14.110 }, 00:29:14.110 "method": "bdev_nvme_attach_controller" 00:29:14.110 },{ 00:29:14.110 "params": { 00:29:14.110 "name": "Nvme2", 00:29:14.110 "trtype": "tcp", 00:29:14.110 "traddr": "10.0.0.2", 00:29:14.110 "adrfam": "ipv4", 00:29:14.110 "trsvcid": "4420", 00:29:14.110 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:14.110 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:14.110 "hdgst": false, 00:29:14.110 "ddgst": false 00:29:14.110 }, 00:29:14.110 "method": "bdev_nvme_attach_controller" 00:29:14.110 }' 00:29:14.110 01:22:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:14.110 01:22:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:14.110 01:22:04 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:14.110 01:22:04 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:14.110 01:22:04 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:14.110 01:22:04 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:14.110 01:22:04 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:14.110 01:22:04 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:14.110 01:22:04 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:14.110 01:22:04 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:14.369 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:14.369 ... 00:29:14.369 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:14.369 ... 00:29:14.369 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:14.369 ... 00:29:14.369 fio-3.35 00:29:14.369 Starting 24 threads 00:29:14.369 EAL: No free 2048 kB hugepages reported on node 1 00:29:15.305 [2024-11-26 01:22:05.561386] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:15.305 [2024-11-26 01:22:05.561469] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:25.283 00:29:25.283 filename0: (groupid=0, jobs=1): err= 0: pid=1186835: Tue Nov 26 01:22:15 2024 00:29:25.283 read: IOPS=499, BW=1998KiB/s (2046kB/s)(19.6MiB/10025msec) 00:29:25.283 slat (usec): min=5, max=165, avg=50.71, stdev=24.85 00:29:25.283 clat (usec): min=13444, max=37494, avg=31589.20, stdev=1357.87 00:29:25.283 lat (usec): min=13450, max=37521, avg=31639.92, stdev=1356.11 00:29:25.283 clat percentiles (usec): 00:29:25.283 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:25.283 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:25.283 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.283 | 99.00th=[34866], 99.50th=[35390], 99.90th=[37487], 99.95th=[37487], 00:29:25.283 | 99.99th=[37487] 00:29:25.283 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=1996.80, stdev=64.34, samples=20 00:29:25.283 iops : min= 480, max= 512, avg=499.20, stdev=16.08, samples=20 00:29:25.283 lat (msec) : 20=0.32%, 50=99.68% 00:29:25.283 cpu : usr=95.54%, sys=2.68%, ctx=516, majf=0, minf=47 00:29:25.283 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:25.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.283 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.283 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.283 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.283 filename0: (groupid=0, jobs=1): err= 0: pid=1186836: Tue Nov 26 01:22:15 2024 00:29:25.283 read: IOPS=497, BW=1990KiB/s (2037kB/s)(19.4MiB/10004msec) 00:29:25.283 slat (usec): min=12, max=165, avg=50.35, stdev=18.69 00:29:25.283 clat (usec): min=12558, max=69150, avg=31695.62, stdev=2334.35 00:29:25.283 lat (usec): min=12572, max=69169, avg=31745.96, stdev=2334.19 00:29:25.283 clat percentiles (usec): 00:29:25.283 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:25.283 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.283 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32375], 95.00th=[32637], 00:29:25.283 | 99.00th=[35914], 99.50th=[36963], 99.90th=[65799], 99.95th=[65799], 00:29:25.283 | 99.99th=[68682] 00:29:25.283 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=1980.63, stdev=78.31, samples=19 00:29:25.283 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:29:25.283 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:25.283 cpu : usr=98.65%, sys=0.94%, ctx=14, majf=0, minf=29 00:29:25.283 IO depths : 1=6.1%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:25.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.283 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.283 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.283 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.283 filename0: (groupid=0, jobs=1): err= 0: pid=1186837: Tue Nov 26 01:22:15 2024 00:29:25.283 read: IOPS=500, BW=2004KiB/s (2052kB/s)(19.6MiB/10030msec) 00:29:25.283 slat (usec): min=4, max=170, avg=26.37, stdev=19.05 00:29:25.283 clat (usec): min=6901, max=55325, avg=31721.67, stdev=1757.76 00:29:25.283 lat (usec): min=6915, max=55333, avg=31748.05, stdev=1758.10 00:29:25.283 clat percentiles (usec): 00:29:25.283 | 1.00th=[26084], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:25.283 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:29:25.283 | 70.00th=[32113], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.283 | 99.00th=[34866], 99.50th=[35390], 99.90th=[36439], 99.95th=[42206], 00:29:25.283 | 99.99th=[55313] 00:29:25.283 bw ( KiB/s): min= 1920, max= 2048, per=4.19%, avg=2003.20, stdev=62.64, samples=20 00:29:25.283 iops : min= 480, max= 512, avg=500.80, stdev=15.66, samples=20 00:29:25.283 lat (msec) : 10=0.04%, 20=0.64%, 50=99.28%, 100=0.04% 00:29:25.283 cpu : usr=96.97%, sys=1.98%, ctx=103, majf=0, minf=61 00:29:25.283 IO depths : 1=6.1%, 2=12.2%, 4=24.6%, 8=50.7%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:25.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.283 complete : 0=0.0%, 4=94.0%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.283 issued rwts: total=5024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.283 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.283 filename0: (groupid=0, jobs=1): err= 0: pid=1186838: Tue Nov 26 01:22:15 2024 00:29:25.283 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10008msec) 00:29:25.283 slat (usec): min=11, max=255, avg=48.38, stdev=34.76 00:29:25.283 clat (usec): min=27963, max=58072, avg=31661.61, stdev=1436.59 00:29:25.283 lat (usec): min=27982, max=58092, avg=31709.99, stdev=1437.98 00:29:25.283 clat percentiles (usec): 00:29:25.283 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:25.283 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.283 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:29:25.283 | 99.00th=[35390], 99.50th=[36963], 99.90th=[53216], 99.95th=[53216], 00:29:25.283 | 99.99th=[57934] 00:29:25.283 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1987.37, stdev=78.31, samples=19 00:29:25.283 iops : min= 448, max= 512, avg=496.84, stdev=19.58, samples=19 00:29:25.283 lat (msec) : 50=99.68%, 100=0.32% 00:29:25.283 cpu : usr=98.40%, sys=0.99%, ctx=73, majf=0, minf=36 00:29:25.283 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:25.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename0: (groupid=0, jobs=1): err= 0: pid=1186839: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=498, BW=1993KiB/s (2041kB/s)(19.5MiB/10013msec) 00:29:25.284 slat (usec): min=9, max=157, avg=52.34, stdev=19.22 00:29:25.284 clat (usec): min=7624, max=74664, avg=31622.85, stdev=2947.10 00:29:25.284 lat (usec): min=7686, max=74710, avg=31675.19, stdev=2947.02 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:25.284 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.284 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32375], 95.00th=[32637], 00:29:25.284 | 99.00th=[34866], 99.50th=[36439], 99.90th=[74974], 99.95th=[74974], 00:29:25.284 | 99.99th=[74974] 00:29:25.284 bw ( KiB/s): min= 1768, max= 2048, per=4.16%, avg=1986.11, stdev=81.75, samples=19 00:29:25.284 iops : min= 442, max= 512, avg=496.53, stdev=20.44, samples=19 00:29:25.284 lat (msec) : 10=0.14%, 20=0.56%, 50=98.98%, 100=0.32% 00:29:25.284 cpu : usr=98.84%, sys=0.74%, ctx=14, majf=0, minf=44 00:29:25.284 IO depths : 1=6.2%, 2=12.4%, 4=24.8%, 8=50.3%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4989,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename0: (groupid=0, jobs=1): err= 0: pid=1186840: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=498, BW=1996KiB/s (2044kB/s)(19.5MiB/10018msec) 00:29:25.284 slat (usec): min=7, max=128, avg=27.19, stdev=24.49 00:29:25.284 clat (usec): min=10992, max=55377, avg=31834.32, stdev=1904.64 00:29:25.284 lat (usec): min=11029, max=55386, avg=31861.51, stdev=1900.93 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[28967], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:25.284 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:29:25.284 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[32900], 00:29:25.284 | 99.00th=[35914], 99.50th=[40109], 99.90th=[54264], 99.95th=[54789], 00:29:25.284 | 99.99th=[55313] 00:29:25.284 bw ( KiB/s): min= 1888, max= 2048, per=4.17%, avg=1992.80, stdev=65.55, samples=20 00:29:25.284 iops : min= 472, max= 512, avg=498.20, stdev=16.39, samples=20 00:29:25.284 lat (msec) : 20=0.36%, 50=99.40%, 100=0.24% 00:29:25.284 cpu : usr=96.98%, sys=1.72%, ctx=195, majf=0, minf=58 00:29:25.284 IO depths : 1=5.8%, 2=12.0%, 4=24.7%, 8=50.8%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4998,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename0: (groupid=0, jobs=1): err= 0: pid=1186841: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=498, BW=1994KiB/s (2042kB/s)(19.5MiB/10015msec) 00:29:25.284 slat (usec): min=8, max=169, avg=51.06, stdev=34.47 00:29:25.284 clat (usec): min=23100, max=40263, avg=31637.67, stdev=1013.15 00:29:25.284 lat (usec): min=23134, max=40286, avg=31688.72, stdev=1007.98 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30802], 20.00th=[31065], 00:29:25.284 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.284 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:29:25.284 | 99.00th=[35914], 99.50th=[36439], 99.90th=[40109], 99.95th=[40109], 00:29:25.284 | 99.99th=[40109] 00:29:25.284 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1990.40, stdev=65.33, samples=20 00:29:25.284 iops : min= 480, max= 512, avg=497.60, stdev=16.33, samples=20 00:29:25.284 lat (msec) : 50=100.00% 00:29:25.284 cpu : usr=98.54%, sys=1.03%, ctx=15, majf=0, minf=33 00:29:25.284 IO depths : 1=6.0%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename0: (groupid=0, jobs=1): err= 0: pid=1186842: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:29:25.284 slat (usec): min=10, max=147, avg=48.08, stdev=22.42 00:29:25.284 clat (usec): min=29751, max=53171, avg=31736.70, stdev=1408.28 00:29:25.284 lat (usec): min=29842, max=53193, avg=31784.79, stdev=1405.78 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[30278], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:25.284 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:25.284 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.284 | 99.00th=[35390], 99.50th=[36439], 99.90th=[53216], 99.95th=[53216], 00:29:25.284 | 99.99th=[53216] 00:29:25.284 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1987.37, stdev=78.31, samples=19 00:29:25.284 iops : min= 448, max= 512, avg=496.84, stdev=19.58, samples=19 00:29:25.284 lat (msec) : 50=99.68%, 100=0.32% 00:29:25.284 cpu : usr=98.19%, sys=1.10%, ctx=96, majf=0, minf=43 00:29:25.284 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename1: (groupid=0, jobs=1): err= 0: pid=1186843: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=508, BW=2034KiB/s (2082kB/s)(19.9MiB/10004msec) 00:29:25.284 slat (usec): min=7, max=159, avg=40.29, stdev=22.54 00:29:25.284 clat (usec): min=4381, max=78937, avg=31108.97, stdev=4486.99 00:29:25.284 lat (usec): min=4389, max=78979, avg=31149.26, stdev=4492.09 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[17957], 5.00th=[21103], 10.00th=[29754], 20.00th=[31065], 00:29:25.284 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.284 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32375], 95.00th=[34341], 00:29:25.284 | 99.00th=[43779], 99.50th=[47973], 99.90th=[62653], 99.95th=[62653], 00:29:25.284 | 99.99th=[79168] 00:29:25.284 bw ( KiB/s): min= 1792, max= 2256, per=4.24%, avg=2026.95, stdev=119.38, samples=19 00:29:25.284 iops : min= 448, max= 564, avg=506.74, stdev=29.85, samples=19 00:29:25.284 lat (msec) : 10=0.63%, 20=4.09%, 50=94.97%, 100=0.31% 00:29:25.284 cpu : usr=98.73%, sys=0.86%, ctx=14, majf=0, minf=38 00:29:25.284 IO depths : 1=4.3%, 2=9.2%, 4=20.2%, 8=57.6%, 16=8.8%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=92.9%, 8=2.0%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=5086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename1: (groupid=0, jobs=1): err= 0: pid=1186844: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=497, BW=1990KiB/s (2038kB/s)(19.4MiB/10003msec) 00:29:25.284 slat (usec): min=8, max=115, avg=42.87, stdev=12.86 00:29:25.284 clat (usec): min=12697, max=72673, avg=31766.94, stdev=2430.63 00:29:25.284 lat (usec): min=12723, max=72723, avg=31809.80, stdev=2431.01 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:25.284 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:25.284 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.284 | 99.00th=[35390], 99.50th=[36963], 99.90th=[67634], 99.95th=[67634], 00:29:25.284 | 99.99th=[72877] 00:29:25.284 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=1980.63, stdev=78.31, samples=19 00:29:25.284 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:29:25.284 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:25.284 cpu : usr=97.64%, sys=1.50%, ctx=94, majf=0, minf=40 00:29:25.284 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename1: (groupid=0, jobs=1): err= 0: pid=1186845: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=498, BW=1992KiB/s (2040kB/s)(19.5MiB/10004msec) 00:29:25.284 slat (usec): min=7, max=192, avg=46.54, stdev=41.44 00:29:25.284 clat (usec): min=4134, max=62494, avg=31775.98, stdev=3979.93 00:29:25.284 lat (usec): min=4145, max=62545, avg=31822.51, stdev=3979.74 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[17957], 5.00th=[30016], 10.00th=[30540], 20.00th=[31065], 00:29:25.284 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:29:25.284 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32637], 95.00th=[34341], 00:29:25.284 | 99.00th=[48497], 99.50th=[55313], 99.90th=[62129], 99.95th=[62653], 00:29:25.284 | 99.99th=[62653] 00:29:25.284 bw ( KiB/s): min= 1792, max= 2104, per=4.14%, avg=1976.42, stdev=84.81, samples=19 00:29:25.284 iops : min= 448, max= 526, avg=494.11, stdev=21.20, samples=19 00:29:25.284 lat (msec) : 10=0.44%, 20=1.12%, 50=97.71%, 100=0.72% 00:29:25.284 cpu : usr=98.02%, sys=1.31%, ctx=29, majf=0, minf=49 00:29:25.284 IO depths : 1=1.2%, 2=6.1%, 4=19.9%, 8=60.6%, 16=12.3%, 32=0.0%, >=64=0.0% 00:29:25.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 complete : 0=0.0%, 4=93.2%, 8=2.2%, 16=4.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.284 issued rwts: total=4982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.284 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.284 filename1: (groupid=0, jobs=1): err= 0: pid=1186846: Tue Nov 26 01:22:15 2024 00:29:25.284 read: IOPS=499, BW=1999KiB/s (2047kB/s)(19.6MiB/10021msec) 00:29:25.284 slat (usec): min=4, max=187, avg=47.95, stdev=22.68 00:29:25.284 clat (usec): min=9808, max=36947, avg=31619.44, stdev=1440.90 00:29:25.284 lat (usec): min=9813, max=36971, avg=31667.39, stdev=1441.59 00:29:25.284 clat percentiles (usec): 00:29:25.284 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:25.284 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.284 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32637], 00:29:25.284 | 99.00th=[34866], 99.50th=[35390], 99.90th=[36963], 99.95th=[36963], 00:29:25.284 | 99.99th=[36963] 00:29:25.285 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=1996.80, stdev=64.34, samples=20 00:29:25.285 iops : min= 480, max= 512, avg=499.20, stdev=16.08, samples=20 00:29:25.285 lat (msec) : 10=0.28%, 20=0.04%, 50=99.68% 00:29:25.285 cpu : usr=97.26%, sys=1.84%, ctx=60, majf=0, minf=45 00:29:25.285 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename1: (groupid=0, jobs=1): err= 0: pid=1186847: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=497, BW=1990KiB/s (2037kB/s)(19.4MiB/10004msec) 00:29:25.285 slat (usec): min=7, max=115, avg=45.45, stdev=16.98 00:29:25.285 clat (usec): min=12573, max=65339, avg=31758.71, stdev=2300.69 00:29:25.285 lat (usec): min=12597, max=65365, avg=31804.16, stdev=2299.66 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[30802], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:25.285 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.285 | 99.00th=[35390], 99.50th=[36439], 99.90th=[65274], 99.95th=[65274], 00:29:25.285 | 99.99th=[65274] 00:29:25.285 bw ( KiB/s): min= 1795, max= 2048, per=4.14%, avg=1980.79, stdev=77.91, samples=19 00:29:25.285 iops : min= 448, max= 512, avg=495.16, stdev=19.58, samples=19 00:29:25.285 lat (msec) : 20=0.32%, 50=99.36%, 100=0.32% 00:29:25.285 cpu : usr=98.78%, sys=0.82%, ctx=16, majf=0, minf=34 00:29:25.285 IO depths : 1=6.0%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename1: (groupid=0, jobs=1): err= 0: pid=1186848: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:29:25.285 slat (usec): min=7, max=272, avg=46.31, stdev=28.74 00:29:25.285 clat (usec): min=27373, max=58066, avg=31769.22, stdev=1477.60 00:29:25.285 lat (usec): min=27383, max=58086, avg=31815.53, stdev=1472.38 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[30016], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:25.285 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.285 | 99.00th=[35914], 99.50th=[36963], 99.90th=[53216], 99.95th=[53216], 00:29:25.285 | 99.99th=[57934] 00:29:25.285 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1987.37, stdev=77.03, samples=19 00:29:25.285 iops : min= 448, max= 512, avg=496.84, stdev=19.26, samples=19 00:29:25.285 lat (msec) : 50=99.68%, 100=0.32% 00:29:25.285 cpu : usr=98.65%, sys=0.93%, ctx=15, majf=0, minf=37 00:29:25.285 IO depths : 1=5.7%, 2=11.9%, 4=24.9%, 8=50.7%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename1: (groupid=0, jobs=1): err= 0: pid=1186849: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=498, BW=1994KiB/s (2042kB/s)(19.5MiB/10012msec) 00:29:25.285 slat (usec): min=7, max=182, avg=33.41, stdev=18.05 00:29:25.285 clat (usec): min=3614, max=52982, avg=31766.20, stdev=1912.73 00:29:25.285 lat (usec): min=3624, max=53004, avg=31799.62, stdev=1912.40 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:25.285 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.285 | 99.00th=[35390], 99.50th=[36439], 99.90th=[52691], 99.95th=[53216], 00:29:25.285 | 99.99th=[53216] 00:29:25.285 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1987.37, stdev=78.31, samples=19 00:29:25.285 iops : min= 448, max= 512, avg=496.84, stdev=19.58, samples=19 00:29:25.285 lat (msec) : 4=0.14%, 20=0.18%, 50=99.36%, 100=0.32% 00:29:25.285 cpu : usr=92.62%, sys=3.83%, ctx=329, majf=0, minf=36 00:29:25.285 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename1: (groupid=0, jobs=1): err= 0: pid=1186850: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=507, BW=2032KiB/s (2081kB/s)(19.9MiB/10004msec) 00:29:25.285 slat (usec): min=7, max=136, avg=45.07, stdev=26.54 00:29:25.285 clat (usec): min=6086, max=79493, avg=31127.23, stdev=4401.08 00:29:25.285 lat (usec): min=6096, max=79543, avg=31172.30, stdev=4406.18 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[17171], 5.00th=[21365], 10.00th=[30016], 20.00th=[31065], 00:29:25.285 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[33817], 00:29:25.285 | 99.00th=[45351], 99.50th=[48497], 99.90th=[62129], 99.95th=[62653], 00:29:25.285 | 99.99th=[79168] 00:29:25.285 bw ( KiB/s): min= 1792, max= 2320, per=4.24%, avg=2024.42, stdev=114.93, samples=19 00:29:25.285 iops : min= 448, max= 580, avg=506.11, stdev=28.73, samples=19 00:29:25.285 lat (msec) : 10=0.55%, 20=3.40%, 50=95.69%, 100=0.35% 00:29:25.285 cpu : usr=98.66%, sys=0.93%, ctx=12, majf=0, minf=26 00:29:25.285 IO depths : 1=0.8%, 2=6.0%, 4=21.2%, 8=60.0%, 16=12.1%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=93.3%, 8=1.5%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=5082,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename2: (groupid=0, jobs=1): err= 0: pid=1186851: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10007msec) 00:29:25.285 slat (usec): min=10, max=147, avg=44.82, stdev=18.63 00:29:25.285 clat (usec): min=27830, max=53212, avg=31776.18, stdev=1405.78 00:29:25.285 lat (usec): min=27873, max=53234, avg=31821.00, stdev=1403.97 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[30540], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:25.285 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.285 | 99.00th=[35390], 99.50th=[36439], 99.90th=[53216], 99.95th=[53216], 00:29:25.285 | 99.99th=[53216] 00:29:25.285 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1987.37, stdev=78.31, samples=19 00:29:25.285 iops : min= 448, max= 512, avg=496.84, stdev=19.58, samples=19 00:29:25.285 lat (msec) : 50=99.68%, 100=0.32% 00:29:25.285 cpu : usr=98.69%, sys=0.90%, ctx=12, majf=0, minf=26 00:29:25.285 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename2: (groupid=0, jobs=1): err= 0: pid=1186852: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=497, BW=1989KiB/s (2037kB/s)(19.4MiB/10005msec) 00:29:25.285 slat (usec): min=8, max=190, avg=48.83, stdev=19.60 00:29:25.285 clat (usec): min=12626, max=69330, avg=31734.43, stdev=2481.86 00:29:25.285 lat (usec): min=12650, max=69351, avg=31783.26, stdev=2480.68 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[27132], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:25.285 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.285 | 99.00th=[36963], 99.50th=[38011], 99.90th=[65799], 99.95th=[65799], 00:29:25.285 | 99.99th=[69731] 00:29:25.285 bw ( KiB/s): min= 1792, max= 2048, per=4.14%, avg=1980.63, stdev=77.03, samples=19 00:29:25.285 iops : min= 448, max= 512, avg=495.16, stdev=19.26, samples=19 00:29:25.285 lat (msec) : 20=0.32%, 50=99.32%, 100=0.36% 00:29:25.285 cpu : usr=95.75%, sys=2.37%, ctx=205, majf=0, minf=42 00:29:25.285 IO depths : 1=4.5%, 2=10.7%, 4=24.9%, 8=51.9%, 16=8.0%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.2%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename2: (groupid=0, jobs=1): err= 0: pid=1186853: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=497, BW=1990KiB/s (2037kB/s)(19.4MiB/10004msec) 00:29:25.285 slat (usec): min=7, max=128, avg=44.29, stdev=12.89 00:29:25.285 clat (usec): min=26009, max=55407, avg=31771.26, stdev=1565.15 00:29:25.285 lat (usec): min=26018, max=55426, avg=31815.55, stdev=1563.89 00:29:25.285 clat percentiles (usec): 00:29:25.285 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:25.285 | 30.00th=[31327], 40.00th=[31589], 50.00th=[31589], 60.00th=[31589], 00:29:25.285 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.285 | 99.00th=[35390], 99.50th=[36963], 99.90th=[55313], 99.95th=[55313], 00:29:25.285 | 99.99th=[55313] 00:29:25.285 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=1987.37, stdev=77.03, samples=19 00:29:25.285 iops : min= 448, max= 512, avg=496.84, stdev=19.26, samples=19 00:29:25.285 lat (msec) : 50=99.68%, 100=0.32% 00:29:25.285 cpu : usr=98.21%, sys=1.31%, ctx=83, majf=0, minf=38 00:29:25.285 IO depths : 1=6.0%, 2=12.2%, 4=24.9%, 8=50.3%, 16=6.5%, 32=0.0%, >=64=0.0% 00:29:25.285 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.285 issued rwts: total=4976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.285 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.285 filename2: (groupid=0, jobs=1): err= 0: pid=1186854: Tue Nov 26 01:22:15 2024 00:29:25.285 read: IOPS=498, BW=1993KiB/s (2041kB/s)(19.5MiB/10017msec) 00:29:25.285 slat (usec): min=14, max=228, avg=54.41, stdev=35.66 00:29:25.286 clat (usec): min=23239, max=39235, avg=31537.07, stdev=933.03 00:29:25.286 lat (usec): min=23270, max=39267, avg=31591.48, stdev=938.22 00:29:25.286 clat percentiles (usec): 00:29:25.286 | 1.00th=[30540], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:29:25.286 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31589], 00:29:25.286 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32113], 95.00th=[32637], 00:29:25.286 | 99.00th=[34866], 99.50th=[36963], 99.90th=[39060], 99.95th=[39060], 00:29:25.286 | 99.99th=[39060] 00:29:25.286 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1990.55, stdev=65.17, samples=20 00:29:25.286 iops : min= 480, max= 512, avg=497.60, stdev=16.33, samples=20 00:29:25.286 lat (msec) : 50=100.00% 00:29:25.286 cpu : usr=98.42%, sys=1.10%, ctx=18, majf=0, minf=34 00:29:25.286 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:25.286 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.286 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.286 filename2: (groupid=0, jobs=1): err= 0: pid=1186855: Tue Nov 26 01:22:15 2024 00:29:25.286 read: IOPS=498, BW=1994KiB/s (2042kB/s)(19.5MiB/10015msec) 00:29:25.286 slat (usec): min=7, max=162, avg=34.01, stdev=20.83 00:29:25.286 clat (usec): min=23007, max=40271, avg=31806.79, stdev=997.75 00:29:25.286 lat (usec): min=23066, max=40301, avg=31840.80, stdev=995.41 00:29:25.286 clat percentiles (usec): 00:29:25.286 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31065], 20.00th=[31327], 00:29:25.286 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31851], 60.00th=[31851], 00:29:25.286 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.286 | 99.00th=[35390], 99.50th=[36439], 99.90th=[40109], 99.95th=[40109], 00:29:25.286 | 99.99th=[40109] 00:29:25.286 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1990.40, stdev=63.87, samples=20 00:29:25.286 iops : min= 480, max= 512, avg=497.60, stdev=15.97, samples=20 00:29:25.286 lat (msec) : 50=100.00% 00:29:25.286 cpu : usr=97.51%, sys=1.52%, ctx=71, majf=0, minf=47 00:29:25.286 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:25.286 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.286 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.286 filename2: (groupid=0, jobs=1): err= 0: pid=1186856: Tue Nov 26 01:22:15 2024 00:29:25.286 read: IOPS=499, BW=1998KiB/s (2046kB/s)(19.6MiB/10027msec) 00:29:25.286 slat (usec): min=6, max=141, avg=38.36, stdev=20.61 00:29:25.286 clat (usec): min=15430, max=40576, avg=31726.88, stdev=1380.20 00:29:25.286 lat (usec): min=15436, max=40625, avg=31765.25, stdev=1377.71 00:29:25.286 clat percentiles (usec): 00:29:25.286 | 1.00th=[26608], 5.00th=[30802], 10.00th=[31065], 20.00th=[31327], 00:29:25.286 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.286 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.286 | 99.00th=[35914], 99.50th=[36439], 99.90th=[38536], 99.95th=[39060], 00:29:25.286 | 99.99th=[40633] 00:29:25.286 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=1996.80, stdev=62.85, samples=20 00:29:25.286 iops : min= 480, max= 512, avg=499.20, stdev=15.71, samples=20 00:29:25.286 lat (msec) : 20=0.32%, 50=99.68% 00:29:25.286 cpu : usr=98.44%, sys=1.11%, ctx=14, majf=0, minf=52 00:29:25.286 IO depths : 1=5.8%, 2=12.0%, 4=24.9%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:25.286 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 issued rwts: total=5008,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.286 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.286 filename2: (groupid=0, jobs=1): err= 0: pid=1186857: Tue Nov 26 01:22:15 2024 00:29:25.286 read: IOPS=498, BW=1994KiB/s (2042kB/s)(19.5MiB/10015msec) 00:29:25.286 slat (usec): min=8, max=143, avg=32.66, stdev=17.56 00:29:25.286 clat (usec): min=22605, max=40452, avg=31807.91, stdev=971.76 00:29:25.286 lat (usec): min=22665, max=40469, avg=31840.57, stdev=969.14 00:29:25.286 clat percentiles (usec): 00:29:25.286 | 1.00th=[30540], 5.00th=[31065], 10.00th=[31327], 20.00th=[31327], 00:29:25.286 | 30.00th=[31589], 40.00th=[31589], 50.00th=[31589], 60.00th=[31851], 00:29:25.286 | 70.00th=[31851], 80.00th=[32113], 90.00th=[32375], 95.00th=[32900], 00:29:25.286 | 99.00th=[35390], 99.50th=[36439], 99.90th=[40633], 99.95th=[40633], 00:29:25.286 | 99.99th=[40633] 00:29:25.286 bw ( KiB/s): min= 1920, max= 2048, per=4.17%, avg=1990.40, stdev=65.33, samples=20 00:29:25.286 iops : min= 480, max= 512, avg=497.60, stdev=16.33, samples=20 00:29:25.286 lat (msec) : 50=100.00% 00:29:25.286 cpu : usr=98.02%, sys=1.26%, ctx=80, majf=0, minf=45 00:29:25.286 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:25.286 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.286 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.286 filename2: (groupid=0, jobs=1): err= 0: pid=1186858: Tue Nov 26 01:22:15 2024 00:29:25.286 read: IOPS=497, BW=1989KiB/s (2036kB/s)(19.5MiB/10041msec) 00:29:25.286 slat (usec): min=7, max=153, avg=48.32, stdev=20.32 00:29:25.286 clat (usec): min=12596, max=65980, avg=31632.74, stdev=2752.17 00:29:25.286 lat (usec): min=12622, max=66025, avg=31681.06, stdev=2753.71 00:29:25.286 clat percentiles (usec): 00:29:25.286 | 1.00th=[22152], 5.00th=[30802], 10.00th=[31065], 20.00th=[31065], 00:29:25.286 | 30.00th=[31327], 40.00th=[31327], 50.00th=[31589], 60.00th=[31589], 00:29:25.286 | 70.00th=[31851], 80.00th=[31851], 90.00th=[32375], 95.00th=[32900], 00:29:25.286 | 99.00th=[36439], 99.50th=[48497], 99.90th=[65799], 99.95th=[65799], 00:29:25.286 | 99.99th=[65799] 00:29:25.286 bw ( KiB/s): min= 1792, max= 2144, per=4.17%, avg=1994.40, stdev=83.43, samples=20 00:29:25.286 iops : min= 448, max= 536, avg=498.60, stdev=20.86, samples=20 00:29:25.286 lat (msec) : 20=0.72%, 50=98.92%, 100=0.36% 00:29:25.286 cpu : usr=98.74%, sys=0.86%, ctx=14, majf=0, minf=29 00:29:25.286 IO depths : 1=5.7%, 2=11.7%, 4=24.3%, 8=51.4%, 16=6.9%, 32=0.0%, >=64=0.0% 00:29:25.286 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:25.286 issued rwts: total=4992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:25.286 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:25.286 00:29:25.286 Run status group 0 (all jobs): 00:29:25.286 READ: bw=46.7MiB/s (48.9MB/s), 1989KiB/s-2034KiB/s (2036kB/s-2082kB/s), io=468MiB (491MB), run=10003-10041msec 00:29:25.854 01:22:16 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:25.855 01:22:16 -- target/dif.sh@43 -- # local sub 00:29:25.855 01:22:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:25.855 01:22:16 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:25.855 01:22:16 -- target/dif.sh@36 -- # local sub_id=0 00:29:25.855 01:22:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:25.855 01:22:16 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:25.855 01:22:16 -- target/dif.sh@36 -- # local sub_id=1 00:29:25.855 01:22:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@45 -- # for sub in "$@" 00:29:25.855 01:22:16 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:25.855 01:22:16 -- target/dif.sh@36 -- # local sub_id=2 00:29:25.855 01:22:16 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:25.855 01:22:16 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:25.855 01:22:16 -- target/dif.sh@115 -- # numjobs=2 00:29:25.855 01:22:16 -- target/dif.sh@115 -- # iodepth=8 00:29:25.855 01:22:16 -- target/dif.sh@115 -- # runtime=5 00:29:25.855 01:22:16 -- target/dif.sh@115 -- # files=1 00:29:25.855 01:22:16 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:25.855 01:22:16 -- target/dif.sh@28 -- # local sub 00:29:25.855 01:22:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:25.855 01:22:16 -- target/dif.sh@31 -- # create_subsystem 0 00:29:25.855 01:22:16 -- target/dif.sh@18 -- # local sub_id=0 00:29:25.855 01:22:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 bdev_null0 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 [2024-11-26 01:22:16.187200] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@30 -- # for sub in "$@" 00:29:25.855 01:22:16 -- target/dif.sh@31 -- # create_subsystem 1 00:29:25.855 01:22:16 -- target/dif.sh@18 -- # local sub_id=1 00:29:25.855 01:22:16 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 bdev_null1 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:25.855 01:22:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:25.855 01:22:16 -- common/autotest_common.sh@10 -- # set +x 00:29:25.855 01:22:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.855 01:22:16 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:25.855 01:22:16 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:25.855 01:22:16 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:25.855 01:22:16 -- nvmf/common.sh@520 -- # config=() 00:29:25.855 01:22:16 -- nvmf/common.sh@520 -- # local subsystem config 00:29:25.855 01:22:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:25.855 01:22:16 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:25.855 01:22:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:25.855 { 00:29:25.855 "params": { 00:29:25.855 "name": "Nvme$subsystem", 00:29:25.855 "trtype": "$TEST_TRANSPORT", 00:29:25.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:25.855 "adrfam": "ipv4", 00:29:25.855 "trsvcid": "$NVMF_PORT", 00:29:25.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:25.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:25.855 "hdgst": ${hdgst:-false}, 00:29:25.855 "ddgst": ${ddgst:-false} 00:29:25.855 }, 00:29:25.855 "method": "bdev_nvme_attach_controller" 00:29:25.855 } 00:29:25.855 EOF 00:29:25.855 )") 00:29:25.855 01:22:16 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:25.855 01:22:16 -- target/dif.sh@82 -- # gen_fio_conf 00:29:25.855 01:22:16 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:25.855 01:22:16 -- target/dif.sh@54 -- # local file 00:29:25.855 01:22:16 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:25.855 01:22:16 -- target/dif.sh@56 -- # cat 00:29:25.855 01:22:16 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:25.855 01:22:16 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:25.855 01:22:16 -- common/autotest_common.sh@1330 -- # shift 00:29:25.855 01:22:16 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:25.855 01:22:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:25.855 01:22:16 -- nvmf/common.sh@542 -- # cat 00:29:25.855 01:22:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:25.855 01:22:16 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:25.855 01:22:16 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:25.855 01:22:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:25.855 01:22:16 -- target/dif.sh@73 -- # cat 00:29:25.855 01:22:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:25.855 01:22:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:25.855 01:22:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:25.855 { 00:29:25.855 "params": { 00:29:25.855 "name": "Nvme$subsystem", 00:29:25.855 "trtype": "$TEST_TRANSPORT", 00:29:25.855 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:25.855 "adrfam": "ipv4", 00:29:25.855 "trsvcid": "$NVMF_PORT", 00:29:25.855 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:25.855 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:25.855 "hdgst": ${hdgst:-false}, 00:29:25.855 "ddgst": ${ddgst:-false} 00:29:25.855 }, 00:29:25.855 "method": "bdev_nvme_attach_controller" 00:29:25.855 } 00:29:25.855 EOF 00:29:25.855 )") 00:29:25.855 01:22:16 -- nvmf/common.sh@542 -- # cat 00:29:25.855 01:22:16 -- target/dif.sh@72 -- # (( file++ )) 00:29:25.855 01:22:16 -- target/dif.sh@72 -- # (( file <= files )) 00:29:25.855 01:22:16 -- nvmf/common.sh@544 -- # jq . 00:29:25.855 01:22:16 -- nvmf/common.sh@545 -- # IFS=, 00:29:25.855 01:22:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:25.855 "params": { 00:29:25.855 "name": "Nvme0", 00:29:25.855 "trtype": "tcp", 00:29:25.855 "traddr": "10.0.0.2", 00:29:25.855 "adrfam": "ipv4", 00:29:25.855 "trsvcid": "4420", 00:29:25.855 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:25.855 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:25.855 "hdgst": false, 00:29:25.855 "ddgst": false 00:29:25.855 }, 00:29:25.855 "method": "bdev_nvme_attach_controller" 00:29:25.855 },{ 00:29:25.855 "params": { 00:29:25.855 "name": "Nvme1", 00:29:25.855 "trtype": "tcp", 00:29:25.855 "traddr": "10.0.0.2", 00:29:25.855 "adrfam": "ipv4", 00:29:25.855 "trsvcid": "4420", 00:29:25.855 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:25.855 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:25.855 "hdgst": false, 00:29:25.855 "ddgst": false 00:29:25.855 }, 00:29:25.855 "method": "bdev_nvme_attach_controller" 00:29:25.855 }' 00:29:25.856 01:22:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:25.856 01:22:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:25.856 01:22:16 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:25.856 01:22:16 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:25.856 01:22:16 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:25.856 01:22:16 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:25.856 01:22:16 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:25.856 01:22:16 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:25.856 01:22:16 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:25.856 01:22:16 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:26.114 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:26.114 ... 00:29:26.114 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:26.114 ... 00:29:26.114 fio-3.35 00:29:26.114 Starting 4 threads 00:29:26.114 EAL: No free 2048 kB hugepages reported on node 1 00:29:26.681 [2024-11-26 01:22:17.125244] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:26.681 [2024-11-26 01:22:17.125294] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:31.947 00:29:31.947 filename0: (groupid=0, jobs=1): err= 0: pid=1188278: Tue Nov 26 01:22:22 2024 00:29:31.947 read: IOPS=1888, BW=14.8MiB/s (15.5MB/s)(73.8MiB/5003msec) 00:29:31.947 slat (nsec): min=4183, max=68540, avg=20362.03, stdev=10874.06 00:29:31.947 clat (usec): min=962, max=9350, avg=4168.10, stdev=442.85 00:29:31.947 lat (usec): min=982, max=9376, avg=4188.46, stdev=443.65 00:29:31.947 clat percentiles (usec): 00:29:31.947 | 1.00th=[ 2868], 5.00th=[ 3425], 10.00th=[ 3752], 20.00th=[ 3982], 00:29:31.947 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4228], 00:29:31.947 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4621], 00:29:31.947 | 99.00th=[ 5538], 99.50th=[ 6128], 99.90th=[ 7439], 99.95th=[ 8979], 00:29:31.947 | 99.99th=[ 9372] 00:29:31.947 bw ( KiB/s): min=14848, max=15552, per=25.22%, avg=15107.20, stdev=233.18, samples=10 00:29:31.947 iops : min= 1856, max= 1944, avg=1888.40, stdev=29.15, samples=10 00:29:31.947 lat (usec) : 1000=0.01% 00:29:31.947 lat (msec) : 2=0.13%, 4=21.51%, 10=78.35% 00:29:31.947 cpu : usr=95.22%, sys=3.94%, ctx=128, majf=0, minf=9 00:29:31.947 IO depths : 1=0.2%, 2=11.9%, 4=60.4%, 8=27.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:31.947 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 issued rwts: total=9450,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.947 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:31.947 filename0: (groupid=0, jobs=1): err= 0: pid=1188279: Tue Nov 26 01:22:22 2024 00:29:31.947 read: IOPS=1863, BW=14.6MiB/s (15.3MB/s)(72.9MiB/5003msec) 00:29:31.947 slat (nsec): min=4300, max=66511, avg=21929.94, stdev=10529.40 00:29:31.947 clat (usec): min=779, max=7800, avg=4215.26, stdev=490.99 00:29:31.947 lat (usec): min=798, max=7849, avg=4237.19, stdev=490.97 00:29:31.947 clat percentiles (usec): 00:29:31.947 | 1.00th=[ 2802], 5.00th=[ 3589], 10.00th=[ 3851], 20.00th=[ 4015], 00:29:31.947 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4228], 00:29:31.947 | 70.00th=[ 4293], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4817], 00:29:31.947 | 99.00th=[ 6325], 99.50th=[ 6587], 99.90th=[ 7046], 99.95th=[ 7373], 00:29:31.947 | 99.99th=[ 7832] 00:29:31.947 bw ( KiB/s): min=14525, max=15168, per=24.89%, avg=14910.10, stdev=188.10, samples=10 00:29:31.947 iops : min= 1815, max= 1896, avg=1863.70, stdev=23.66, samples=10 00:29:31.947 lat (usec) : 1000=0.08% 00:29:31.947 lat (msec) : 2=0.33%, 4=17.60%, 10=81.99% 00:29:31.947 cpu : usr=95.86%, sys=3.56%, ctx=8, majf=0, minf=0 00:29:31.947 IO depths : 1=0.1%, 2=14.7%, 4=58.1%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:31.947 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 issued rwts: total=9325,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.947 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:31.947 filename1: (groupid=0, jobs=1): err= 0: pid=1188280: Tue Nov 26 01:22:22 2024 00:29:31.947 read: IOPS=1871, BW=14.6MiB/s (15.3MB/s)(73.1MiB/5001msec) 00:29:31.947 slat (nsec): min=6716, max=68206, avg=20700.63, stdev=11094.90 00:29:31.947 clat (usec): min=718, max=8053, avg=4203.11, stdev=497.29 00:29:31.947 lat (usec): min=731, max=8060, avg=4223.81, stdev=497.73 00:29:31.947 clat percentiles (usec): 00:29:31.947 | 1.00th=[ 2835], 5.00th=[ 3556], 10.00th=[ 3818], 20.00th=[ 4015], 00:29:31.947 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4228], 00:29:31.947 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4490], 95.00th=[ 4752], 00:29:31.947 | 99.00th=[ 6325], 99.50th=[ 6783], 99.90th=[ 7308], 99.95th=[ 7701], 00:29:31.947 | 99.99th=[ 8029] 00:29:31.947 bw ( KiB/s): min=14576, max=16048, per=24.99%, avg=14972.44, stdev=444.61, samples=9 00:29:31.947 iops : min= 1822, max= 2006, avg=1871.56, stdev=55.58, samples=9 00:29:31.947 lat (usec) : 750=0.02%, 1000=0.04% 00:29:31.947 lat (msec) : 2=0.28%, 4=19.42%, 10=80.24% 00:29:31.947 cpu : usr=94.96%, sys=4.48%, ctx=11, majf=0, minf=0 00:29:31.947 IO depths : 1=0.1%, 2=12.4%, 4=60.3%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:31.947 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 issued rwts: total=9361,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.947 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:31.947 filename1: (groupid=0, jobs=1): err= 0: pid=1188281: Tue Nov 26 01:22:22 2024 00:29:31.947 read: IOPS=1865, BW=14.6MiB/s (15.3MB/s)(72.9MiB/5002msec) 00:29:31.947 slat (nsec): min=4350, max=76391, avg=22077.77, stdev=11130.58 00:29:31.947 clat (usec): min=896, max=7569, avg=4206.22, stdev=530.09 00:29:31.947 lat (usec): min=910, max=7582, avg=4228.30, stdev=530.11 00:29:31.947 clat percentiles (usec): 00:29:31.947 | 1.00th=[ 2671], 5.00th=[ 3523], 10.00th=[ 3818], 20.00th=[ 3982], 00:29:31.947 | 30.00th=[ 4080], 40.00th=[ 4146], 50.00th=[ 4178], 60.00th=[ 4228], 00:29:31.947 | 70.00th=[ 4293], 80.00th=[ 4359], 90.00th=[ 4555], 95.00th=[ 4948], 00:29:31.947 | 99.00th=[ 6325], 99.50th=[ 6652], 99.90th=[ 7242], 99.95th=[ 7373], 00:29:31.947 | 99.99th=[ 7570] 00:29:31.947 bw ( KiB/s): min=14512, max=15232, per=24.86%, avg=14894.22, stdev=221.48, samples=9 00:29:31.947 iops : min= 1814, max= 1904, avg=1861.78, stdev=27.68, samples=9 00:29:31.947 lat (usec) : 1000=0.03% 00:29:31.947 lat (msec) : 2=0.43%, 4=19.81%, 10=79.73% 00:29:31.947 cpu : usr=94.84%, sys=4.52%, ctx=10, majf=0, minf=9 00:29:31.947 IO depths : 1=0.1%, 2=16.6%, 4=56.8%, 8=26.6%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:31.947 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:31.947 issued rwts: total=9330,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:31.947 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:31.947 00:29:31.947 Run status group 0 (all jobs): 00:29:31.947 READ: bw=58.5MiB/s (61.3MB/s), 14.6MiB/s-14.8MiB/s (15.3MB/s-15.5MB/s), io=293MiB (307MB), run=5001-5003msec 00:29:32.206 01:22:22 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:32.206 01:22:22 -- target/dif.sh@43 -- # local sub 00:29:32.206 01:22:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.206 01:22:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:32.206 01:22:22 -- target/dif.sh@36 -- # local sub_id=0 00:29:32.206 01:22:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@45 -- # for sub in "$@" 00:29:32.206 01:22:22 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:32.206 01:22:22 -- target/dif.sh@36 -- # local sub_id=1 00:29:32.206 01:22:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 00:29:32.206 real 0m24.363s 00:29:32.206 user 4m32.776s 00:29:32.206 sys 0m5.991s 00:29:32.206 01:22:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 ************************************ 00:29:32.206 END TEST fio_dif_rand_params 00:29:32.206 ************************************ 00:29:32.206 01:22:22 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:32.206 01:22:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:32.206 01:22:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 ************************************ 00:29:32.206 START TEST fio_dif_digest 00:29:32.206 ************************************ 00:29:32.206 01:22:22 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:32.206 01:22:22 -- target/dif.sh@123 -- # local NULL_DIF 00:29:32.206 01:22:22 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:32.206 01:22:22 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:32.206 01:22:22 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:32.206 01:22:22 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:32.206 01:22:22 -- target/dif.sh@127 -- # numjobs=3 00:29:32.206 01:22:22 -- target/dif.sh@127 -- # iodepth=3 00:29:32.206 01:22:22 -- target/dif.sh@127 -- # runtime=10 00:29:32.206 01:22:22 -- target/dif.sh@128 -- # hdgst=true 00:29:32.206 01:22:22 -- target/dif.sh@128 -- # ddgst=true 00:29:32.206 01:22:22 -- target/dif.sh@130 -- # create_subsystems 0 00:29:32.206 01:22:22 -- target/dif.sh@28 -- # local sub 00:29:32.206 01:22:22 -- target/dif.sh@30 -- # for sub in "$@" 00:29:32.206 01:22:22 -- target/dif.sh@31 -- # create_subsystem 0 00:29:32.206 01:22:22 -- target/dif.sh@18 -- # local sub_id=0 00:29:32.206 01:22:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 bdev_null0 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:32.206 01:22:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:32.206 01:22:22 -- common/autotest_common.sh@10 -- # set +x 00:29:32.206 [2024-11-26 01:22:22.664905] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:32.206 01:22:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:32.206 01:22:22 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:32.206 01:22:22 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:32.206 01:22:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.206 01:22:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:32.207 01:22:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.207 01:22:22 -- nvmf/common.sh@520 -- # config=() 00:29:32.207 01:22:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:32.207 01:22:22 -- nvmf/common.sh@520 -- # local subsystem config 00:29:32.207 01:22:22 -- target/dif.sh@82 -- # gen_fio_conf 00:29:32.207 01:22:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:32.207 01:22:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:32.207 01:22:22 -- target/dif.sh@54 -- # local file 00:29:32.207 01:22:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:32.207 01:22:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:32.207 { 00:29:32.207 "params": { 00:29:32.207 "name": "Nvme$subsystem", 00:29:32.207 "trtype": "$TEST_TRANSPORT", 00:29:32.207 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:32.207 "adrfam": "ipv4", 00:29:32.207 "trsvcid": "$NVMF_PORT", 00:29:32.207 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:32.207 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:32.207 "hdgst": ${hdgst:-false}, 00:29:32.207 "ddgst": ${ddgst:-false} 00:29:32.207 }, 00:29:32.207 "method": "bdev_nvme_attach_controller" 00:29:32.207 } 00:29:32.207 EOF 00:29:32.207 )") 00:29:32.207 01:22:22 -- target/dif.sh@56 -- # cat 00:29:32.207 01:22:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.207 01:22:22 -- common/autotest_common.sh@1330 -- # shift 00:29:32.207 01:22:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:32.207 01:22:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:32.207 01:22:22 -- nvmf/common.sh@542 -- # cat 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.207 01:22:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:32.207 01:22:22 -- target/dif.sh@72 -- # (( file <= files )) 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:32.207 01:22:22 -- nvmf/common.sh@544 -- # jq . 00:29:32.207 01:22:22 -- nvmf/common.sh@545 -- # IFS=, 00:29:32.207 01:22:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:32.207 "params": { 00:29:32.207 "name": "Nvme0", 00:29:32.207 "trtype": "tcp", 00:29:32.207 "traddr": "10.0.0.2", 00:29:32.207 "adrfam": "ipv4", 00:29:32.207 "trsvcid": "4420", 00:29:32.207 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:32.207 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:32.207 "hdgst": true, 00:29:32.207 "ddgst": true 00:29:32.207 }, 00:29:32.207 "method": "bdev_nvme_attach_controller" 00:29:32.207 }' 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:32.207 01:22:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:32.207 01:22:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:32.207 01:22:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:32.207 01:22:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:32.207 01:22:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:32.207 01:22:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:32.465 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:32.465 ... 00:29:32.465 fio-3.35 00:29:32.465 Starting 3 threads 00:29:32.465 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.033 [2024-11-26 01:22:23.348010] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:33.033 [2024-11-26 01:22:23.348105] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:43.005 00:29:43.005 filename0: (groupid=0, jobs=1): err= 0: pid=1189050: Tue Nov 26 01:22:33 2024 00:29:43.005 read: IOPS=224, BW=28.1MiB/s (29.4MB/s)(282MiB/10048msec) 00:29:43.005 slat (nsec): min=4281, max=59473, avg=21871.00, stdev=5423.92 00:29:43.005 clat (usec): min=7609, max=49652, avg=13310.30, stdev=1859.36 00:29:43.005 lat (usec): min=7628, max=49672, avg=13332.17, stdev=1859.82 00:29:43.005 clat percentiles (usec): 00:29:43.005 | 1.00th=[ 8717], 5.00th=[ 9634], 10.00th=[11207], 20.00th=[12518], 00:29:43.005 | 30.00th=[12911], 40.00th=[13304], 50.00th=[13566], 60.00th=[13829], 00:29:43.005 | 70.00th=[14091], 80.00th=[14353], 90.00th=[14877], 95.00th=[15270], 00:29:43.005 | 99.00th=[16057], 99.50th=[16581], 99.90th=[18220], 99.95th=[47973], 00:29:43.005 | 99.99th=[49546] 00:29:43.005 bw ( KiB/s): min=27904, max=30720, per=35.63%, avg=28864.00, stdev=842.43, samples=20 00:29:43.005 iops : min= 218, max= 240, avg=225.50, stdev= 6.58, samples=20 00:29:43.005 lat (msec) : 10=6.65%, 20=93.27%, 50=0.09% 00:29:43.005 cpu : usr=94.88%, sys=4.51%, ctx=19, majf=0, minf=149 00:29:43.005 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:43.005 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:43.005 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:43.005 issued rwts: total=2257,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:43.005 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:43.005 filename0: (groupid=0, jobs=1): err= 0: pid=1189051: Tue Nov 26 01:22:33 2024 00:29:43.005 read: IOPS=216, BW=27.1MiB/s (28.4MB/s)(272MiB/10046msec) 00:29:43.005 slat (nsec): min=7287, max=50083, avg=16050.00, stdev=5232.08 00:29:43.005 clat (usec): min=7841, max=55410, avg=13802.69, stdev=1948.22 00:29:43.005 lat (usec): min=7858, max=55431, avg=13818.74, stdev=1948.12 00:29:43.005 clat percentiles (usec): 00:29:43.005 | 1.00th=[ 9110], 5.00th=[10028], 10.00th=[11731], 20.00th=[13042], 00:29:43.005 | 30.00th=[13435], 40.00th=[13698], 50.00th=[13960], 60.00th=[14353], 00:29:43.005 | 70.00th=[14484], 80.00th=[14877], 90.00th=[15401], 95.00th=[15926], 00:29:43.005 | 99.00th=[16581], 99.50th=[16909], 99.90th=[18220], 99.95th=[49546], 00:29:43.005 | 99.99th=[55313] 00:29:43.005 bw ( KiB/s): min=26112, max=30720, per=34.37%, avg=27840.00, stdev=975.26, samples=20 00:29:43.005 iops : min= 204, max= 240, avg=217.50, stdev= 7.62, samples=20 00:29:43.006 lat (msec) : 10=5.05%, 20=94.86%, 50=0.05%, 100=0.05% 00:29:43.006 cpu : usr=93.63%, sys=5.82%, ctx=41, majf=0, minf=114 00:29:43.006 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:43.006 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:43.006 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:43.006 issued rwts: total=2177,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:43.006 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:43.006 filename0: (groupid=0, jobs=1): err= 0: pid=1189052: Tue Nov 26 01:22:33 2024 00:29:43.006 read: IOPS=191, BW=24.0MiB/s (25.1MB/s)(241MiB/10045msec) 00:29:43.006 slat (nsec): min=7387, max=82233, avg=16155.43, stdev=5118.88 00:29:43.006 clat (usec): min=11257, max=57440, avg=15613.41, stdev=6686.38 00:29:43.006 lat (usec): min=11291, max=57455, avg=15629.56, stdev=6686.50 00:29:43.006 clat percentiles (usec): 00:29:43.006 | 1.00th=[12387], 5.00th=[13042], 10.00th=[13435], 20.00th=[13698], 00:29:43.006 | 30.00th=[14091], 40.00th=[14222], 50.00th=[14484], 60.00th=[14746], 00:29:43.006 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15795], 95.00th=[16450], 00:29:43.006 | 99.00th=[55837], 99.50th=[56361], 99.90th=[57410], 99.95th=[57410], 00:29:43.006 | 99.99th=[57410] 00:29:43.006 bw ( KiB/s): min=19456, max=26880, per=30.39%, avg=24616.75, stdev=1733.72, samples=20 00:29:43.006 iops : min= 152, max= 210, avg=192.30, stdev=13.55, samples=20 00:29:43.006 lat (msec) : 20=97.25%, 50=0.10%, 100=2.65% 00:29:43.006 cpu : usr=93.99%, sys=5.51%, ctx=35, majf=0, minf=211 00:29:43.006 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:43.006 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:43.006 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:43.006 issued rwts: total=1925,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:43.006 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:43.006 00:29:43.006 Run status group 0 (all jobs): 00:29:43.006 READ: bw=79.1MiB/s (82.9MB/s), 24.0MiB/s-28.1MiB/s (25.1MB/s-29.4MB/s), io=795MiB (833MB), run=10045-10048msec 00:29:43.575 01:22:33 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:43.575 01:22:33 -- target/dif.sh@43 -- # local sub 00:29:43.575 01:22:33 -- target/dif.sh@45 -- # for sub in "$@" 00:29:43.575 01:22:33 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:43.575 01:22:33 -- target/dif.sh@36 -- # local sub_id=0 00:29:43.575 01:22:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:43.575 01:22:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:43.575 01:22:33 -- common/autotest_common.sh@10 -- # set +x 00:29:43.575 01:22:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:43.575 01:22:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:43.575 01:22:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:43.575 01:22:33 -- common/autotest_common.sh@10 -- # set +x 00:29:43.575 01:22:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:43.575 00:29:43.575 real 0m11.225s 00:29:43.575 user 0m29.620s 00:29:43.575 sys 0m1.857s 00:29:43.575 01:22:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:43.575 01:22:33 -- common/autotest_common.sh@10 -- # set +x 00:29:43.575 ************************************ 00:29:43.575 END TEST fio_dif_digest 00:29:43.575 ************************************ 00:29:43.575 01:22:33 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:43.575 01:22:33 -- target/dif.sh@147 -- # nvmftestfini 00:29:43.575 01:22:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:43.575 01:22:33 -- nvmf/common.sh@116 -- # sync 00:29:43.575 01:22:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:43.575 01:22:33 -- nvmf/common.sh@119 -- # set +e 00:29:43.575 01:22:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:43.575 01:22:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:43.575 rmmod nvme_tcp 00:29:43.575 rmmod nvme_fabrics 00:29:43.575 rmmod nvme_keyring 00:29:43.575 01:22:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:43.575 01:22:33 -- nvmf/common.sh@123 -- # set -e 00:29:43.575 01:22:33 -- nvmf/common.sh@124 -- # return 0 00:29:43.575 01:22:33 -- nvmf/common.sh@477 -- # '[' -n 1182817 ']' 00:29:43.575 01:22:33 -- nvmf/common.sh@478 -- # killprocess 1182817 00:29:43.575 01:22:33 -- common/autotest_common.sh@936 -- # '[' -z 1182817 ']' 00:29:43.575 01:22:33 -- common/autotest_common.sh@940 -- # kill -0 1182817 00:29:43.575 01:22:33 -- common/autotest_common.sh@941 -- # uname 00:29:43.576 01:22:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:43.576 01:22:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1182817 00:29:43.576 01:22:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:43.576 01:22:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:43.576 01:22:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1182817' 00:29:43.576 killing process with pid 1182817 00:29:43.576 01:22:33 -- common/autotest_common.sh@955 -- # kill 1182817 00:29:43.576 01:22:33 -- common/autotest_common.sh@960 -- # wait 1182817 00:29:43.835 01:22:34 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:43.835 01:22:34 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:44.771 Waiting for block devices as requested 00:29:45.031 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:45.031 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:45.292 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:45.292 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:45.292 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:45.292 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:45.551 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:45.551 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:45.551 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:45.551 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:45.811 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:45.811 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:45.811 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:45.811 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:46.071 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:46.071 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:46.071 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:46.332 01:22:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:46.332 01:22:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:46.332 01:22:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:46.332 01:22:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:46.332 01:22:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:46.332 01:22:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:46.332 01:22:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.239 01:22:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:48.239 00:29:48.239 real 1m7.828s 00:29:48.239 user 6m31.389s 00:29:48.239 sys 0m16.888s 00:29:48.239 01:22:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:48.239 01:22:38 -- common/autotest_common.sh@10 -- # set +x 00:29:48.239 ************************************ 00:29:48.239 END TEST nvmf_dif 00:29:48.239 ************************************ 00:29:48.239 01:22:38 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:48.239 01:22:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:48.239 01:22:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:48.239 01:22:38 -- common/autotest_common.sh@10 -- # set +x 00:29:48.239 ************************************ 00:29:48.239 START TEST nvmf_abort_qd_sizes 00:29:48.239 ************************************ 00:29:48.239 01:22:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:48.239 * Looking for test storage... 00:29:48.239 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:48.239 01:22:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:48.239 01:22:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:48.239 01:22:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:48.498 01:22:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:48.498 01:22:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:48.498 01:22:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:48.498 01:22:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:48.498 01:22:38 -- scripts/common.sh@335 -- # IFS=.-: 00:29:48.498 01:22:38 -- scripts/common.sh@335 -- # read -ra ver1 00:29:48.498 01:22:38 -- scripts/common.sh@336 -- # IFS=.-: 00:29:48.498 01:22:38 -- scripts/common.sh@336 -- # read -ra ver2 00:29:48.498 01:22:38 -- scripts/common.sh@337 -- # local 'op=<' 00:29:48.498 01:22:38 -- scripts/common.sh@339 -- # ver1_l=2 00:29:48.498 01:22:38 -- scripts/common.sh@340 -- # ver2_l=1 00:29:48.498 01:22:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:48.498 01:22:38 -- scripts/common.sh@343 -- # case "$op" in 00:29:48.498 01:22:38 -- scripts/common.sh@344 -- # : 1 00:29:48.498 01:22:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:48.498 01:22:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:48.498 01:22:38 -- scripts/common.sh@364 -- # decimal 1 00:29:48.498 01:22:38 -- scripts/common.sh@352 -- # local d=1 00:29:48.498 01:22:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:48.498 01:22:38 -- scripts/common.sh@354 -- # echo 1 00:29:48.498 01:22:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:48.498 01:22:38 -- scripts/common.sh@365 -- # decimal 2 00:29:48.498 01:22:38 -- scripts/common.sh@352 -- # local d=2 00:29:48.498 01:22:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:48.498 01:22:38 -- scripts/common.sh@354 -- # echo 2 00:29:48.498 01:22:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:48.498 01:22:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:48.498 01:22:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:48.498 01:22:38 -- scripts/common.sh@367 -- # return 0 00:29:48.498 01:22:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:48.498 01:22:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:48.498 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:48.498 --rc genhtml_branch_coverage=1 00:29:48.498 --rc genhtml_function_coverage=1 00:29:48.498 --rc genhtml_legend=1 00:29:48.498 --rc geninfo_all_blocks=1 00:29:48.498 --rc geninfo_unexecuted_blocks=1 00:29:48.498 00:29:48.498 ' 00:29:48.499 01:22:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:48.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:48.499 --rc genhtml_branch_coverage=1 00:29:48.499 --rc genhtml_function_coverage=1 00:29:48.499 --rc genhtml_legend=1 00:29:48.499 --rc geninfo_all_blocks=1 00:29:48.499 --rc geninfo_unexecuted_blocks=1 00:29:48.499 00:29:48.499 ' 00:29:48.499 01:22:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:48.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:48.499 --rc genhtml_branch_coverage=1 00:29:48.499 --rc genhtml_function_coverage=1 00:29:48.499 --rc genhtml_legend=1 00:29:48.499 --rc geninfo_all_blocks=1 00:29:48.499 --rc geninfo_unexecuted_blocks=1 00:29:48.499 00:29:48.499 ' 00:29:48.499 01:22:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:48.499 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:48.499 --rc genhtml_branch_coverage=1 00:29:48.499 --rc genhtml_function_coverage=1 00:29:48.499 --rc genhtml_legend=1 00:29:48.499 --rc geninfo_all_blocks=1 00:29:48.499 --rc geninfo_unexecuted_blocks=1 00:29:48.499 00:29:48.499 ' 00:29:48.499 01:22:38 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:48.499 01:22:38 -- nvmf/common.sh@7 -- # uname -s 00:29:48.499 01:22:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:48.499 01:22:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:48.499 01:22:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:48.499 01:22:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:48.499 01:22:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:48.499 01:22:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:48.499 01:22:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:48.499 01:22:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:48.499 01:22:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:48.499 01:22:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:48.499 01:22:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:48.499 01:22:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:48.499 01:22:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:48.499 01:22:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:48.499 01:22:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:48.499 01:22:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:48.499 01:22:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:48.499 01:22:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:48.499 01:22:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:48.499 01:22:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.499 01:22:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.499 01:22:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.499 01:22:38 -- paths/export.sh@5 -- # export PATH 00:29:48.499 01:22:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:48.499 01:22:38 -- nvmf/common.sh@46 -- # : 0 00:29:48.499 01:22:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:48.499 01:22:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:48.499 01:22:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:48.499 01:22:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:48.499 01:22:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:48.499 01:22:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:48.499 01:22:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:48.499 01:22:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:48.499 01:22:38 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:48.499 01:22:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:48.499 01:22:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:48.499 01:22:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:48.499 01:22:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:48.499 01:22:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:48.499 01:22:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:48.499 01:22:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:48.499 01:22:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:48.499 01:22:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:48.499 01:22:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:48.499 01:22:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:48.499 01:22:38 -- common/autotest_common.sh@10 -- # set +x 00:29:50.405 01:22:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:50.405 01:22:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:50.405 01:22:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:50.405 01:22:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:50.405 01:22:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:50.405 01:22:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:50.405 01:22:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:50.405 01:22:40 -- nvmf/common.sh@294 -- # net_devs=() 00:29:50.405 01:22:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:50.405 01:22:40 -- nvmf/common.sh@295 -- # e810=() 00:29:50.405 01:22:40 -- nvmf/common.sh@295 -- # local -ga e810 00:29:50.405 01:22:40 -- nvmf/common.sh@296 -- # x722=() 00:29:50.405 01:22:40 -- nvmf/common.sh@296 -- # local -ga x722 00:29:50.405 01:22:40 -- nvmf/common.sh@297 -- # mlx=() 00:29:50.405 01:22:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:50.405 01:22:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:50.405 01:22:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:50.405 01:22:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:50.405 01:22:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:50.405 01:22:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.405 01:22:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:50.405 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:50.405 01:22:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:50.405 01:22:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:50.405 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:50.405 01:22:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:50.405 01:22:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:50.405 01:22:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.405 01:22:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.405 01:22:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.406 01:22:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.406 01:22:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:50.406 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:50.406 01:22:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.406 01:22:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:50.406 01:22:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:50.406 01:22:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:50.406 01:22:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:50.406 01:22:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:50.406 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:50.406 01:22:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:50.406 01:22:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:50.406 01:22:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:50.406 01:22:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:50.406 01:22:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:50.406 01:22:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:50.406 01:22:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:50.406 01:22:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:50.406 01:22:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:50.406 01:22:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:50.406 01:22:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:50.406 01:22:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:50.406 01:22:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:50.406 01:22:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:50.406 01:22:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:50.406 01:22:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:50.406 01:22:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:50.406 01:22:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:50.406 01:22:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:50.406 01:22:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:50.406 01:22:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:50.406 01:22:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:50.406 01:22:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:50.406 01:22:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:50.406 01:22:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:50.406 01:22:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:50.406 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:50.406 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:29:50.406 00:29:50.406 --- 10.0.0.2 ping statistics --- 00:29:50.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.406 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:29:50.406 01:22:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:50.406 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:50.406 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:29:50.406 00:29:50.406 --- 10.0.0.1 ping statistics --- 00:29:50.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:50.406 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:29:50.406 01:22:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:50.406 01:22:40 -- nvmf/common.sh@410 -- # return 0 00:29:50.406 01:22:40 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:50.406 01:22:40 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:51.785 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:51.785 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:51.785 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:52.723 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:29:52.982 01:22:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:52.982 01:22:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:52.982 01:22:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:52.982 01:22:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:52.982 01:22:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:52.982 01:22:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:52.982 01:22:43 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:29:52.982 01:22:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:52.982 01:22:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:52.982 01:22:43 -- common/autotest_common.sh@10 -- # set +x 00:29:52.982 01:22:43 -- nvmf/common.sh@469 -- # nvmfpid=1194072 00:29:52.982 01:22:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:29:52.982 01:22:43 -- nvmf/common.sh@470 -- # waitforlisten 1194072 00:29:52.982 01:22:43 -- common/autotest_common.sh@829 -- # '[' -z 1194072 ']' 00:29:52.982 01:22:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:52.982 01:22:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:52.982 01:22:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:52.982 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:52.982 01:22:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:52.982 01:22:43 -- common/autotest_common.sh@10 -- # set +x 00:29:52.982 [2024-11-26 01:22:43.344244] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:52.982 [2024-11-26 01:22:43.344312] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:52.982 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.982 [2024-11-26 01:22:43.411732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:53.241 [2024-11-26 01:22:43.527684] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:53.241 [2024-11-26 01:22:43.527833] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:53.241 [2024-11-26 01:22:43.527850] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:53.241 [2024-11-26 01:22:43.527861] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:53.241 [2024-11-26 01:22:43.527926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:53.241 [2024-11-26 01:22:43.529703] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:53.241 [2024-11-26 01:22:43.529779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:53.241 [2024-11-26 01:22:43.529783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:53.807 01:22:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:53.807 01:22:44 -- common/autotest_common.sh@862 -- # return 0 00:29:53.807 01:22:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:53.807 01:22:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:53.807 01:22:44 -- common/autotest_common.sh@10 -- # set +x 00:29:53.807 01:22:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:53.807 01:22:44 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:29:53.807 01:22:44 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:29:53.807 01:22:44 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:29:53.807 01:22:44 -- scripts/common.sh@311 -- # local bdf bdfs 00:29:53.807 01:22:44 -- scripts/common.sh@312 -- # local nvmes 00:29:53.807 01:22:44 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:29:53.807 01:22:44 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:29:53.807 01:22:44 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:29:53.807 01:22:44 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:29:53.807 01:22:44 -- scripts/common.sh@322 -- # uname -s 00:29:53.807 01:22:44 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:29:53.807 01:22:44 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:29:53.807 01:22:44 -- scripts/common.sh@327 -- # (( 1 )) 00:29:53.807 01:22:44 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:29:53.807 01:22:44 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:29:53.807 01:22:44 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:29:53.807 01:22:44 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:29:53.807 01:22:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:53.807 01:22:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:53.807 01:22:44 -- common/autotest_common.sh@10 -- # set +x 00:29:53.808 ************************************ 00:29:53.808 START TEST spdk_target_abort 00:29:53.808 ************************************ 00:29:53.808 01:22:44 -- common/autotest_common.sh@1114 -- # spdk_target 00:29:53.808 01:22:44 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:29:53.808 01:22:44 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:53.808 01:22:44 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:29:53.808 01:22:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:53.808 01:22:44 -- common/autotest_common.sh@10 -- # set +x 00:29:57.132 spdk_targetn1 00:29:57.132 01:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:57.132 01:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.132 01:22:47 -- common/autotest_common.sh@10 -- # set +x 00:29:57.132 [2024-11-26 01:22:47.159947] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:57.132 01:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:29:57.132 01:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.132 01:22:47 -- common/autotest_common.sh@10 -- # set +x 00:29:57.132 01:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:29:57.132 01:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.132 01:22:47 -- common/autotest_common.sh@10 -- # set +x 00:29:57.132 01:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:29:57.132 01:22:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.132 01:22:47 -- common/autotest_common.sh@10 -- # set +x 00:29:57.132 [2024-11-26 01:22:47.192304] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:57.132 01:22:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:29:57.132 01:22:47 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@24 -- # local target r 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:29:57.133 01:22:47 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:29:57.133 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.449 Initializing NVMe Controllers 00:30:00.449 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:00.449 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:00.449 Initialization complete. Launching workers. 00:30:00.449 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 12328, failed: 0 00:30:00.449 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1249, failed to submit 11079 00:30:00.449 success 740, unsuccess 509, failed 0 00:30:00.449 01:22:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:00.449 01:22:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:00.449 EAL: No free 2048 kB hugepages reported on node 1 00:30:03.728 [2024-11-26 01:22:53.635725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.635892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xb805e0 is same with the state(5) to be set 00:30:03.728 [2024-11-26 01:22:53.736376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xba3740 is same with the state(5) to be set 00:30:03.728 Initializing NVMe Controllers 00:30:03.728 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:03.728 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:03.728 Initialization complete. Launching workers. 00:30:03.728 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8739, failed: 0 00:30:03.728 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1209, failed to submit 7530 00:30:03.728 success 373, unsuccess 836, failed 0 00:30:03.728 01:22:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:03.728 01:22:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:03.728 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.029 Initializing NVMe Controllers 00:30:07.029 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:07.029 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:07.029 Initialization complete. Launching workers. 00:30:07.029 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30994, failed: 0 00:30:07.029 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2677, failed to submit 28317 00:30:07.029 success 545, unsuccess 2132, failed 0 00:30:07.029 01:22:56 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:07.029 01:22:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:07.029 01:22:56 -- common/autotest_common.sh@10 -- # set +x 00:30:07.029 01:22:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:07.029 01:22:56 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:07.029 01:22:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:07.029 01:22:56 -- common/autotest_common.sh@10 -- # set +x 00:30:07.962 01:22:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:07.962 01:22:58 -- target/abort_qd_sizes.sh@62 -- # killprocess 1194072 00:30:07.962 01:22:58 -- common/autotest_common.sh@936 -- # '[' -z 1194072 ']' 00:30:07.962 01:22:58 -- common/autotest_common.sh@940 -- # kill -0 1194072 00:30:07.962 01:22:58 -- common/autotest_common.sh@941 -- # uname 00:30:07.962 01:22:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:07.962 01:22:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 1194072 00:30:07.962 01:22:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:07.962 01:22:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:07.962 01:22:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 1194072' 00:30:07.962 killing process with pid 1194072 00:30:07.962 01:22:58 -- common/autotest_common.sh@955 -- # kill 1194072 00:30:07.962 01:22:58 -- common/autotest_common.sh@960 -- # wait 1194072 00:30:08.221 00:30:08.221 real 0m14.254s 00:30:08.221 user 0m56.337s 00:30:08.221 sys 0m2.574s 00:30:08.221 01:22:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:08.221 01:22:58 -- common/autotest_common.sh@10 -- # set +x 00:30:08.221 ************************************ 00:30:08.221 END TEST spdk_target_abort 00:30:08.221 ************************************ 00:30:08.221 01:22:58 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:08.221 01:22:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:08.222 01:22:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:08.222 01:22:58 -- common/autotest_common.sh@10 -- # set +x 00:30:08.222 ************************************ 00:30:08.222 START TEST kernel_target_abort 00:30:08.222 ************************************ 00:30:08.222 01:22:58 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:08.222 01:22:58 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:08.222 01:22:58 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:08.222 01:22:58 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:08.222 01:22:58 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:08.222 01:22:58 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:08.222 01:22:58 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:08.222 01:22:58 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:08.222 01:22:58 -- nvmf/common.sh@627 -- # local block nvme 00:30:08.222 01:22:58 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:08.222 01:22:58 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:08.222 01:22:58 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:08.222 01:22:58 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:09.164 Waiting for block devices as requested 00:30:09.423 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:09.423 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:09.423 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:09.681 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:09.681 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:09.681 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:09.939 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:09.939 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:09.939 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:09.939 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:09.939 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:10.199 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:10.199 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:10.199 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:10.199 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:10.458 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:10.458 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:10.458 01:23:00 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:10.458 01:23:00 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:10.458 01:23:00 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:10.458 01:23:00 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:10.458 01:23:00 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:10.458 No valid GPT data, bailing 00:30:10.458 01:23:00 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:10.458 01:23:00 -- scripts/common.sh@393 -- # pt= 00:30:10.458 01:23:00 -- scripts/common.sh@394 -- # return 1 00:30:10.458 01:23:00 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:10.458 01:23:00 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:10.458 01:23:00 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:10.458 01:23:00 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:10.716 01:23:00 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:10.716 01:23:00 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:10.716 01:23:00 -- nvmf/common.sh@654 -- # echo 1 00:30:10.716 01:23:00 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:10.716 01:23:00 -- nvmf/common.sh@656 -- # echo 1 00:30:10.716 01:23:00 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:10.716 01:23:00 -- nvmf/common.sh@663 -- # echo tcp 00:30:10.716 01:23:00 -- nvmf/common.sh@664 -- # echo 4420 00:30:10.716 01:23:00 -- nvmf/common.sh@665 -- # echo ipv4 00:30:10.716 01:23:00 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:10.716 01:23:01 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:10.716 00:30:10.716 Discovery Log Number of Records 2, Generation counter 2 00:30:10.716 =====Discovery Log Entry 0====== 00:30:10.716 trtype: tcp 00:30:10.716 adrfam: ipv4 00:30:10.716 subtype: current discovery subsystem 00:30:10.716 treq: not specified, sq flow control disable supported 00:30:10.716 portid: 1 00:30:10.716 trsvcid: 4420 00:30:10.716 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:10.716 traddr: 10.0.0.1 00:30:10.716 eflags: none 00:30:10.716 sectype: none 00:30:10.717 =====Discovery Log Entry 1====== 00:30:10.717 trtype: tcp 00:30:10.717 adrfam: ipv4 00:30:10.717 subtype: nvme subsystem 00:30:10.717 treq: not specified, sq flow control disable supported 00:30:10.717 portid: 1 00:30:10.717 trsvcid: 4420 00:30:10.717 subnqn: kernel_target 00:30:10.717 traddr: 10.0.0.1 00:30:10.717 eflags: none 00:30:10.717 sectype: none 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:10.717 01:23:01 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:10.717 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.995 Initializing NVMe Controllers 00:30:13.995 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:13.995 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:13.995 Initialization complete. Launching workers. 00:30:13.995 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 43525, failed: 0 00:30:13.995 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 43525, failed to submit 0 00:30:13.995 success 0, unsuccess 43525, failed 0 00:30:13.995 01:23:04 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:13.995 01:23:04 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:13.995 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.276 Initializing NVMe Controllers 00:30:17.276 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:17.276 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:17.276 Initialization complete. Launching workers. 00:30:17.276 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 78444, failed: 0 00:30:17.276 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19758, failed to submit 58686 00:30:17.276 success 0, unsuccess 19758, failed 0 00:30:17.276 01:23:07 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:17.276 01:23:07 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:17.276 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.560 Initializing NVMe Controllers 00:30:20.560 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:20.560 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:20.560 Initialization complete. Launching workers. 00:30:20.560 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 73791, failed: 0 00:30:20.560 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 18438, failed to submit 55353 00:30:20.560 success 0, unsuccess 18438, failed 0 00:30:20.560 01:23:10 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:20.560 01:23:10 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:20.560 01:23:10 -- nvmf/common.sh@677 -- # echo 0 00:30:20.560 01:23:10 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:20.560 01:23:10 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:20.560 01:23:10 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:20.560 01:23:10 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:20.560 01:23:10 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:20.561 01:23:10 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:20.561 00:30:20.561 real 0m11.888s 00:30:20.561 user 0m5.476s 00:30:20.561 sys 0m2.452s 00:30:20.561 01:23:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:20.561 01:23:10 -- common/autotest_common.sh@10 -- # set +x 00:30:20.561 ************************************ 00:30:20.561 END TEST kernel_target_abort 00:30:20.561 ************************************ 00:30:20.561 01:23:10 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:20.561 01:23:10 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:20.561 01:23:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:20.561 01:23:10 -- nvmf/common.sh@116 -- # sync 00:30:20.561 01:23:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:20.561 01:23:10 -- nvmf/common.sh@119 -- # set +e 00:30:20.561 01:23:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:20.561 01:23:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:20.561 rmmod nvme_tcp 00:30:20.561 rmmod nvme_fabrics 00:30:20.561 rmmod nvme_keyring 00:30:20.561 01:23:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:20.561 01:23:10 -- nvmf/common.sh@123 -- # set -e 00:30:20.561 01:23:10 -- nvmf/common.sh@124 -- # return 0 00:30:20.561 01:23:10 -- nvmf/common.sh@477 -- # '[' -n 1194072 ']' 00:30:20.561 01:23:10 -- nvmf/common.sh@478 -- # killprocess 1194072 00:30:20.561 01:23:10 -- common/autotest_common.sh@936 -- # '[' -z 1194072 ']' 00:30:20.561 01:23:10 -- common/autotest_common.sh@940 -- # kill -0 1194072 00:30:20.561 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (1194072) - No such process 00:30:20.561 01:23:10 -- common/autotest_common.sh@963 -- # echo 'Process with pid 1194072 is not found' 00:30:20.561 Process with pid 1194072 is not found 00:30:20.561 01:23:10 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:20.561 01:23:10 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:21.496 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:21.496 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:21.496 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:21.496 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:21.496 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:21.496 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:21.496 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:21.496 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:21.496 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:21.496 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:21.496 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:21.496 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:21.496 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:21.496 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:21.496 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:21.496 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:21.496 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:21.754 01:23:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:21.754 01:23:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:21.754 01:23:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:21.754 01:23:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:21.754 01:23:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:21.754 01:23:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:21.754 01:23:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:23.659 01:23:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:23.659 00:30:23.659 real 0m35.450s 00:30:23.659 user 1m4.199s 00:30:23.659 sys 0m8.567s 00:30:23.659 01:23:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:23.659 01:23:14 -- common/autotest_common.sh@10 -- # set +x 00:30:23.660 ************************************ 00:30:23.660 END TEST nvmf_abort_qd_sizes 00:30:23.660 ************************************ 00:30:23.660 01:23:14 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:23.660 01:23:14 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:23.660 01:23:14 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:23.660 01:23:14 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:23.660 01:23:14 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:23.660 01:23:14 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:23.660 01:23:14 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:23.660 01:23:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:23.660 01:23:14 -- common/autotest_common.sh@10 -- # set +x 00:30:23.660 01:23:14 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:23.660 01:23:14 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:23.660 01:23:14 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:23.660 01:23:14 -- common/autotest_common.sh@10 -- # set +x 00:30:25.560 INFO: APP EXITING 00:30:25.560 INFO: killing all VMs 00:30:25.560 INFO: killing vhost app 00:30:25.560 INFO: EXIT DONE 00:30:26.494 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:26.494 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:26.494 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:26.494 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:26.494 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:26.494 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:26.752 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:26.752 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:26.752 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:26.752 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:26.752 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:26.752 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:26.752 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:26.752 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:26.752 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:26.752 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:26.752 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:28.126 Cleaning 00:30:28.126 Removing: /var/run/dpdk/spdk0/config 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:28.126 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:28.126 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:28.126 Removing: /var/run/dpdk/spdk1/config 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:28.126 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:28.126 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:28.126 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:28.126 Removing: /var/run/dpdk/spdk2/config 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:28.126 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:28.126 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:28.126 Removing: /var/run/dpdk/spdk3/config 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:28.126 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:28.126 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:28.126 Removing: /var/run/dpdk/spdk4/config 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:28.126 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:28.126 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:28.126 Removing: /dev/shm/bdev_svc_trace.1 00:30:28.126 Removing: /dev/shm/nvmf_trace.0 00:30:28.126 Removing: /dev/shm/spdk_tgt_trace.pid924197 00:30:28.126 Removing: /var/run/dpdk/spdk0 00:30:28.126 Removing: /var/run/dpdk/spdk1 00:30:28.126 Removing: /var/run/dpdk/spdk2 00:30:28.126 Removing: /var/run/dpdk/spdk3 00:30:28.126 Removing: /var/run/dpdk/spdk4 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1003719 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1006508 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1014246 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1017716 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1020119 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1020616 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1025758 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1026049 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1028733 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1032513 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1034785 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1041530 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1047005 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1048304 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1049103 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1060239 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1062545 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1065459 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1066676 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1068050 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1068315 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1068474 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1068740 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1069342 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1070714 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1071733 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1072187 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1075807 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1079300 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1083537 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1107483 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1110446 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1114794 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1115844 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1117017 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1119730 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1122266 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1126660 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1126662 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1129621 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1129759 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1129936 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1130303 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1130311 00:30:28.126 Removing: /var/run/dpdk/spdk_pid1131417 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1132701 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1133974 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1135191 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1136416 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1137635 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1141581 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1141989 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1143419 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1144691 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1148615 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1150668 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1154289 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1158034 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1161605 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1162133 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1162549 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1162971 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1163561 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1164120 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1164675 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1165224 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1167899 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1168089 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1172019 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1172213 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1173869 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1179916 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1179922 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1182995 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1184433 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1185879 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1186649 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1188096 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1188992 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1194512 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1194920 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1195324 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1197062 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1197474 00:30:28.386 Removing: /var/run/dpdk/spdk_pid1197897 00:30:28.386 Removing: /var/run/dpdk/spdk_pid922414 00:30:28.386 Removing: /var/run/dpdk/spdk_pid923238 00:30:28.386 Removing: /var/run/dpdk/spdk_pid924197 00:30:28.386 Removing: /var/run/dpdk/spdk_pid924753 00:30:28.386 Removing: /var/run/dpdk/spdk_pid926602 00:30:28.386 Removing: /var/run/dpdk/spdk_pid927553 00:30:28.386 Removing: /var/run/dpdk/spdk_pid927882 00:30:28.386 Removing: /var/run/dpdk/spdk_pid928213 00:30:28.386 Removing: /var/run/dpdk/spdk_pid928516 00:30:28.386 Removing: /var/run/dpdk/spdk_pid928766 00:30:28.386 Removing: /var/run/dpdk/spdk_pid928925 00:30:28.386 Removing: /var/run/dpdk/spdk_pid929095 00:30:28.386 Removing: /var/run/dpdk/spdk_pid929403 00:30:28.386 Removing: /var/run/dpdk/spdk_pid929881 00:30:28.386 Removing: /var/run/dpdk/spdk_pid932495 00:30:28.386 Removing: /var/run/dpdk/spdk_pid932725 00:30:28.386 Removing: /var/run/dpdk/spdk_pid933016 00:30:28.386 Removing: /var/run/dpdk/spdk_pid933156 00:30:28.386 Removing: /var/run/dpdk/spdk_pid933472 00:30:28.386 Removing: /var/run/dpdk/spdk_pid933608 00:30:28.386 Removing: /var/run/dpdk/spdk_pid934056 00:30:28.386 Removing: /var/run/dpdk/spdk_pid934202 00:30:28.386 Removing: /var/run/dpdk/spdk_pid934369 00:30:28.386 Removing: /var/run/dpdk/spdk_pid934511 00:30:28.386 Removing: /var/run/dpdk/spdk_pid934683 00:30:28.386 Removing: /var/run/dpdk/spdk_pid934825 00:30:28.386 Removing: /var/run/dpdk/spdk_pid935202 00:30:28.386 Removing: /var/run/dpdk/spdk_pid935362 00:30:28.386 Removing: /var/run/dpdk/spdk_pid935694 00:30:28.386 Removing: /var/run/dpdk/spdk_pid935870 00:30:28.386 Removing: /var/run/dpdk/spdk_pid936018 00:30:28.386 Removing: /var/run/dpdk/spdk_pid936079 00:30:28.386 Removing: /var/run/dpdk/spdk_pid936228 00:30:28.386 Removing: /var/run/dpdk/spdk_pid936506 00:30:28.386 Removing: /var/run/dpdk/spdk_pid936645 00:30:28.386 Removing: /var/run/dpdk/spdk_pid936806 00:30:28.386 Removing: /var/run/dpdk/spdk_pid937067 00:30:28.386 Removing: /var/run/dpdk/spdk_pid937234 00:30:28.386 Removing: /var/run/dpdk/spdk_pid937372 00:30:28.386 Removing: /var/run/dpdk/spdk_pid937652 00:30:28.386 Removing: /var/run/dpdk/spdk_pid937800 00:30:28.386 Removing: /var/run/dpdk/spdk_pid937955 00:30:28.386 Removing: /var/run/dpdk/spdk_pid938127 00:30:28.386 Removing: /var/run/dpdk/spdk_pid938381 00:30:28.386 Removing: /var/run/dpdk/spdk_pid938527 00:30:28.386 Removing: /var/run/dpdk/spdk_pid938682 00:30:28.386 Removing: /var/run/dpdk/spdk_pid938945 00:30:28.386 Removing: /var/run/dpdk/spdk_pid939110 00:30:28.386 Removing: /var/run/dpdk/spdk_pid939254 00:30:28.386 Removing: /var/run/dpdk/spdk_pid939528 00:30:28.386 Removing: /var/run/dpdk/spdk_pid939677 00:30:28.386 Removing: /var/run/dpdk/spdk_pid939837 00:30:28.386 Removing: /var/run/dpdk/spdk_pid940100 00:30:28.386 Removing: /var/run/dpdk/spdk_pid940257 00:30:28.386 Removing: /var/run/dpdk/spdk_pid940408 00:30:28.386 Removing: /var/run/dpdk/spdk_pid940633 00:30:28.386 Removing: /var/run/dpdk/spdk_pid940827 00:30:28.386 Removing: /var/run/dpdk/spdk_pid940987 00:30:28.386 Removing: /var/run/dpdk/spdk_pid941130 00:30:28.386 Removing: /var/run/dpdk/spdk_pid941410 00:30:28.386 Removing: /var/run/dpdk/spdk_pid941553 00:30:28.386 Removing: /var/run/dpdk/spdk_pid941714 00:30:28.386 Removing: /var/run/dpdk/spdk_pid941976 00:30:28.386 Removing: /var/run/dpdk/spdk_pid942142 00:30:28.386 Removing: /var/run/dpdk/spdk_pid942285 00:30:28.386 Removing: /var/run/dpdk/spdk_pid942572 00:30:28.386 Removing: /var/run/dpdk/spdk_pid942718 00:30:28.386 Removing: /var/run/dpdk/spdk_pid942883 00:30:28.386 Removing: /var/run/dpdk/spdk_pid943140 00:30:28.386 Removing: /var/run/dpdk/spdk_pid943311 00:30:28.386 Removing: /var/run/dpdk/spdk_pid943457 00:30:28.386 Removing: /var/run/dpdk/spdk_pid943738 00:30:28.386 Removing: /var/run/dpdk/spdk_pid943867 00:30:28.386 Removing: /var/run/dpdk/spdk_pid944151 00:30:28.386 Removing: /var/run/dpdk/spdk_pid946380 00:30:28.386 Clean 00:30:28.645 killing process with pid 894729 00:30:36.753 killing process with pid 894726 00:30:36.753 killing process with pid 894728 00:30:36.753 killing process with pid 894727 00:30:36.753 01:23:27 -- common/autotest_common.sh@1446 -- # return 0 00:30:36.753 01:23:27 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:36.753 01:23:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:36.753 01:23:27 -- common/autotest_common.sh@10 -- # set +x 00:30:36.753 01:23:27 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:36.753 01:23:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:36.753 01:23:27 -- common/autotest_common.sh@10 -- # set +x 00:30:36.753 01:23:27 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:36.753 01:23:27 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:36.753 01:23:27 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:36.753 01:23:27 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:36.753 01:23:27 -- spdk/autotest.sh@383 -- # hostname 00:30:36.753 01:23:27 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:37.011 geninfo: WARNING: invalid characters removed from testname! 00:31:03.564 01:23:53 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:06.906 01:23:56 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:09.443 01:23:59 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:11.978 01:24:02 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:14.515 01:24:04 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:17.054 01:24:07 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:19.587 01:24:10 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:19.846 01:24:10 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:19.846 01:24:10 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:19.846 01:24:10 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:19.846 01:24:10 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:19.846 01:24:10 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:19.846 01:24:10 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:19.846 01:24:10 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:19.846 01:24:10 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:19.846 01:24:10 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:19.846 01:24:10 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:19.846 01:24:10 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:19.846 01:24:10 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:19.846 01:24:10 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:19.846 01:24:10 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:19.846 01:24:10 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:19.846 01:24:10 -- scripts/common.sh@343 -- $ case "$op" in 00:31:19.846 01:24:10 -- scripts/common.sh@344 -- $ : 1 00:31:19.846 01:24:10 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:19.846 01:24:10 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:19.846 01:24:10 -- scripts/common.sh@364 -- $ decimal 1 00:31:19.846 01:24:10 -- scripts/common.sh@352 -- $ local d=1 00:31:19.846 01:24:10 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:19.846 01:24:10 -- scripts/common.sh@354 -- $ echo 1 00:31:19.846 01:24:10 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:19.846 01:24:10 -- scripts/common.sh@365 -- $ decimal 2 00:31:19.846 01:24:10 -- scripts/common.sh@352 -- $ local d=2 00:31:19.846 01:24:10 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:19.846 01:24:10 -- scripts/common.sh@354 -- $ echo 2 00:31:19.846 01:24:10 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:19.846 01:24:10 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:19.847 01:24:10 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:19.847 01:24:10 -- scripts/common.sh@367 -- $ return 0 00:31:19.847 01:24:10 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:19.847 01:24:10 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:19.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.847 --rc genhtml_branch_coverage=1 00:31:19.847 --rc genhtml_function_coverage=1 00:31:19.847 --rc genhtml_legend=1 00:31:19.847 --rc geninfo_all_blocks=1 00:31:19.847 --rc geninfo_unexecuted_blocks=1 00:31:19.847 00:31:19.847 ' 00:31:19.847 01:24:10 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:19.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.847 --rc genhtml_branch_coverage=1 00:31:19.847 --rc genhtml_function_coverage=1 00:31:19.847 --rc genhtml_legend=1 00:31:19.847 --rc geninfo_all_blocks=1 00:31:19.847 --rc geninfo_unexecuted_blocks=1 00:31:19.847 00:31:19.847 ' 00:31:19.847 01:24:10 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:19.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.847 --rc genhtml_branch_coverage=1 00:31:19.847 --rc genhtml_function_coverage=1 00:31:19.847 --rc genhtml_legend=1 00:31:19.847 --rc geninfo_all_blocks=1 00:31:19.847 --rc geninfo_unexecuted_blocks=1 00:31:19.847 00:31:19.847 ' 00:31:19.847 01:24:10 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:19.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.847 --rc genhtml_branch_coverage=1 00:31:19.847 --rc genhtml_function_coverage=1 00:31:19.847 --rc genhtml_legend=1 00:31:19.847 --rc geninfo_all_blocks=1 00:31:19.847 --rc geninfo_unexecuted_blocks=1 00:31:19.847 00:31:19.847 ' 00:31:19.847 01:24:10 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:19.847 01:24:10 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:19.847 01:24:10 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:19.847 01:24:10 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:19.847 01:24:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.847 01:24:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.847 01:24:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.847 01:24:10 -- paths/export.sh@5 -- $ export PATH 00:31:19.847 01:24:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.847 01:24:10 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:19.847 01:24:10 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:19.847 01:24:10 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732580650.XXXXXX 00:31:19.847 01:24:10 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732580650.EawwmP 00:31:19.847 01:24:10 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:19.847 01:24:10 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:19.847 01:24:10 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:19.847 01:24:10 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:19.847 01:24:10 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:19.847 01:24:10 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:19.847 01:24:10 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:19.847 01:24:10 -- common/autotest_common.sh@10 -- $ set +x 00:31:19.847 01:24:10 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:19.847 01:24:10 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:19.847 01:24:10 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:19.847 01:24:10 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:19.847 01:24:10 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:19.847 01:24:10 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:19.847 01:24:10 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:19.847 01:24:10 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:19.847 01:24:10 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:19.847 01:24:10 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:19.847 01:24:10 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:19.847 + [[ -n 852411 ]] 00:31:19.847 + sudo kill 852411 00:31:19.856 [Pipeline] } 00:31:19.870 [Pipeline] // stage 00:31:19.875 [Pipeline] } 00:31:19.889 [Pipeline] // timeout 00:31:19.894 [Pipeline] } 00:31:19.908 [Pipeline] // catchError 00:31:19.913 [Pipeline] } 00:31:19.929 [Pipeline] // wrap 00:31:19.937 [Pipeline] } 00:31:19.950 [Pipeline] // catchError 00:31:19.960 [Pipeline] stage 00:31:19.963 [Pipeline] { (Epilogue) 00:31:19.977 [Pipeline] catchError 00:31:19.979 [Pipeline] { 00:31:19.993 [Pipeline] echo 00:31:19.995 Cleanup processes 00:31:20.001 [Pipeline] sh 00:31:20.289 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:20.289 1210499 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:20.306 [Pipeline] sh 00:31:20.596 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:20.597 ++ grep -v 'sudo pgrep' 00:31:20.597 ++ awk '{print $1}' 00:31:20.597 + sudo kill -9 00:31:20.597 + true 00:31:20.610 [Pipeline] sh 00:31:20.896 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:33.134 [Pipeline] sh 00:31:33.421 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:33.421 Artifacts sizes are good 00:31:33.436 [Pipeline] archiveArtifacts 00:31:33.444 Archiving artifacts 00:31:33.664 [Pipeline] sh 00:31:33.978 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:33.994 [Pipeline] cleanWs 00:31:34.004 [WS-CLEANUP] Deleting project workspace... 00:31:34.004 [WS-CLEANUP] Deferred wipeout is used... 00:31:34.011 [WS-CLEANUP] done 00:31:34.014 [Pipeline] } 00:31:34.032 [Pipeline] // catchError 00:31:34.044 [Pipeline] sh 00:31:34.325 + logger -p user.info -t JENKINS-CI 00:31:34.334 [Pipeline] } 00:31:34.348 [Pipeline] // stage 00:31:34.353 [Pipeline] } 00:31:34.368 [Pipeline] // node 00:31:34.374 [Pipeline] End of Pipeline 00:31:34.403 Finished: SUCCESS